-- Logs begin at Wed 2022-07-27 22:01:22 UTC, end at Wed 2022-07-27 23:34:41 UTC. -- Jul 27 22:40:27.155829 dv-cinder-851249-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 22:40:27.164968 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 22:40:27.166935 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 22:40:27 2022] *** Jul 27 22:40:27.166935 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 22:40:27.166935 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 22:40:27.166935 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: nodename: dv-cinder-851249-4-iscsi Jul 27 22:40:27.166935 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: machine: x86_64 Jul 27 22:40:27.166935 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: clock source: unix Jul 27 22:40:27.166935 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: pcre jit disabled Jul 27 22:40:27.166935 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: detected number of CPU cores: 4 Jul 27 22:40:27.166935 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: current working directory: / Jul 27 22:40:27.166935 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: detected binary path: /usr/bin/uwsgi-core Jul 27 22:40:27.167550 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: your processes number limit is 47680 Jul 27 22:40:27.167550 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: your memory page size is 4096 bytes Jul 27 22:40:27.167550 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: detected max file descriptor number: 2048 Jul 27 22:40:27.167550 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: lock engine: pthread robust mutexes Jul 27 22:40:27.167550 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: thunder lock: enabled Jul 27 22:40:27.167550 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 22:40:27.167550 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 22:40:27.206015 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: Python main interpreter initialized at 0x563aee5e19c0 Jul 27 22:40:27.206015 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: python threads support enabled Jul 27 22:40:27.206015 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: your server socket listen backlog is limited to 100 connections Jul 27 22:40:27.206015 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: your mercy for graceful operations on workers is 90 seconds Jul 27 22:40:27.206336 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 22:40:27.206459 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: *** Operational MODE: preforking *** Jul 27 22:40:27.206677 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: *** uWSGI is running in multiple interpreter mode *** Jul 27 22:40:27.206677 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: spawned uWSGI master process (pid: 114774) Jul 27 22:40:27.206857 dv-cinder-851249-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 22:40:27.207511 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: spawned uWSGI worker 1 (pid: 114775, cores: 1) Jul 27 22:40:27.208586 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: spawned uWSGI worker 2 (pid: 114776, cores: 1) Jul 27 22:40:27.208586 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 22:40:27.863098 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 22:40:27.863710 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 22:40:28.942423 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 22:40:28.942423 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: from cryptography.utils import int_from_bytes Jul 27 22:40:28.943098 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 22:40:28.943098 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: from cryptography.utils import int_from_bytes Jul 27 22:40:28.946536 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 22:40:28.946536 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: from cryptography.utils import int_from_bytes Jul 27 22:40:28.946951 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 22:40:28.946951 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: from cryptography.utils import int_from_bytes Jul 27 22:40:31.438371 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 22:40:31.438889 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 22:40:31.439043 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 22:40:31.439227 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 22:40:31.439580 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 22:40:31.439665 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 22:40:31.439752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 22:40:31.439999 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.440088 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 22:40:31.440317 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.440413 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 22:40:31.440628 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 22:40:31.440737 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.440965 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.441062 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.441288 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.441401 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.442152 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.442263 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.442473 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.442590 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.442784 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.442888 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.443106 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.443208 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.443366 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.443500 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.443671 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.443817 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.443987 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851249-4-iscsi {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.444143 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.444300 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.444407 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.444716 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.444830 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.444919 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.445055 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851249-4-iscsi {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.445225 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.445380 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.445524 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.445685 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.445838 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.445993 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.446136 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.446308 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.446610 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.446703 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.446929 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.447045 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.447241 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.447355 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.447637 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.447751 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.447969 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.448096 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.448277 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.448413 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.448601 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.448744 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.448919 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.449055 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.449222 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.449363 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.449539 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.449666 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.449843 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.449971 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.450143 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.450271 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851249-4-iscsi {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.450465 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.450657 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.450853 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.451054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.451264 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.451422 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851249-4-iscsi {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.451422 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.451781 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.451994 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.452152 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.452380 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.452597 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.452597 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.452946 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.453113 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.453236 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.453397 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.453545 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.453739 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.453877 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.454001 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.454160 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.454372 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.454506 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.454630 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.454751 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.454873 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.455004 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.455127 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.455248 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.455372 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.455518 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.455643 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.455773 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.455901 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.456031 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.456154 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.456276 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.456399 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.456533 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.456708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.456840 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.456963 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.457127 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.457257 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.457388 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.457512 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.457638 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.457762 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.457885 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.458020 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.458200 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.458328 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.458451 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.458586 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.458720 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.458854 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.458977 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.459100 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.459234 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.459364 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.459495 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.459620 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.459741 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.459864 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.460018 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.460160 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.460322 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.460449 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.460650 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.460790 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.460958 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.461094 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.461261 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.461401 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.461564 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.461691 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.461869 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.462014 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.462188 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.462315 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.462502 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.462628 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.462822 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.462965 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.463121 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.463246 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.463435 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.463560 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.463785 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.463934 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.464060 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.464189 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.464342 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.464471 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.464693 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.464824 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.464997 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.465125 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.465297 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.465424 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.465595 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.465724 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.465907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.466035 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.466209 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.466334 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.466512 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.466645 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.466777 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.466899 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.467274 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.467402 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.467573 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.467701 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.467884 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.468012 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.468183 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.468320 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.468482 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.468664 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.468791 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.468913 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.469088 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.469229 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.469388 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.469516 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.469685 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.469819 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.469984 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.470121 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.470279 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.470413 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.470573 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.470699 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.470871 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.471007 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.471170 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.471304 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.471465 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.471597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.471761 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.471901 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.472059 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.472186 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.472364 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.472493 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.472707 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.472835 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.473012 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.473139 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.473313 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.473452 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.473614 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.473756 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.473972 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.474097 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.474220 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.474342 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.474495 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.474633 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.474800 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.474928 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.475096 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.475223 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.475393 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.475533 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.475703 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.475828 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.476001 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.476127 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.476301 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.476429 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.476621 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.476768 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.476922 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.477049 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.477222 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.477355 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.477524 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.477660 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.477821 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.477947 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.478120 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.478249 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.478415 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.478542 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.478712 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.478848 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.479009 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.479145 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.479305 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.479445 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.479601 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.479808 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.479934 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.480055 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.480176 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.480304 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.480469 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.480628 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.480793 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.480922 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.481094 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.481221 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.481391 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.481526 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.481691 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.481828 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.482005 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.482133 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.482308 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.482443 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.482613 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.482741 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.482918 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.483046 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.483234 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:40:31.483370 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.483566 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.483693 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.483887 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.484092 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.484219 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.484349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.484495 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.484675 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.484831 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.484958 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.485154 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.485284 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.485461 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.485589 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.485768 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.485905 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.486074 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.486201 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.486387 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.486515 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.486694 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.486828 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.487005 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.487133 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.487314 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.487467 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.487635 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.487769 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.487924 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.488052 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.488231 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.488880 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.489104 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.489245 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.489422 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.489549 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.489733 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.489859 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.490039 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.490174 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.490355 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.490483 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.490683 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.490812 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.490989 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.491128 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.491298 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.491425 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.491609 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.491743 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.491915 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.492051 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.492219 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.492355 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.492522 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.492695 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.492868 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.493004 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.493191 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.493324 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.493496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.493622 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.493801 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.493936 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.494141 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.494284 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.494409 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.494532 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.494700 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.494838 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.495005 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.495134 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.495312 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.495440 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.495638 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.495773 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.495944 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.496077 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.496251 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.496387 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.496572 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.496715 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.496890 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.497027 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.497196 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.497333 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.497502 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.497631 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.497808 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.497936 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.498105 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.498244 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.498404 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.498533 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.498701 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.498829 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.499002 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.499139 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.499301 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.499430 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.499606 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.499747 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.499909 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.500038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.500207 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.500332 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.500506 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.500666 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.500849 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.500985 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.501153 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.501278 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.501458 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.501585 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.501763 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.501893 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.502063 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.502191 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.502371 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.502496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.502705 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.502839 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.502963 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.503085 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.503261 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.503396 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.503562 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.503687 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.503862 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.504021 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.504779 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.504925 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.505075 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.505213 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.505378 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.505506 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.505686 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.505825 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.505993 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.506128 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.506300 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.506428 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.506607 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.506745 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.506913 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.507043 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.507220 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.507346 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.507526 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.507660 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.507832 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.507959 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.508127 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.508253 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.508449 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.508629 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.508767 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.508890 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.509082 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.509211 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.509400 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.509530 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.509712 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.509857 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.510010 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.510139 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.510314 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.510445 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.510610 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.510737 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.510907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.511044 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.511204 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.511333 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.511508 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.511635 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.511806 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.511941 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.512100 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.512227 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.512395 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.512523 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.512717 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.512857 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.513020 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.513153 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.513319 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.513446 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.513621 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.513757 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.513917 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.514050 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.514214 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.514348 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.514510 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.514647 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.514857 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.514991 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.515114 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.515248 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.515382 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.515506 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.515694 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.515823 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.516034 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.516162 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.516338 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.516467 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.516678 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.516805 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.516991 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.517120 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.517297 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.517426 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.517601 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.517729 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.517908 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.518044 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.518214 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.518341 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.518520 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.518655 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.518823 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.518957 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.519129 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.519255 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.519430 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.519605 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.519794 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.519935 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.520099 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.520234 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.520415 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.520575 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.520742 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.520883 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.521051 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.521179 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.521357 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.521494 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.521677 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.521819 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.521983 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.522111 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.522297 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.522423 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.522602 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.522732 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.522916 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.523043 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.523220 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.523341 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.523526 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.523662 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.523831 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.523959 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.524136 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.524280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.524441 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.524606 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.524773 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.524977 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.525104 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.525225 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.525360 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.525492 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.525680 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.525809 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.525978 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.526113 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.526289 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.526424 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.526589 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.526726 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.526897 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.527036 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.527200 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.527326 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.527518 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.527645 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.527821 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.527957 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.528127 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.528255 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.528440 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.528600 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.528773 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.528915 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.529079 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.529207 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.529384 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.529512 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.529684 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.529813 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.529984 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.530112 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.530288 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.530423 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.530595 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.530721 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.530896 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.531021 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.531195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.531329 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.531529 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.531653 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.531776 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.531898 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.532076 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.532205 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.532375 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.532508 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.532697 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.532831 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.532999 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.533137 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.533303 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.533441 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.533607 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.533743 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.533909 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.534046 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.534219 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.534348 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.534516 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.534641 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.534816 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.534972 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.535164 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.535807 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.535930 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.536052 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.536233 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.536371 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.536534 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.536685 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.536854 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.536994 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.537192 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.537332 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.537497 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.537625 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.537794 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.537922 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.538104 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.538240 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.538419 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.538555 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.538724 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.538851 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.539033 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.539162 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.539336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.539471 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.539640 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.539768 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.539946 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.540082 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.540251 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.540387 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.540599 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.540744 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.540878 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.541001 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.541176 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.541311 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.541481 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.541619 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.541785 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.541911 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.542095 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.542222 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.542395 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.542530 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.542700 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.542836 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.543005 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.543133 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.543303 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.543444 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.543611 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.543740 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.543918 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.544056 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.544227 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.544473 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.544620 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.544840 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.544968 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.545209 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.545364 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.545489 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.545709 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.545837 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.546042 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.546168 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.546362 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.546489 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.546679 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.546805 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.546997 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.547124 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.547301 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.547440 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.547606 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.547733 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.547906 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.548041 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.548205 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.548341 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.548512 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.548689 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.548823 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.548958 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.549123 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.549252 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.549422 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.549551 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.549727 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.549855 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.550026 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.550162 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.550325 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.550455 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.550623 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.550759 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.551486 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.551617 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.551795 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.551932 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.552099 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.552228 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.552402 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.552539 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.552727 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.552853 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.553039 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.553175 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.553341 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.553477 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.553646 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.553773 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.553945 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.554073 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.554245 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.554383 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.554557 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.554683 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.554860 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.554996 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.555165 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.555320 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.555512 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.555646 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.555791 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.555920 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.556134 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.556261 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.556385 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.556495 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.556725 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.556853 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.557026 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.557156 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.557324 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.557449 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.557613 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.557756 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.557919 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.558048 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.558224 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.558353 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.558522 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.558659 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.558828 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.558956 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.559133 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.559269 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.559439 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.559575 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.559742 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.559877 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.560037 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.560171 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.560341 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.560479 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.560664 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.560793 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.560971 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.561109 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.561271 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.561411 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.561570 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.561706 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.561866 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.561995 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.562170 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.562307 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.562472 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.562600 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.562766 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.562892 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.563063 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.563192 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.563357 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.563483 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.563664 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.563785 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.563959 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.564086 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.564257 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.564385 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.564598 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.564730 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.564867 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.564991 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.565170 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.565305 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.565466 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.565682 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.565821 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.565945 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.566080 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.566204 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.566355 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.566514 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.566675 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.566804 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.566979 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.567106 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.567277 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.567413 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.567573 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.567700 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.567872 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.567999 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.568182 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.568319 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.568484 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.568630 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.568807 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.568947 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.569112 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.569249 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.569411 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.569539 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.569711 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.569840 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.570008 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.570138 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.570313 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.570440 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.570606 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.570732 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.570902 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.571032 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.571197 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.571325 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.571493 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.571621 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.571788 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.571926 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.572085 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.572211 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.572385 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.572513 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.572705 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.572838 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.572989 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.573119 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.573287 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.573429 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.573600 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.573726 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.573905 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.574032 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.574211 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.574348 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.574513 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.574649 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.574827 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.574961 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.575139 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.575275 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.575440 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.575566 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.575769 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.575914 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.576046 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.576181 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.576330 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.576459 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.576664 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.576806 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.576971 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.577108 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.577279 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.577407 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.577576 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.577704 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.577873 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.577995 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.578185 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.578312 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.578487 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.578612 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.578785 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.578913 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.579088 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.579215 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.579400 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.579526 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.579709 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.579844 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.580004 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.580130 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.580305 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.580443 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.580633 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.580776 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.580940 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.581069 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.581246 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.581383 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.581551 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.581677 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.581853 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.581979 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.582185 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.582321 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.582491 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.582619 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.582796 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.582930 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.583099 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.583235 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.583400 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.583529 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.583707 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.583833 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.584009 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.584201 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.584327 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.584449 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.584634 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.584775 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.584938 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.585066 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.585237 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.585373 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.585538 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.585665 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.585818 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.586008 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.586135 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.586257 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.586410 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.586538 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.586747 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.586875 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.587052 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.587188 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.587364 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.587501 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.587668 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.587798 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.587984 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.588115 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.588287 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.588424 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.588619 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.588751 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.588930 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.589058 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.589228 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.589369 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.589590 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.589717 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.589905 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.590041 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.590218 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.590357 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.590522 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.590650 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.590818 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.590946 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.591116 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.591244 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.591417 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.591545 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.591735 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.591864 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.592290 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.592420 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.592608 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.592740 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.592910 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.593039 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.593226 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.593357 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.593532 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.593669 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.593845 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.593972 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.594150 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.594287 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.594469 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.594606 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.594772 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.594909 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.595092 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.595221 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.595505 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.595633 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.595806 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.595946 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.596160 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.596287 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.596417 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.596538 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.596754 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.596889 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.597054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.597192 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.597363 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.597490 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.598173 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.598336 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.598503 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.598642 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.598821 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.598949 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.599128 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.599256 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.599437 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.599572 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.599734 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.599860 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.600050 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.600180 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.600362 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.600497 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.600692 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.600820 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.600995 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.601121 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.601316 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.601447 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.601636 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.601771 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.601949 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.602085 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.602269 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.602398 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.602597 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.602731 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.602899 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.603026 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.603199 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.603328 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.603503 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.603631 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.603803 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.603940 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.604108 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.604229 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.604424 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.604584 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.604749 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.604890 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.605057 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.605186 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.605359 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.605493 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.605663 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.605798 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.605962 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.606089 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.606294 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.606421 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.606552 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.606690 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.606848 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.606967 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.607146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.607272 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.607450 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.607580 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.607746 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.607872 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.608055 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.608181 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.608354 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.608481 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.608697 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.608828 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.608999 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.609126 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.609296 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.609432 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.609597 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.609725 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.609898 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.610026 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.610204 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.610331 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.610507 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.610636 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.610810 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.610951 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.611114 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.611242 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.611436 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.611563 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.611742 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.611880 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.612057 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.612183 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.612375 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.612510 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.612714 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.612856 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.613023 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.613150 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.613403 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.614020 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.614209 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.614352 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.614510 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.614638 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.614815 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.614936 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.615115 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.615245 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.615415 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.615543 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.615713 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.615841 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.616017 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.616147 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.616360 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.616494 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.616650 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.616775 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.616908 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.617034 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.617221 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.617350 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.617520 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.617656 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.617818 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.617953 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.618121 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.618258 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.618418 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.618554 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.618717 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.618845 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.619015 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.619151 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.619326 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.619462 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.619629 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.619758 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.619933 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.620061 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.620234 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.620372 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.620597 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.620729 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.620884 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.621029 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.621187 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.621326 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.621506 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.621643 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.621818 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.621950 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.622126 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.622255 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.622435 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.622562 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.622743 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.622869 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.623051 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.623181 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.623360 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.623490 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.623670 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.623797 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.623966 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.624091 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.624272 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.624394 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.624600 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.624746 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.624916 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.625047 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.625221 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.625428 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.625565 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.625752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.625894 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.626063 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.626192 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.626371 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.626638 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.626785 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.626967 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.627095 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.627274 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.627409 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.627580 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.627723 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.627887 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.628015 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.628189 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.628324 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.628494 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.628675 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.628801 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.628944 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.629141 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.629271 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.629452 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.629591 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.629761 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.629890 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.630076 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.630203 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.630390 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.630519 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.630701 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.630831 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.631012 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.631213 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.631347 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.631477 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.631614 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.631738 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.631928 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.632069 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.632242 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.632378 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.632572 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.632703 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.632883 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.633015 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.633191 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.633320 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.633500 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.633628 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.633811 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.633940 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.634122 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.634252 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.634425 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.634551 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.634728 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.634858 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.635038 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.635172 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.635344 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.635479 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.635651 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.635778 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.635958 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.636096 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.636271 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.636411 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.636632 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.636771 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.636896 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.637020 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.637205 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.637347 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.637646 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.637773 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.637962 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.638105 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.638277 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.638413 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.638590 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.638719 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.638944 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.639109 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.639255 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.639430 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.639559 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.639763 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.639891 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.640091 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.640234 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.640417 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.640545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.640747 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.640874 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.641053 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.641195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.641353 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.641481 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.641667 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.641794 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.641969 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.642097 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.642264 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.642391 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.642572 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.642699 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.642871 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.643002 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.643185 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.643391 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.643521 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.643728 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.643864 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.644046 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.644174 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.644367 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.644496 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.644733 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.644940 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.645070 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.645281 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.645412 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.645600 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.645738 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.645926 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.646054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.646222 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.646357 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.646532 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.646690 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.646882 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.647009 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.647132 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.647255 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.647406 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.647546 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.647710 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.647847 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.648015 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.648143 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.648314 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.648455 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.648642 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.648766 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.648942 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.649071 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.649249 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.649384 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.649550 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.649677 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.649849 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.649985 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.650133 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.650380 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.650508 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.650639 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.650764 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.650886 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.651018 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.651143 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.651289 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.651426 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.651585 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.651714 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.651891 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.652021 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.652187 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.652314 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.652487 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.652781 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.652920 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.653043 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.653166 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.653296 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.653421 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.653553 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.653686 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.653820 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.653973 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.654108 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.654275 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.654414 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.654583 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.654712 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.654878 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.655013 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.655181 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.655318 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.655482 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.655618 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.655798 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.655936 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.656105 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.656234 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.656403 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.656530 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.656746 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.656890 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.657078 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.657207 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.657358 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.657571 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.657710 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.657899 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.658038 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.658216 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.658352 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.658542 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.658670 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.658867 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.659093 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.659223 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.659426 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.659554 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.659741 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.659881 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.660058 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.660755 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.660966 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.661095 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.661221 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.661439 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.661570 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.661750 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.661879 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.662060 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.662189 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.662367 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.662505 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.662672 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.662800 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.662977 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.663115 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.663282 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.663411 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.663586 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.663715 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.663891 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.664031 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.664193 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.664329 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.664497 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.664670 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.664827 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.664969 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.665131 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.665258 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.665436 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.665564 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.665740 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.665867 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.666048 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.666178 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.666356 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.666494 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.666663 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.666799 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.666973 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.667109 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.667278 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.667415 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.667582 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.667711 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.667883 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.668012 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.668185 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.668321 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.668495 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.668651 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.668828 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.668950 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.669135 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.669273 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.669440 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.669570 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.669755 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.669881 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.670079 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.670219 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.670392 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.670520 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.670696 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.670824 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.671044 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.671195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.671360 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.671489 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.671676 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.671813 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.671981 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.672110 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.672296 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.672425 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.672625 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.672757 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.672951 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.673080 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.673263 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.673391 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.673583 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.673713 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.673894 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.674023 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.674192 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.674318 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.674498 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.674634 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.674797 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.674919 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.675101 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.675229 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.675413 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.675551 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.675717 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.675888 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.676612 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.676757 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.676928 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.677067 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.677235 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.677370 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.677538 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.677666 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.677839 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.677978 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.678140 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.678268 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.678438 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.678566 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.678747 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.678874 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.679040 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.679165 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.679338 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.679475 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.679637 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.679766 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.679935 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.680065 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.680232 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.680366 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.680527 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.680673 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.680852 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.680978 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.681183 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.681317 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.681455 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.681581 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.681716 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.681848 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.682009 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.682213 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.682340 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.682463 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.682586 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.682708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.682887 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.683025 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.683190 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.683326 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.683491 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.683627 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.683808 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.683949 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.684122 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.684258 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.684423 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.684574 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.684765 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.684893 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.685078 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.685207 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.685384 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.685509 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.685687 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.685816 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.686001 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.686127 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.686301 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.686429 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.686606 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.686735 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.686910 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.687037 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.687210 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.687338 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.687512 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.687649 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.687814 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.687950 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.688127 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.688263 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.688477 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.688666 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.688793 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.688915 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.689061 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.689198 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.689367 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.689496 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.689680 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.689809 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.689984 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.690121 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.690288 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.690415 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.690607 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.690734 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.690910 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.691037 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.691227 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.691441 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.691576 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.691707 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.691845 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.691971 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.692123 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.692259 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.692433 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.692581 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.692767 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.692896 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.693072 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.693199 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.693378 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.693515 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.693683 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.693810 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.693989 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.694115 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.694300 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.694438 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.694609 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.694737 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.694919 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.695045 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.695235 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.695370 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.695553 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.695686 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.695861 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.695990 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.696185 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.696322 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.696505 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.696689 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.696840 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.696968 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.697148 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.697279 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.697449 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.697577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.697700 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 22:40:31.697824 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.698104 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.698416 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.698719 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:40:31.698964 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 22:40:31.850317 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO dbcounter [None req-521b1261-d16a-413e-941f-a216e489518e None None] Registered counter for database nova_api Jul 27 22:40:31.851977 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO dbcounter [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Registered counter for database nova_api Jul 27 22:40:31.870059 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG oslo_db.sqlalchemy.engines [None req-521b1261-d16a-413e-941f-a216e489518e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:40:31.871869 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_db.sqlalchemy.engines [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:40:31.876790 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG dbcounter [-] [114775] Writer thread running {{(pid=114775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:40:31.878408 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writer thread running {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:40:31.932886 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.context [None req-521b1261-d16a-413e-941f-a216e489518e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fe71611c-dbfe-47bb-b77e-29ffa97fa073(cell1) {{(pid=114775) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 22:40:31.934574 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.context [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fe71611c-dbfe-47bb-b77e-29ffa97fa073(cell1) {{(pid=114776) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 22:40:31.936837 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG oslo_concurrency.lockutils [None req-521b1261-d16a-413e-941f-a216e489518e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:40:31.938387 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG oslo_concurrency.lockutils [None req-521b1261-d16a-413e-941f-a216e489518e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:40:31.938585 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:40:31.939187 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG oslo_concurrency.lockutils [None req-521b1261-d16a-413e-941f-a216e489518e None None] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:40:31.940094 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:40:31.940907 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:40:31.941320 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG oslo_concurrency.lockutils [None req-521b1261-d16a-413e-941f-a216e489518e None None] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:40:31.943538 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:40:31.943838 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO dbcounter [None req-521b1261-d16a-413e-941f-a216e489518e None None] Registered counter for database nova_cell0 Jul 27 22:40:31.945531 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO dbcounter [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Registered counter for database nova_cell0 Jul 27 22:40:31.949216 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO dbcounter [None req-521b1261-d16a-413e-941f-a216e489518e None None] Registered counter for database nova_cell1 Jul 27 22:40:31.950943 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO dbcounter [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Registered counter for database nova_cell1 Jul 27 22:40:31.956226 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG oslo_db.sqlalchemy.engines [None req-521b1261-d16a-413e-941f-a216e489518e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:40:31.958350 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_db.sqlalchemy.engines [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:40:31.960576 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG oslo_db.sqlalchemy.engines [None req-521b1261-d16a-413e-941f-a216e489518e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:40:31.961832 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_db.sqlalchemy.engines [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:40:31.963505 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG dbcounter [-] [114775] Writer thread running {{(pid=114775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:40:31.968138 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writer thread running {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:40:31.970353 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writer thread running {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:40:32.104402 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG dbcounter [-] [114775] Writer thread running {{(pid=114775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:40:32.112236 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO dbcounter [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Registered counter for database nova_cell0 Jul 27 22:40:32.114921 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO dbcounter [None req-521b1261-d16a-413e-941f-a216e489518e None None] Registered counter for database nova_cell0 Jul 27 22:40:32.122009 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_db.sqlalchemy.engines [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:40:32.125179 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG oslo_db.sqlalchemy.engines [None req-521b1261-d16a-413e-941f-a216e489518e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:40:32.126371 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writer thread running {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:40:32.130484 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG dbcounter [-] [114775] Writer thread running {{(pid=114775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:40:32.463056 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: WARNING keystonemiddleware.auth_token [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 22:40:32.468222 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: WARNING keystonemiddleware.auth_token [None req-521b1261-d16a-413e-941f-a216e489518e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 22:40:32.470630 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: WARNING keystonemiddleware.auth_token [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 22:40:32.475989 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: WARNING keystonemiddleware.auth_token [None req-521b1261-d16a-413e-941f-a216e489518e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 22:40:32.811326 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: WARNING keystonemiddleware.auth_token [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 22:40:32.817322 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: WARNING keystonemiddleware.auth_token [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 22:40:32.819616 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: WARNING keystonemiddleware.auth_token [None req-521b1261-d16a-413e-941f-a216e489518e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 22:40:32.822550 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563aee5e19c0 pid: 114776 (default app) Jul 27 22:40:32.824616 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:40:32.825596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: WARNING keystonemiddleware.auth_token [None req-521b1261-d16a-413e-941f-a216e489518e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 22:40:32.825783 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Jul 27 22:40:32.826186 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Wed Jul 27 22:40:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:40:32.830837 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563aee5e19c0 pid: 114775 (default app) Jul 27 22:41:48.073600 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:41:48.074631 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 27 22:41:48.075186 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:41:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:41:48.087499 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG dbcounter [-] [114775] Writing DB stats nova_api:SELECT=3 {{(pid=114775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:48.088426 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG dbcounter [-] [114775] Writing DB stats nova_cell1:SELECT=3 {{(pid=114775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:48.089350 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG dbcounter [-] [114775] Writing DB stats nova_cell0:SELECT=3 {{(pid=114775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:48.090101 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG dbcounter [-] [114775] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:48.948949 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-e22b53f3-b2b3-4492-b8d3-82cb878e53b7 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:41:48.984670 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-e22b53f3-b2b3-4492-b8d3-82cb878e53b7 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.902205 Jul 27 22:41:48.986270 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Jul 27 22:41:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:41:51.344296 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:41:51.345324 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-712566f8-5c8a-488e-b218-365c17d9782f None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 27 22:41:51.345926 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:41:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:41:51.758215 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-22610f04-bcac-4c63-b082-2dfd8537bfc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0}} {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:41:51.779129 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:41:51.779129 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: warnings.warn(msg) Jul 27 22:41:51.808652 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-22610f04-bcac-4c63-b082-2dfd8537bfc8 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.456372 Jul 27 22:41:51.809224 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 22:41:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:41:52.035037 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-db5ec261-3bf3-49e8-9171-83ab991f968d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:41:52.039799 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:41:52.039799 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: warnings.warn(msg) Jul 27 22:41:52.042880 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writing DB stats nova_api:SELECT=3 {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:52.043735 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writing DB stats nova_cell1:SELECT=3 {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:52.044792 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writing DB stats nova_cell0:SELECT=3 {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:52.045521 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:52.116001 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-db5ec261-3bf3-49e8-9171-83ab991f968d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.297792 Jul 27 22:41:52.116630 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jul 27 22:41:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:41:54.325575 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-22610f04-bcac-4c63-b082-2dfd8537bfc8 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:41:54.326607 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-22610f04-bcac-4c63-b082-2dfd8537bfc8 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 27 22:41:54.327019 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:41:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:41:54.973376 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-b7a75519-9d70-40f6-82d9-30ab8412e9ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1"}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:41:54.992659 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:41:54.992659 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: warnings.warn(msg) Jul 27 22:41:55.011540 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-b7a75519-9d70-40f6-82d9-30ab8412e9ab admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.675687 Jul 27 22:41:55.012316 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 22:41:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:41:55.023810 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-905ab71c-bd55-400e-9a54-0c0d7587a215 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:41:55.026603 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:41:55.026603 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: warnings.warn(msg) Jul 27 22:41:55.060056 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-905ab71c-bd55-400e-9a54-0c0d7587a215 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039880 Jul 27 22:41:55.060785 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jul 27 22:41:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:41:57.325030 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-b7a75519-9d70-40f6-82d9-30ab8412e9ab admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:41:57.326050 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-b7a75519-9d70-40f6-82d9-30ab8412e9ab admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 27 22:41:57.327031 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:41:57.719336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-bd922231-3733-45dc-ab0b-6221e1e99118 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G"}} {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:41:57.738091 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-bd922231-3733-45dc-ab0b-6221e1e99118 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.405214 Jul 27 22:41:57.738692 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 22:41:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:41:57.750437 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-939744c2-7536-43f1-9b52-b4be5f35dbb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:41:57.773595 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-939744c2-7536-43f1-9b52-b4be5f35dbb2 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026945 Jul 27 22:41:57.774153 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jul 27 22:41:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:42:00.000195 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-bd922231-3733-45dc-ab0b-6221e1e99118 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:00.002174 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-bd922231-3733-45dc-ab0b-6221e1e99118 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002769 Jul 27 22:42:00.003338 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:41:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:00.452652 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-3ce13425-d354-4e30-a48e-80ae94f5c21a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "id": "d3", "swap": 0, "vcpus": 2, "name": "ds2G"}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:00.484209 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-3ce13425-d354-4e30-a48e-80ae94f5c21a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473562 Jul 27 22:42:00.485496 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 22:42:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:42:00.501376 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-67da2394-16e7-416d-af84-10f94ce9f501 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:00.539076 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-67da2394-16e7-416d-af84-10f94ce9f501 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041692 Jul 27 22:42:00.548057 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jul 27 22:42:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:42:02.731612 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-3ce13425-d354-4e30-a48e-80ae94f5c21a admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:02.732640 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-3ce13425-d354-4e30-a48e-80ae94f5c21a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 27 22:42:02.733040 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:42:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:03.164435 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-3e95e115-9d1a-41b2-adab-079d764730c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0}} {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:03.184898 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-3e95e115-9d1a-41b2-adab-079d764730c7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445060 Jul 27 22:42:03.192834 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 22:42:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:42:03.197771 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-14be49ce-d65b-4f82-9d4e-e9f56c59d283 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:03.223856 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-14be49ce-d65b-4f82-9d4e-e9f56c59d283 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029691 Jul 27 22:42:03.224502 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1335 bytes} [Wed Jul 27 22:42:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:42:05.424621 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-3e95e115-9d1a-41b2-adab-079d764730c7 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:05.425644 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-3e95e115-9d1a-41b2-adab-079d764730c7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Jul 27 22:42:05.426047 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:05.849976 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-00914206-96ae-4d49-875d-fc45eaeb750f admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:05.874685 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-00914206-96ae-4d49-875d-fc45eaeb750f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.442513 Jul 27 22:42:05.875220 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Jul 27 22:42:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:42:08.099699 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-3e95e115-9d1a-41b2-adab-079d764730c7 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:08.100767 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-3e95e115-9d1a-41b2-adab-079d764730c7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 27 22:42:08.101179 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:42:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:08.531528 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-1d0a8312-dcc1-4ef3-9e89-36976efc76db admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "rxtx_factor": 1.0, "ram": 512}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:08.551833 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-1d0a8312-dcc1-4ef3-9e89-36976efc76db admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.443228 Jul 27 22:42:08.552390 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 22:42:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:42:08.564166 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-0411754f-1215-4e4d-b280-6a4267bff1c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:08.590082 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-0411754f-1215-4e4d-b280-6a4267bff1c7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029583 Jul 27 22:42:08.590774 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jul 27 22:42:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:42:10.988817 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-1d0a8312-dcc1-4ef3-9e89-36976efc76db admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:10.989820 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-1d0a8312-dcc1-4ef3-9e89-36976efc76db admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 27 22:42:10.990216 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:42:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:11.384983 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-3074e749-2b52-46a0-93ea-7c203f95670b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:11.405252 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-3074e749-2b52-46a0-93ea-7c203f95670b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.409122 Jul 27 22:42:11.405874 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 22:42:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:42:11.419195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-d7b2186a-e2dd-4c0b-bfec-cda1866348b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:11.442816 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-d7b2186a-e2dd-4c0b-bfec-cda1866348b8 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027249 Jul 27 22:42:11.443381 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jul 27 22:42:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:42:13.623908 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-3074e749-2b52-46a0-93ea-7c203f95670b admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:13.624961 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-3074e749-2b52-46a0-93ea-7c203f95670b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 27 22:42:13.625394 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:42:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:13.988126 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-295510f1-4a1c-437f-8d4f-0bf8e87a8eef admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:14.006393 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-295510f1-4a1c-437f-8d4f-0bf8e87a8eef admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.374095 Jul 27 22:42:14.006927 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 22:42:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:42:14.019266 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-7be63beb-009e-4f39-b00e-362e29c6faab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:14.043504 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-7be63beb-009e-4f39-b00e-362e29c6faab admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028441 Jul 27 22:42:14.044070 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jul 27 22:42:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:42:16.264690 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-295510f1-4a1c-437f-8d4f-0bf8e87a8eef admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:16.265707 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-295510f1-4a1c-437f-8d4f-0bf8e87a8eef admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 27 22:42:16.266119 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:42:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:16.697984 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-cb4f87dc-38a3-4dd3-a943-4f0202cf8b4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4}} {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:16.718278 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-cb4f87dc-38a3-4dd3-a943-4f0202cf8b4b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.445560 Jul 27 22:42:16.718844 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 22:42:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:42:16.731178 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-1cbb94ef-3827-4ecc-96a1-218d5b398a79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:16.758003 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-1cbb94ef-3827-4ecc-96a1-218d5b398a79 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030795 Jul 27 22:42:16.758688 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jul 27 22:42:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:42:18.977445 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-cb4f87dc-38a3-4dd3-a943-4f0202cf8b4b admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:18.978455 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-cb4f87dc-38a3-4dd3-a943-4f0202cf8b4b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 27 22:42:18.978858 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:42:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:19.415419 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-0d8459bb-d45f-48ce-a99d-9903a5bc8d75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "ram": 16384, "swap": 0, "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:19.435054 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-0d8459bb-d45f-48ce-a99d-9903a5bc8d75 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.450323 Jul 27 22:42:19.435629 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1282 bytes} [Wed Jul 27 22:42:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:42:19.448107 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-7857bc20-5912-4a12-bd65-e22d8f0ceeeb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:19.452997 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG dbcounter [-] [114775] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=114775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:19.475476 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-7857bc20-5912-4a12-bd65-e22d8f0ceeeb admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031051 Jul 27 22:42:19.476281 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1332 bytes} [Wed Jul 27 22:42:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:42:39.339596 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-0d8459bb-d45f-48ce-a99d-9903a5bc8d75 admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:39.340638 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-0d8459bb-d45f-48ce-a99d-9903a5bc8d75 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 27 22:42:39.341040 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:42:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:39.723462 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-b384d446-83e9-4b91-a489-8af200b9d0ac admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:39.741608 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-b384d446-83e9-4b91-a489-8af200b9d0ac admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.394313 Jul 27 22:42:39.742141 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Jul 27 22:42:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:42:40.801449 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-0d8459bb-d45f-48ce-a99d-9903a5bc8d75 admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:40.802455 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-0d8459bb-d45f-48ce-a99d-9903a5bc8d75 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 27 22:42:40.802853 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 22:42:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:41.319628 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-f486fd6a-4c55-4c5a-9441-4ccd5908050a admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:41.325463 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.wsgi [None req-f486fd6a-4c55-4c5a-9441-4ccd5908050a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-f486fd6a-4c55-4c5a-9441-4ccd5908050a admin admin] Request method failure captured: Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Accept: application/json Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Accept-Encoding: gzip, deflate Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Connection: keep-alive Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Content-Length: 0 Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Host: 10.222.0.47 Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Openstack-Api-Version: compute 2.90 Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Openstack-System-Scope: None Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: User-Agent: python-novaclient Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Auth-Token: gAAAAABi4b9gBwzmyC6BohrTdSNBlUHtu1qrCPPDZgiF5CbalmYWHCpYzeN9iBpF9Ec2Fkr6QgQxWlfmrX8smwuf3YGJmVCKbg8OVlpOOTDf8uBV42nzWTv6emCfGXojQZuMvn4v6I7-ZP7vuDXJz10aFf9sJfEBFARbeu5XcTVcFr54DPufOgo Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Domain-Id: None Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Domain-Name: None Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Identity-Status: Confirmed Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Is-Admin-Project: True Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Project-Domain-Id: default Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Project-Domain-Name: Default Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Project-Id: f2cfa132043645ed9aba908b2c5ec402 Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Project-Name: admin Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Role: admin,member,reader Jul 27 22:42:41.328708 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Roles: admin,member,reader Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f2cfa132043645ed9aba908b2c5ec402", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Tenant: admin Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Tenant-Id: f2cfa132043645ed9aba908b2c5ec402 Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Tenant-Name: admin Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User: admin Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User-Domain-Id: default Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User-Domain-Name: Default Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User-Id: 5ba59e69401e48aa98a715630f5ff904 Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User-Name: admin Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: method: > Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: exception: Flavor 42 could not be found. Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: action_args: {'id': '42'} Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:42:41.330336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:42:41.332352 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:41.333596 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-f486fd6a-4c55-4c5a-9441-4ccd5908050a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:42:41.334633 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-f486fd6a-4c55-4c5a-9441-4ccd5908050a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387605 Jul 27 22:42:41.334633 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Jul 27 22:42:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:41.339690 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-d444d9ca-644e-4281-b83d-badd747ed61e admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:41.343981 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:41.363981 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-d444d9ca-644e-4281-b83d-badd747ed61e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027813 Jul 27 22:42:41.364521 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jul 27 22:42:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:42:41.374181 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-37197e82-eb6f-4243-8d58-5cec373b7a99 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:41.397753 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-37197e82-eb6f-4243-8d58-5cec373b7a99 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027194 Jul 27 22:42:41.398299 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jul 27 22:42:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:42:41.407418 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-a285d2ec-28c1-47da-b0df-9fbb7e7fa792 admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:41.414961 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.wsgi [None req-a285d2ec-28c1-47da-b0df-9fbb7e7fa792 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-a285d2ec-28c1-47da-b0df-9fbb7e7fa792 admin admin] Request method failure captured: Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Accept: application/json Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Accept-Encoding: gzip, deflate Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Connection: keep-alive Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Content-Length: 0 Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Host: 10.222.0.47 Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Openstack-Api-Version: compute 2.90 Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Openstack-System-Scope: None Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: User-Agent: python-novaclient Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Auth-Token: gAAAAABi4b9gBwzmyC6BohrTdSNBlUHtu1qrCPPDZgiF5CbalmYWHCpYzeN9iBpF9Ec2Fkr6QgQxWlfmrX8smwuf3YGJmVCKbg8OVlpOOTDf8uBV42nzWTv6emCfGXojQZuMvn4v6I7-ZP7vuDXJz10aFf9sJfEBFARbeu5XcTVcFr54DPufOgo Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Domain-Id: None Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Domain-Name: None Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Identity-Status: Confirmed Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Is-Admin-Project: True Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Project-Domain-Id: default Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Project-Domain-Name: Default Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Project-Id: f2cfa132043645ed9aba908b2c5ec402 Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Project-Name: admin Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Role: admin,member,reader Jul 27 22:42:41.418237 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Roles: admin,member,reader Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f2cfa132043645ed9aba908b2c5ec402", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Tenant: admin Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Tenant-Id: f2cfa132043645ed9aba908b2c5ec402 Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Tenant-Name: admin Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User: admin Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User-Domain-Id: default Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User-Domain-Name: Default Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User-Id: 5ba59e69401e48aa98a715630f5ff904 Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User-Name: admin Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: method: > Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: exception: Flavor 42 could not be found. Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: action_args: {'id': '42'} Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:42:41.419577 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:42:41.420349 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:41.421787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-a285d2ec-28c1-47da-b0df-9fbb7e7fa792 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:42:41.422967 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-a285d2ec-28c1-47da-b0df-9fbb7e7fa792 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015689 Jul 27 22:42:41.422967 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Jul 27 22:42:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:42.492912 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-37197e82-eb6f-4243-8d58-5cec373b7a99 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:42.493914 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-37197e82-eb6f-4243-8d58-5cec373b7a99 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 27 22:42:42.494302 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 22:42:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:43.012188 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-abc1505c-058c-4a77-abc4-5135aad00c3d admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:43.017449 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.wsgi [None req-abc1505c-058c-4a77-abc4-5135aad00c3d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-abc1505c-058c-4a77-abc4-5135aad00c3d admin admin] Request method failure captured: Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Accept: application/json Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Accept-Encoding: gzip, deflate Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Connection: keep-alive Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Content-Length: 0 Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Host: 10.222.0.47 Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Openstack-Api-Version: compute 2.90 Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Openstack-System-Scope: None Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: User-Agent: python-novaclient Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Auth-Token: gAAAAABi4b9iio13e9F2w7O-1B7814kM24vl-DKgTFYQ7yqfOSN4lAn7gReGHjAbg8dVOPJ0Ku5h2EK5U6OVg6k4XUtGNOcc--oMOdx9KmTyGr6YNvgfKFAH0Gnyso8RHAoyA0XX-MER0p1RgHObDPByrZlR7pxFJ72KzTa-SqsVuRvTtAOEpKU Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Domain-Id: None Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Domain-Name: None Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Identity-Status: Confirmed Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Is-Admin-Project: True Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Project-Domain-Id: default Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Project-Domain-Name: Default Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Project-Id: f2cfa132043645ed9aba908b2c5ec402 Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Project-Name: admin Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Role: admin,member,reader Jul 27 22:42:43.018931 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Roles: admin,member,reader Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f2cfa132043645ed9aba908b2c5ec402", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Tenant: admin Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Tenant-Id: f2cfa132043645ed9aba908b2c5ec402 Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Tenant-Name: admin Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User: admin Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User-Domain-Id: default Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User-Domain-Name: Default Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User-Id: 5ba59e69401e48aa98a715630f5ff904 Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User-Name: admin Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: method: > Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: exception: Flavor 84 could not be found. Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: action_args: {'id': '84'} Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:42:43.020354 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:42:43.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:43.022184 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-abc1505c-058c-4a77-abc4-5135aad00c3d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:42:43.023162 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-abc1505c-058c-4a77-abc4-5135aad00c3d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.386914 Jul 27 22:42:43.023162 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Jul 27 22:42:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:43.029865 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-73be89bf-58a7-4767-8973-6071d47457b9 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:43.045135 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-73be89bf-58a7-4767-8973-6071d47457b9 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018825 Jul 27 22:42:43.045652 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jul 27 22:42:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:42:43.055564 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-5e9b6e16-d8cb-44a0-b265-66a9e078e481 admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:43.071652 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-5e9b6e16-d8cb-44a0-b265-66a9e078e481 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019607 Jul 27 22:42:43.072167 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jul 27 22:42:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:42:43.081181 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-63211a74-4299-46ff-8317-ca2e83b54f27 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:43.086540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.wsgi [None req-63211a74-4299-46ff-8317-ca2e83b54f27 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-63211a74-4299-46ff-8317-ca2e83b54f27 admin admin] Request method failure captured: Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Accept: application/json Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Accept-Encoding: gzip, deflate Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Connection: keep-alive Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Content-Length: 0 Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Host: 10.222.0.47 Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Openstack-Api-Version: compute 2.90 Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Openstack-System-Scope: None Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: User-Agent: python-novaclient Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Auth-Token: gAAAAABi4b9iio13e9F2w7O-1B7814kM24vl-DKgTFYQ7yqfOSN4lAn7gReGHjAbg8dVOPJ0Ku5h2EK5U6OVg6k4XUtGNOcc--oMOdx9KmTyGr6YNvgfKFAH0Gnyso8RHAoyA0XX-MER0p1RgHObDPByrZlR7pxFJ72KzTa-SqsVuRvTtAOEpKU Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Domain-Id: None Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Domain-Name: None Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Identity-Status: Confirmed Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Is-Admin-Project: True Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Project-Domain-Id: default Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Project-Domain-Name: Default Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Project-Id: f2cfa132043645ed9aba908b2c5ec402 Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Project-Name: admin Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Role: admin,member,reader Jul 27 22:42:43.088038 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Roles: admin,member,reader Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f2cfa132043645ed9aba908b2c5ec402", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Tenant: admin Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Tenant-Id: f2cfa132043645ed9aba908b2c5ec402 Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Tenant-Name: admin Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User: admin Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User-Domain-Id: default Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User-Domain-Name: Default Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User-Id: 5ba59e69401e48aa98a715630f5ff904 Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User-Name: admin Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: method: > Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: exception: Flavor 84 could not be found. Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: action_args: {'id': '84'} Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:42:43.089540 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:42:43.090434 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:43.091545 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-63211a74-4299-46ff-8317-ca2e83b54f27 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:42:43.092638 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-63211a74-4299-46ff-8317-ca2e83b54f27 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011779 Jul 27 22:42:43.092638 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Jul 27 22:42:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:44.051990 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-5e9b6e16-d8cb-44a0-b265-66a9e078e481 admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:44.053030 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-5e9b6e16-d8cb-44a0-b265-66a9e078e481 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 27 22:42:44.053426 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 22:42:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:44.567682 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-0081e253-673f-49d2-8c1e-de2ddc83fb72 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:44.573420 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.wsgi [None req-0081e253-673f-49d2-8c1e-de2ddc83fb72 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-0081e253-673f-49d2-8c1e-de2ddc83fb72 admin admin] Request method failure captured: Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Accept: application/json Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Accept-Encoding: gzip, deflate Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Connection: keep-alive Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Content-Length: 0 Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Host: 10.222.0.47 Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Openstack-Api-Version: compute 2.90 Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Openstack-System-Scope: None Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: User-Agent: python-novaclient Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Auth-Token: gAAAAABi4b9jdW85WCbUv7g7htC02iSU4l1lW8gt94WJULJZQIJnxBqLOP5q6njn0B6XY05JvwHPg6XAoheQlTK-X_Jlk-areLk-EGBSUTwSFDa1rZeAtnCtEFpz12WDQ8gsv2vw8HTY8du-iNP2U_jiLbvN_nCCp0C_bRGARGqN5IlH-uxu9vA Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Domain-Id: None Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Domain-Name: None Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Identity-Status: Confirmed Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Is-Admin-Project: True Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Project-Domain-Id: default Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Project-Domain-Name: Default Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Project-Id: f2cfa132043645ed9aba908b2c5ec402 Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Project-Name: admin Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Role: admin,member,reader Jul 27 22:42:44.574907 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Roles: admin,member,reader Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f2cfa132043645ed9aba908b2c5ec402", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Tenant: admin Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Tenant-Id: f2cfa132043645ed9aba908b2c5ec402 Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-Tenant-Name: admin Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User: admin Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User-Domain-Id: default Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User-Domain-Name: Default Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User-Id: 5ba59e69401e48aa98a715630f5ff904 Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: X-User-Name: admin Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: method: > Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: exception: Flavor 451 could not be found. Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: action_args: {'id': '451'} Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:42:44.576496 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:42:44.577752 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: ERROR nova.api.openstack.wsgi Jul 27 22:42:44.579054 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-0081e253-673f-49d2-8c1e-de2ddc83fb72 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:42:44.580336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-0081e253-673f-49d2-8c1e-de2ddc83fb72 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.381584 Jul 27 22:42:44.580336 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jul 27 22:42:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 383 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:44.585835 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-e0145e44-263c-4bd6-8950-d68cb88fb74e admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:44.601163 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-e0145e44-263c-4bd6-8950-d68cb88fb74e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018899 Jul 27 22:42:44.601675 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jul 27 22:42:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:42:44.610578 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:44.625592 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018418 Jul 27 22:42:44.626108 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Jul 27 22:42:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:42:44.634797 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-b91db1d9-ac60-46ac-8c0f-e17d6b32d31c admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:44.639917 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.wsgi [None req-b91db1d9-ac60-46ac-8c0f-e17d6b32d31c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-b91db1d9-ac60-46ac-8c0f-e17d6b32d31c admin admin] Request method failure captured: Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Accept: application/json Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Accept-Encoding: gzip, deflate Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Connection: keep-alive Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Content-Length: 0 Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Host: 10.222.0.47 Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Openstack-Api-Version: compute 2.90 Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Openstack-System-Scope: None Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: User-Agent: python-novaclient Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Auth-Token: gAAAAABi4b9jdW85WCbUv7g7htC02iSU4l1lW8gt94WJULJZQIJnxBqLOP5q6njn0B6XY05JvwHPg6XAoheQlTK-X_Jlk-areLk-EGBSUTwSFDa1rZeAtnCtEFpz12WDQ8gsv2vw8HTY8du-iNP2U_jiLbvN_nCCp0C_bRGARGqN5IlH-uxu9vA Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Domain-Id: None Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Domain-Name: None Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Identity-Status: Confirmed Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Is-Admin-Project: True Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Project-Domain-Id: default Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Project-Domain-Name: Default Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Project-Id: f2cfa132043645ed9aba908b2c5ec402 Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Project-Name: admin Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Role: admin,member,reader Jul 27 22:42:44.641431 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Roles: admin,member,reader Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f2cfa132043645ed9aba908b2c5ec402", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2cfa132043645ed9aba908b2c5ec402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Tenant: admin Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Tenant-Id: f2cfa132043645ed9aba908b2c5ec402 Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-Tenant-Name: admin Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User: admin Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User-Domain-Id: default Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User-Domain-Name: Default Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User-Id: 5ba59e69401e48aa98a715630f5ff904 Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: X-User-Name: admin Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: method: > Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: exception: Flavor 451 could not be found. Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: action_args: {'id': '451'} Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:42:44.643195 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:42:44.644280 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: ERROR nova.api.openstack.wsgi Jul 27 22:42:44.645597 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-b91db1d9-ac60-46ac-8c0f-e17d6b32d31c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:42:44.646870 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-b91db1d9-ac60-46ac-8c0f-e17d6b32d31c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011356 Jul 27 22:42:44.646870 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jul 27 22:42:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 22:42:45.611807 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:45.612880 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Jul 27 22:42:45.613276 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 22:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:46.141753 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-115b65e7-5e1d-436c-a8e2-19c83cbe7533 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:46.161962 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-115b65e7-5e1d-436c-a8e2-19c83cbe7533 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.406274 Jul 27 22:42:46.162519 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Jul 27 22:42:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:42:47.116604 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:47.117613 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 27 22:42:47.118009 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 22:42:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:47.631330 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-67f99afd-24d4-4799-bc83-44e7303ebae8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:47.649534 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-67f99afd-24d4-4799-bc83-44e7303ebae8 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.393813 Jul 27 22:42:47.650071 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Jul 27 22:42:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:42:48.612136 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:48.613178 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001964 Jul 27 22:42:48.613577 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 22:42:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:49.136398 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-1f70b2da-be5e-48a4-829b-2a5cd1e438f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:49.155634 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-1f70b2da-be5e-48a4-829b-2a5cd1e438f6 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.404573 Jul 27 22:42:49.156255 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Jul 27 22:42:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:42:50.128294 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:50.129324 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 27 22:42:50.129716 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 22:42:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:50.660608 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-2298ae4b-efd4-4ab3-8223-4b008708a8a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:42:50.678701 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-2298ae4b-efd4-4ab3-8223-4b008708a8a2 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.410939 Jul 27 22:42:50.679180 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Jul 27 22:42:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:42:51.659439 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:51.660442 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 27 22:42:51.660891 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 22:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:42:52.175316 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-6e012b50-fdbe-4d1c-a552-7be6f2764d2d admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:42:52.195322 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-6e012b50-fdbe-4d1c-a552-7be6f2764d2d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.398218 Jul 27 22:42:52.195844 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Wed Jul 27 22:42:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:43:42.958603 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:43:42.959619 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-3e6e57ed-4fea-4b88-8fdd-af80b7377e97 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 27 22:43:42.960017 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 930 bytes} [Wed Jul 27 22:43:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:43:42.970626 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:43.343181 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-13dfd92c-90b8-4cff-95f9-a81839e2ecdb admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:43:43.363841 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-13dfd92c-90b8-4cff-95f9-a81839e2ecdb admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397875 Jul 27 22:43:43.364378 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1291 bytes} [Wed Jul 27 22:43:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:43:43.387619 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-1b9827cf-ce83-4caa-8c40-3f502a01d253 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:43:43.390981 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG dbcounter [-] [114775] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=114775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:43.396679 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-1b9827cf-ce83-4caa-8c40-3f502a01d253 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012631 Jul 27 22:43:43.397207 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1282 bytes} [Wed Jul 27 22:43:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:43:43.408613 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-92ecbdd2-0c31-41fc-b065-a3eeedd0ddc9 admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:43:43.416135 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-92ecbdd2-0c31-41fc-b065-a3eeedd0ddc9 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011058 Jul 27 22:43:43.416696 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1285 bytes} [Wed Jul 27 22:43:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:43:43.429537 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-047f9723-9d03-4e89-9b26-1b3f7562bd48 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:43:43.437856 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-047f9723-9d03-4e89-9b26-1b3f7562bd48 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012939 Jul 27 22:43:43.439004 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1285 bytes} [Wed Jul 27 22:43:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:43:43.450074 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-e579ce5c-2551-4a78-8633-61bc54d50c7a admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:43:43.457518 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-e579ce5c-2551-4a78-8633-61bc54d50c7a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010932 Jul 27 22:43:43.458024 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1282 bytes} [Wed Jul 27 22:43:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:47:02.777700 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-047f9723-9d03-4e89-9b26-1b3f7562bd48 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:47:02.778729 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-047f9723-9d03-4e89-9b26-1b3f7562bd48 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jul 27 22:47:02.779150 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 22:47:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:47:02.930107 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writing DB stats nova_api:SELECT=6 {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:47:03.085366 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-b0f11c31-e64a-46a5-955f-3971f88d9fd4 admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:47:03.087750 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:47:03.087750 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: warnings.warn(msg) Jul 27 22:47:03.088985 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-b0f11c31-e64a-46a5-955f-3971f88d9fd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:47:03.089433 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-b0f11c31-e64a-46a5-955f-3971f88d9fd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:47:03.090250 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-b0f11c31-e64a-46a5-955f-3971f88d9fd4 admin admin] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:47:03.090679 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-b0f11c31-e64a-46a5-955f-3971f88d9fd4 admin admin] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:47:03.125233 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-b0f11c31-e64a-46a5-955f-3971f88d9fd4 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.196658 Jul 27 22:47:03.125801 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jul 27 22:47:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:47:03.956971 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-047f9723-9d03-4e89-9b26-1b3f7562bd48 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:47:03.957982 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-047f9723-9d03-4e89-9b26-1b3f7562bd48 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 27 22:47:03.958376 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 22:47:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:47:04.156406 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-f8c0f4e0-e4a7-49f0-9bb0-fa4f87e3c641 admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:47:04.158787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:47:04.158787 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: warnings.warn(msg) Jul 27 22:47:04.160122 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-f8c0f4e0-e4a7-49f0-9bb0-fa4f87e3c641 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:47:04.160618 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-f8c0f4e0-e4a7-49f0-9bb0-fa4f87e3c641 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:47:04.161425 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-f8c0f4e0-e4a7-49f0-9bb0-fa4f87e3c641 admin admin] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:47:04.161839 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-f8c0f4e0-e4a7-49f0-9bb0-fa4f87e3c641 admin admin] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:47:04.181422 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-f8c0f4e0-e4a7-49f0-9bb0-fa4f87e3c641 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083266 Jul 27 22:47:04.181927 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jul 27 22:47:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:47:15.426629 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-047f9723-9d03-4e89-9b26-1b3f7562bd48 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:47:15.427643 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-047f9723-9d03-4e89-9b26-1b3f7562bd48 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jul 27 22:47:15.428039 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 22:47:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:47:15.572773 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writing DB stats nova_cell0:SELECT=4 {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:47:15.573522 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writing DB stats nova_cell1:SELECT=4 {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:47:15.574126 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG dbcounter [-] [114776] Writing DB stats nova_api:SELECT=8 {{(pid=114776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:47:15.621739 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-6e004051-87d7-422e-9079-89b985e1a249 admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:47:15.624584 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:47:15.624584 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: warnings.warn(msg) Jul 27 22:47:15.625770 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-6e004051-87d7-422e-9079-89b985e1a249 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:47:15.626209 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-6e004051-87d7-422e-9079-89b985e1a249 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:47:15.626976 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-6e004051-87d7-422e-9079-89b985e1a249 admin admin] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:47:15.627403 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-6e004051-87d7-422e-9079-89b985e1a249 admin admin] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:47:15.652031 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-6e004051-87d7-422e-9079-89b985e1a249 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083725 Jul 27 22:47:15.652583 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jul 27 22:47:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:47:16.476474 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: DEBUG nova.api.openstack.wsgi [None req-047f9723-9d03-4e89-9b26-1b3f7562bd48 admin admin] Calling method '>' {{(pid=114775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:47:16.477524 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: INFO nova.api.openstack.requestlog [None req-047f9723-9d03-4e89-9b26-1b3f7562bd48 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 27 22:47:16.477925 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: [pid: 114775|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Jul 27 22:47:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:47:16.668009 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG nova.api.openstack.wsgi [None req-76031ab3-31a5-44dc-8db6-6d5ddda93d02 admin admin] Calling method '>' {{(pid=114776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:47:16.670444 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:47:16.670444 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: warnings.warn(msg) Jul 27 22:47:16.671628 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-76031ab3-31a5-44dc-8db6-6d5ddda93d02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:47:16.672074 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-76031ab3-31a5-44dc-8db6-6d5ddda93d02 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:47:16.672888 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-76031ab3-31a5-44dc-8db6-6d5ddda93d02 admin admin] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:47:16.673322 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: DEBUG oslo_concurrency.lockutils [None req-76031ab3-31a5-44dc-8db6-6d5ddda93d02 admin admin] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:47:16.694930 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: INFO nova.api.openstack.requestlog [None req-76031ab3-31a5-44dc-8db6-6d5ddda93d02 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077992 Jul 27 22:47:16.695416 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: [pid: 114776|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Jul 27 22:47:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:48:14.868121 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: Wed Jul 27 22:48:14 2022 - graceful shutdown triggered... Jul 27 22:48:14.867844 dv-cinder-851249-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 27 22:48:14.869060 dv-cinder-851249-4-iscsi devstack@n-api.service[114775]: Gracefully killing worker 1 (pid: 114775)... Jul 27 22:48:14.869434 dv-cinder-851249-4-iscsi devstack@n-api.service[114776]: Gracefully killing worker 2 (pid: 114776)... Jul 27 22:48:15.868848 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: worker 1 buried after 1 seconds Jul 27 22:48:15.869364 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: worker 2 buried after 1 seconds Jul 27 22:48:15.869364 dv-cinder-851249-4-iscsi devstack@n-api.service[114774]: goodbye to uWSGI. Jul 27 22:48:15.870402 dv-cinder-851249-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 27 22:48:15.870954 dv-cinder-851249-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 27 22:48:15.874414 dv-cinder-851249-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 22:48:15.883508 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 22:48:15.885514 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 22:48:15 2022] *** Jul 27 22:48:15.885514 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 22:48:15.885514 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 22:48:15.885514 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: nodename: dv-cinder-851249-4-iscsi Jul 27 22:48:15.885514 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: machine: x86_64 Jul 27 22:48:15.885514 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: clock source: unix Jul 27 22:48:15.885514 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: pcre jit disabled Jul 27 22:48:15.885514 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: detected number of CPU cores: 4 Jul 27 22:48:15.885514 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: current working directory: / Jul 27 22:48:15.885514 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: detected binary path: /usr/bin/uwsgi-core Jul 27 22:48:15.886275 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: your processes number limit is 47680 Jul 27 22:48:15.886275 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: your memory page size is 4096 bytes Jul 27 22:48:15.886275 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: detected max file descriptor number: 2048 Jul 27 22:48:15.886275 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: lock engine: pthread robust mutexes Jul 27 22:48:15.886275 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: thunder lock: enabled Jul 27 22:48:15.886275 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 22:48:15.886275 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 22:48:15.925404 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: Python main interpreter initialized at 0x558c0e4979c0 Jul 27 22:48:15.925404 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: python threads support enabled Jul 27 22:48:15.925404 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: your server socket listen backlog is limited to 100 connections Jul 27 22:48:15.925404 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: your mercy for graceful operations on workers is 90 seconds Jul 27 22:48:15.925834 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 22:48:15.925834 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: *** Operational MODE: preforking *** Jul 27 22:48:15.926124 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: *** uWSGI is running in multiple interpreter mode *** Jul 27 22:48:15.926124 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: spawned uWSGI master process (pid: 129274) Jul 27 22:48:15.926321 dv-cinder-851249-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 22:48:15.926607 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: spawned uWSGI worker 1 (pid: 129294, cores: 1) Jul 27 22:48:15.926911 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: spawned uWSGI worker 2 (pid: 129295, cores: 1) Jul 27 22:48:15.927029 dv-cinder-851249-4-iscsi devstack@n-api.service[129274]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 22:48:16.590455 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 22:48:16.591060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 22:48:17.749787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 22:48:17.749787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: from cryptography.utils import int_from_bytes Jul 27 22:48:17.750481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 22:48:17.750481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: from cryptography.utils import int_from_bytes Jul 27 22:48:17.750888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 22:48:17.750888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: from cryptography.utils import int_from_bytes Jul 27 22:48:17.751028 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 22:48:17.751028 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: from cryptography.utils import int_from_bytes Jul 27 22:48:20.157494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 22:48:20.158026 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 22:48:20.158295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 22:48:20.158657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 22:48:20.158911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 22:48:20.159302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.159629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.159950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.160272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.161595 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.162214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.162574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.162920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.163275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.163553 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.163883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.164219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851249-4-iscsi {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.164574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.165638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.166118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.166460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.166778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.167110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.167427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.167937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.169303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.169303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.169601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.170127 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.170455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.170800 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.171127 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.171900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.171900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.172080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.172471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851249-4-iscsi {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.173007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.173332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.173654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.174078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.174393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.174707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.175032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.175808 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.176290 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.176653 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.176974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.177299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.177624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.178049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.178364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.178679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.179003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.179307 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.179618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.179870 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.180178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.180509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.180868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.181193 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.181447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.181699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.182023 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.182185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 22:48:20.182599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.182676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 22:48:20.182756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.182941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 22:48:20.183100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.183256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.183477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 22:48:20.183477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 22:48:20.183769 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.183920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.184068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.184212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.184352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.184503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.184698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.184858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.185028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.185207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.185358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.185551 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.185726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.185872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.186025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.186701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.186860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.187020 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.187171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.187679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.187855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.187855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851249-4-iscsi {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.188163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.188322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.188474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.188474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.188854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.189005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.189167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.189317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.189461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.189603 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.189752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.189902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.190073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.190073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.190352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.190352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.190629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.190798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.190955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.191110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.191253 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.191401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.191544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.191708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.191859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.192009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.192159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.192308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.192451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.192625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.192782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.192936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.193079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.193221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.193371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.193535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.193686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.193844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.193987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851249-4-iscsi {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.194135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.194295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.194438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.194580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.194721 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.194862 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.195018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.195161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.195312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.195474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.195623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.195776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.195987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.196181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.196335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.196480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.196666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.196825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.196987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.197138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.197281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.197424 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.197973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.198134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.198291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.198443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.198588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.198737 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.198888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.199044 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.199187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.199329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.199479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.199632 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.199792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.199936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.200084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.200226 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.200383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.200525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.200696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.200840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.200992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.201135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.201353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.201498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.201650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.201650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.202513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.202674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.202832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.202983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.203138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.203288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.203433 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.203588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.203731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.203881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.204024 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.204188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.204339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.204496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.204695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.204843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.204993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.205137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.205293 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.205436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.205578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.205719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.205861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.206010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.206010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.206317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.206468 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.206610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.206771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.206922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.207111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.207262 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.207412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.207412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.208078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.208236 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.208409 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.208608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.208776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.208920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.209064 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.209214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.209369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.209521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.209670 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.209829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.209983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.210136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.210279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.210432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.210587 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.210738 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.210887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.211040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.211183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.211332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.211474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.211615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.211615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.211907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.212061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.212223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.212374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.212524 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.212714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.212867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.213011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.213154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.213295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.213443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.213596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.213746 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.213889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.214037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.214191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.214340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.214491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.214634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.214786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.214937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.215080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.215229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.215386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.215528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.215677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.215820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.215969 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.216139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.216292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.216292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.216598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.216756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.216756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.217046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.217197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.217348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.217531 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.217674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.217836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.217836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.218507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.218661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.218817 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.218968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.219118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.219262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.219404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.219556 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.219712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.219863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.220006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.220162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.220313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.220467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.220688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.220839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.220981 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.221123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.221265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.221422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.221422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.222493 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.222654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.222799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.222955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.223105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.223249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.223399 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.223574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.223733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.223884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.224026 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.224178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.224331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.224476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.224652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.224812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.224963 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.225114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.225265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.225416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.225569 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.225713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.225871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.226014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.226180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.226338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.226482 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.226631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.226797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.226948 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.227091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.227242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.227393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.227536 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:48:20.227677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.227820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.227988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.228649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.228806 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.228952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.228952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.229241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.229391 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.229552 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.229704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.229848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.229991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.230141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.230299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.230449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.230602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.230753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.230903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.231060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.231220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.231373 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.231621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.231766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.231916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.232060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.232213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.232363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.232507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.232718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.232864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.233535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.233711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.233863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.234014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.234159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.234303 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.234458 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.234611 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.234754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.234896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.235037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.235143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.235245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.235245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.235381 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.235450 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.235527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.235605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.235689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.235768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.235847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.235847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.235982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.236073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.236146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.236223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.236223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.236355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.236518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.236896 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.237000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.237201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.237401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.237561 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.237879 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.237997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.238231 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.238352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.238666 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.238755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.238847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.238946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.239138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.239238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.239446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.239540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.239767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.239872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.240066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.240162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.240380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.240483 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.240717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.240815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.241026 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.241127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.241332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.241434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.241639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.241742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.241947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.242040 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.242257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.242350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.242565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.242668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.242867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.242967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.243169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.243268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.243472 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.243565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.243774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.243866 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.244094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.244196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.244419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.244513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.244763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.244867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.245094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.245204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.245401 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.245502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.245708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.245802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.246017 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.246160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.246325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.246444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.246629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.246733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.246937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.247051 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.247245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.247345 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.247547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.247654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.247871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.248151 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.248254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.248470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.248744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.249369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.249473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.249668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.249776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.249984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.250079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.250299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.250400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.250603 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.250703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.250913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.251006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.251224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.251329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.251534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.251637 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.251855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.251960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.252164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.252258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.252473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.252640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.252813 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.252907 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.253126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.253253 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.253437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.253561 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.253748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.253884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.254060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.254205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.254379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.254522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.254714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.254816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.255033 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.255128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.255343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.255444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.255687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.255815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.255988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.256096 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.256292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.256400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.256615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.256736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.256922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.257014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.257223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.257315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.257524 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.257687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.257826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.257921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.258145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.258237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.258486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.258614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.258805 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.258983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.259114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.259242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.259426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.259820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.260041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.260325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.260428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.261176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.261297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.261297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.261442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.261442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.261583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.261660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.261739 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.261911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.262002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.262220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.262341 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.262582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.262801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.262913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.263113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.263332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.263418 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.263646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.263744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.263957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.264039 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.268577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.268716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.268716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.268925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.269017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.269091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.269162 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.269245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.269342 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.269432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.269516 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.269516 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.269672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.269755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.269845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.269934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270103 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.270959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.271180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.271330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.271519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.271615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.271833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.271929 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.272143 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.272252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.272455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.272576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.272806 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.272909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.273118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.273225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.273428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.273529 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.273740 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.273843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.274045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.274140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.274357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.274448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.274675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.274768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.275022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.275260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.275356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.275598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.275698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.275915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.276033 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.276235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.276352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.276574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.276724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.276894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.277007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.277226 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.277317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.277555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.277655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.277865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.277988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.278180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.278283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.278506 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.278590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.278822 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.278932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.279114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.279310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.279414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.279517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.279707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.279808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.280083 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.280229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.280372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.280472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.280713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.280818 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.281021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.281126 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.281328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.281421 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.281633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.281724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.281937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.282043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.282245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.282335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.282548 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.282653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.282849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.282950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.283151 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.283250 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.283470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.283560 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.283776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.283877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.284085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.284200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.284386 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.284492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.284753 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.284865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.285026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.285119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.285353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.285451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.285661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.285763 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.285967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.286068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.286269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.286370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.286578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.286733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.286921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.287055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.287229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.287336 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.287534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.287628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.287837 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.287929 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.288143 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.288249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.288448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.288541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.288782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.288888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.289092 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.289255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.289408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.289498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.289698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.289789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.290007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.290108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.290315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.290416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.290616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.290708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.290924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.291053 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.291229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.291331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.291533 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.291624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.291845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.291937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.292150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.292240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.292451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.292569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.292792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.292886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.293100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.293200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.293403 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.293503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.293714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.293808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.294016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.294282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.294385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.294615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.294709 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.294917 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.295008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.295222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.295323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.296050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.296166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.296362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.296460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.296693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.296819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.297013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.297139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.297326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.297434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.297636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.297810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.297942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.298035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.298243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.298344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.298547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.298700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.298852 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.299007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.299177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.299339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.299460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.299552 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.299717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.299820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.300026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.300135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.300330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.300459 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.300657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.300764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.300961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.301065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.301265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.301376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.301573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.301671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.301876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.301969 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.302179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.302278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.302480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.302577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.302783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.302883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.303088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.303180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.303387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.303478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.303689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.303790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.303988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.304094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.304294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.304400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.304618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.304728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.304961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.305063 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.305264 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.305365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.305616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.305715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.305917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.306017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.306221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.306323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.306539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.306631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.306847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.306969 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.307150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.307268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.307454 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.307568 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.307756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.307858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.308060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.308171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.308362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.308465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.308697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.308818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.309004 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.309098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.309309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.309447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.309613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.309715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.309912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.310016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.310217 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.310310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.310519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.310665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.310835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.310987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.311165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.311857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.311993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.312167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.312298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.312480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.312624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.312819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.312913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.313132 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.313228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.313445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.313539 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.313756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.313849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.314068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.314170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.314379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.314479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.314680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.314779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.314982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.315077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.315289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.315381 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.315593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.315701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.315895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.315989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.316201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.316292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.316507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.316649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.316845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.316996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.317148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.317295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.317453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.317559 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.317753 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.317851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.318054 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.318147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.318360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.318466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.318664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.318763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.318983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.319085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.319286 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.319598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.319900 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.320013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.320204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.320367 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.320507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.320722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.320829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.321066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.321230 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.321372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.321466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.321698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.321807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.322001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.322135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.322305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.322479 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.322631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.322770 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.322916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.323038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.323219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.323356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.323521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.323671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.323820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.323981 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.324160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.324288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.324462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.324634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.324841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.324967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.325152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.325277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.325466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.325585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.325782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.325881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.326093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.326195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.326405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.326500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.326716 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.326852 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.327041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.327246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.327378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.327562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.327662 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.327873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.327967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.328233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.328325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.328536 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.328664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.328879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.328982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.329188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.329291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.329496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.329604 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.329816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.329931 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.330133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.330237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.330452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.330545 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.330754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.330890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.331059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.331152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.331366 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.331476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.331670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.331763 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.331975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.332069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.332279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.332387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.332607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.332708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.332919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.333039 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.333227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.333334 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.333535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.333632 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.333842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.333965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.334144 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.334292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.334449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.334606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.334755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.334933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.335060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.335262 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.335384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.335573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.335690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.335883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.335984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.336200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.336300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.336509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.336632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.336847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.336954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.337173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.337302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.337482 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.337602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.337796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.337918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.338108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.338203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.338419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.338520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.338727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.338820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.339034 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.339177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.339358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.339460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.339663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.339755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.339967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.340087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.340294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.340403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.340623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.340732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.340949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.341051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.341256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.341387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.341573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.341673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.341876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.341970 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.342181 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.342275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.342512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.342606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.342813 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.342904 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.343114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.343217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.343417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.343510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.343736 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.343843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.344039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.344133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.344356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.344457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.344718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.344826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.345055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.345157 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.345385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.345523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.345703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.345808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.346024 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.346117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.346350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.346450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.346658 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.346759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.346965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.347068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.347527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.347622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.347833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.347934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.348140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.348253 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.348448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.348632 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.348882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.349020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.349151 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.349284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.349428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.349573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.349723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.349873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.350033 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.350169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.350300 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.350434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.350589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.350721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.350847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.350988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.351220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.351392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.351593 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.351744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.351882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.352014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.352154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.352305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.352446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.352634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.352783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.352924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.353068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.353236 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.353394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.353549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.353696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.353851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.353998 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.354158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.354306 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.354440 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.354602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.354739 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.354903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.355069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.355223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.355351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.355484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.355580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.355789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.355884 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.356091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.356183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.356395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.356489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.356735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.356832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.357036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.357135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.357352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.357443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.357661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.357756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.358479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.358728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.358827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.359057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.359161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.359372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.359502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.359685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.359786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.359986 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.360113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.360290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.360435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.360620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.360719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.360935 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.361030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.361266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.361415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.361560 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.361673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.361872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.361974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.362196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.362296 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.362505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.362617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.362834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.362936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.363159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.363259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.363471 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.363574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.363786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.363877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.364103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.364195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.364404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.364506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.364745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.364849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.365054 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.365155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.365359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.365461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.365662 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.365756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.365963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.366064 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.366267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.366361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.366568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.366661 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.366867 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.366974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.367166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.367267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.367485 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.367578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.367786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.367896 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.368104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.368198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.368407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.368510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.368734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.368847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.369038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.369169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.369337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.369430 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.369677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.369780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.369982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.370075 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.370299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.370390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.370617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.370712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.370936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.371139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.371262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.371459 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.371551 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.371798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.371892 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.372129 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.372230 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.372460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.372639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.372803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.372897 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.373114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.373214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.373425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.373528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.374272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.374384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.374586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.374679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.374892 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.374993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.375204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.375296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.375514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.375608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.375826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.375926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.376139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.376355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.376456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.376707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.376818 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.377020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.377128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.377331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.377602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.377704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.377934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.378061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.378242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.378343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.378551 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.378720 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.378848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.378940 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.379150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.379253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.379457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.379560 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.379782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.379885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.380102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.380202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.380414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.380516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.380762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.380870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.381079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.381172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.381389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.381491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.381700 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.381812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.382008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.382108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.382318 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.382425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.382628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.382782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.382943 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.383046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.383251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.383344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.383563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.383663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.383876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.383993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.384184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.384285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.384490 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.384601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.384826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.384934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.385144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.385236 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.385450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.385550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.385755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.385859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.386063 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.386164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.386371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.386463 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.386675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.386775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.386987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.387087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.387294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.387387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.387606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.387708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.387913 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.388014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.388223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.388324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.388605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.388765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.388936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.389077 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.389267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.389431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.389576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.389757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.389897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.390079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.390283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.390392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.390616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.390797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.390930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.391033 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.391242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.391344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.391585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.391679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.391897 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.391993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.392204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.392432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.392528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.392804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.392908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.393127 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.393222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.393430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.393523 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.393747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.393841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.394053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.394161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.394374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.394585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.394679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.394928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.395028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.395247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.395348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.395569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.395671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.395888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.395979 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.396202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.396296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.396506 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.396616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.396842 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.396946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.397145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.397237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.397451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.397554 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.397759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.397865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.398066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.398158 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.398370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.398465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.398674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.398778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.398982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.399121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.399288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.399381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.399593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.399696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.399901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.400030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.400202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.400329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.400526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.400684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.400854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.400948 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.401160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.401261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.401463 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.401564 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.401773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.401867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.402076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.402178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.402379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.402474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.402682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.402778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.402986 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.403099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.403293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.403402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.403594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.403687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.403901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.404045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.404203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.404320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.404510 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.404665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.404851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.405003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.405242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.405336 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.405600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.405702 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.405924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.406032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.406228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.406330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.406531 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.406625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.406844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.406940 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.407193 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.407293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.407530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.407623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.407851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.407954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.408163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.408265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.408511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.408635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.408850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.408946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.409156 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.409386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.409481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.409725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.409827 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.410050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.410182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.410352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.410452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.410665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.410795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.410978 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.411106 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.411285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.411396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.411591 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.411712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.411898 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.412027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.412204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.412324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.412511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.412665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.412839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.412939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.413144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.413250 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.413450 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.413543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.413754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.413848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.414060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.414166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.414365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.414466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.414669 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.414770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.414972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.415079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.415278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.415371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.415581 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.415683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.415887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.415990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.416189 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.416282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.416501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.416612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.416869 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.416963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.417183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.417284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.417497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.417597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.417809 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.417909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.418120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.418212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.418433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.418536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.418740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.418835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.419047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.419149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.419355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.419462 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.419667 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.419760 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.419989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.420091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.420299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.420406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.421182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.421273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.421447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.421540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.421759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.421867 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.422070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.422172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.422379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.422475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.422705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.422836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.423032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.423161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.423341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.423435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.423648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.423742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.423965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.424064 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.424273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.424375 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.424621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.424720 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.424961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.425056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.425287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.425392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.425600 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.425702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.425901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.425994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.426205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.426308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.426508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.426602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.426814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.426908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.427125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.427227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.427429 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.427521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.427729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.427829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.428032 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.428136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.428336 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.428438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.428659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.428756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.428964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.429068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.429268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.429399 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.429569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.429662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.429872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.429974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.430171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.430265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.430470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.430571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.430771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.430867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.431071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.431283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.431367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.431502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.431656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.431814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.431957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.432120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.432253 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.432401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 22:48:20.432588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.432869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.433168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.433467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.433796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.434126 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.434437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.434756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.435069 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.435389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.435695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.436015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.436894 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.437209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.437518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.437846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.438156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.438466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.438774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.439080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.439387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.439693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.440015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.440339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.440670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.440995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.441315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.441632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.441945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.442250 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.442578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.442887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.443194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.443502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.443808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.444113 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.444423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.444754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.445065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.445375 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.445685 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.446010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.446332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.446641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.446963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.447284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.447628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.447939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.448280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.448629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.448940 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.449249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.449555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:48:20.449796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 22:48:20.494110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO dbcounter [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] Registered counter for database nova_api Jul 27 22:48:20.510842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO dbcounter [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] Registered counter for database nova_api Jul 27 22:48:20.514893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_db.sqlalchemy.engines [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129294) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:48:20.521444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writer thread running {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:48:20.530529 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_db.sqlalchemy.engines [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:48:20.537261 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writer thread running {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:48:20.576526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.context [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fe71611c-dbfe-47bb-b77e-29ffa97fa073(cell1) {{(pid=129294) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 22:48:20.580722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:48:20.582289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:48:20.583322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:48:20.586022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:48:20.588014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO dbcounter [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] Registered counter for database nova_cell0 Jul 27 22:48:20.593383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO dbcounter [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] Registered counter for database nova_cell1 Jul 27 22:48:20.595346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.context [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fe71611c-dbfe-47bb-b77e-29ffa97fa073(cell1) {{(pid=129295) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 22:48:20.601705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:48:20.601867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_db.sqlalchemy.engines [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129294) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:48:20.601952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:48:20.602144 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:48:20.602865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_db.sqlalchemy.engines [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129294) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:48:20.604305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:48:20.606329 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO dbcounter [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] Registered counter for database nova_cell0 Jul 27 22:48:20.607857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writer thread running {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:48:20.610864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO dbcounter [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] Registered counter for database nova_cell1 Jul 27 22:48:20.617968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_db.sqlalchemy.engines [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:48:20.620195 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_db.sqlalchemy.engines [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:48:20.626374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writer thread running {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:48:20.627951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writer thread running {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:48:20.746839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writer thread running {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:48:20.756797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO dbcounter [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] Registered counter for database nova_cell0 Jul 27 22:48:20.763361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_db.sqlalchemy.engines [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129294) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:48:20.768019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writer thread running {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:48:20.774435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO dbcounter [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] Registered counter for database nova_cell0 Jul 27 22:48:20.785302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_db.sqlalchemy.engines [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:48:20.790160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writer thread running {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:48:21.091862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: WARNING keystonemiddleware.auth_token [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 22:48:21.100066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: WARNING keystonemiddleware.auth_token [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 22:48:21.123169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: WARNING keystonemiddleware.auth_token [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 22:48:21.130516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: WARNING keystonemiddleware.auth_token [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 22:48:21.451596 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: WARNING keystonemiddleware.auth_token [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 22:48:21.458113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: WARNING keystonemiddleware.auth_token [None req-dac9bb80-a24a-4a47-a864-6cf579c34ace None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 22:48:21.463490 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c0e4979c0 pid: 129294 (default app) Jul 27 22:48:21.476449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: WARNING keystonemiddleware.auth_token [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 22:48:21.482390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: WARNING keystonemiddleware.auth_token [None req-8e197ddc-e665-4268-97eb-96f01554e7a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 22:48:21.487725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c0e4979c0 pid: 129295 (default app) Jul 27 22:49:04.176080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-217a993b-365c-4bbc-b049-f7efea08f6ee tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] Calling method '.version_select at 0x7f696c1e3820>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:04.215795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=3 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:04.217244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=3 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:04.218431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=3 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:04.219431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=3 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:05.286738 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-217a993b-365c-4bbc-b049-f7efea08f6ee tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a3a598a5-5c1e-4ee8-93cf-5b6c8fe59a9b" status: 200 len: 350 microversion: 2.1 time: 1.483779 Jul 27 22:49:05.297354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1/1] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 22:49:03 2022] GET /compute/v2.1/os-volumes/a3a598a5-5c1e-4ee8-93cf-5b6c8fe59a9b => generated 350 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:49:07.474865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d0cbeeff-94fd-4bba-99fc-7a8e2296a567 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] Calling method '.version_select at 0x7f696c1df820>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:07.528963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=3 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:07.531009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=3 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:07.532544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=3 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:07.534215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=3 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:08.071036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d0cbeeff-94fd-4bba-99fc-7a8e2296a567 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/b1b90aca-c181-4a17-8696-5f029fe04e79" status: 200 len: 351 microversion: 2.1 time: 0.939802 Jul 27 22:49:08.071618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1/2] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 22:49:07 2022] GET /compute/v2.1/os-volumes/b1b90aca-c181-4a17-8696-5f029fe04e79 => generated 351 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:49:14.678956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-48e2364f-070c-429e-ac4f-9a77dab773d1 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] Calling method '.version_select at 0x7f696c024b80>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:14.800885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-48e2364f-070c-429e-ac4f-9a77dab773d1 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/c708fc48-9446-4e88-9827-65053bc36877" status: 200 len: 350 microversion: 2.1 time: 0.126070 Jul 27 22:49:14.801400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 22:49:14 2022] GET /compute/v2.1/os-volumes/c708fc48-9446-4e88-9827-65053bc36877 => generated 350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:49:14.817884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2746d663-04cb-4a7f-9735-f66a3fbb1b4f tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] Calling method '.version_select at 0x7f696c023af0>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:15.046984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2746d663-04cb-4a7f-9735-f66a3fbb1b4f tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.234296 Jul 27 22:49:15.052695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1134 bytes} [Wed Jul 27 22:49:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:15.063774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b3b716a5-cc60-404f-a1ab-8a2d4c5e0e00 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] Calling method '.version_select at 0x7f696c024d30>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:15.292196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b3b716a5-cc60-404f-a1ab-8a2d4c5e0e00 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.232058 Jul 27 22:49:15.308573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 3/5] 10.222.0.47 () {58 vars in 1149 bytes} [Wed Jul 27 22:49:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:49:15.310855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ebece4f1-85f0-48ab-9cd3-3335f12bf31d tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] Calling method '.version_select at 0x7f696bf7d790>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:15.536362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ebece4f1-85f0-48ab-9cd3-3335f12bf31d tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.229270 Jul 27 22:49:15.553386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 3/6] 10.222.0.47 () {58 vars in 1134 bytes} [Wed Jul 27 22:49:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:15.554037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cb7fa791-5eec-4920-8d08-566aec09ea47 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] Calling method '.version_select at 0x7f696c0249d0>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:15.825097 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cb7fa791-5eec-4920-8d08-566aec09ea47 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.277937 Jul 27 22:49:15.835957 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1167 bytes} [Wed Jul 27 22:49:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:49:15.842212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8eccc2d7-fe1a-41ad-888a-99d6ef190a02 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] Calling method '.version_select at 0x7f696bf7daf0>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:16.056396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8eccc2d7-fe1a-41ad-888a-99d6ef190a02 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.218633 Jul 27 22:49:16.057203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1170 bytes} [Wed Jul 27 22:49:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:49:16.072487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9d05ebce-80d9-43c8-82fb-bca4f9fec41e tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] Calling method '.version_select at 0x7f696bff7d30>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:16.211909 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9d05ebce-80d9-43c8-82fb-bca4f9fec41e tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.143576 Jul 27 22:49:16.213356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 5/9] 10.222.0.47 () {58 vars in 1155 bytes} [Wed Jul 27 22:49:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:16.226477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0798139e-805e-4321-a853-1aa3ab46d3b7 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] Calling method '.version_select at 0x7f696bf958b0>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:16.541624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0798139e-805e-4321-a853-1aa3ab46d3b7 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.319125 Jul 27 22:49:16.542649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 5/10] 10.222.0.47 () {58 vars in 1188 bytes} [Wed Jul 27 22:49:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:49:16.558427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-85a7e53f-a22e-4039-a11d-0c6742af2735 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] Calling method '.version_select at 0x7f696bf98f70>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:16.739297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-85a7e53f-a22e-4039-a11d-0c6742af2735 tempest-VolumesTestJSON-1062902290 tempest-VolumesTestJSON-1062902290-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.185175 Jul 27 22:49:16.740019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 6/11] 10.222.0.47 () {58 vars in 1155 bytes} [Wed Jul 27 22:49:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:17.364667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2082905509", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:49:17.589713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.network.neutron [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] validate_networks() for [('b15daecf-7efc-40e4-aa11-6d83d979ffdf', None, None, None, None, None)] {{(pid=129295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 22:49:18.581294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6efcbd49-630a-4832-b59c-6e98ac2a812a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Action: 'create', calling method: .version_select at 0x7f696bf980d0>, body: {"keypair": {"name": "tempest-keypair-1171337682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyGHgLxHtr5xVUiu5Incol3bx9EFUAqjK88x2WyW2wHc/NgYOa2T0z3s+AcG4GvCAs8EDwU7W59ng4pix/3At1paCJ7arO/+QFkNcefS20azgtjjwjIfZBSXMDaWeFILw=="}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:49:18.714232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-6efcbd49-630a-4832-b59c-6e98ac2a812a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Getting quotas for project 161af2d8dc8f4aa99d4cc112a89ff674. Resources: {'key_pairs'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:49:18.725416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-6efcbd49-630a-4832-b59c-6e98ac2a812a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Getting quotas for user 3aa05eaf07f14de6b6ef97f08e6e5123 and project 161af2d8dc8f4aa99d4cc112a89ff674. Resources: {'key_pairs'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:49:18.827808 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6efcbd49-630a-4832-b59c-6e98ac2a812a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.874701 Jul 27 22:49:18.829121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 7/12] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 22:49:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:49:18.942632 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-971363440", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "networks": [{"uuid": "6b628fff-73f7-4aee-b19d-1b6682821287"}]}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:49:19.150424 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.network.neutron [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] validate_networks() for [('6b628fff-73f7-4aee-b19d-1b6682821287', None, None, None, None, None)] {{(pid=129294) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 22:49:21.078012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Flavor limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 22:49:21.078481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Image limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 22:49:21.078895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Flavor pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 22:49:21.079350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Image pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 22:49:21.079903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 22:49:21.121122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:21.122350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:21.125601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:21.126278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:21.181884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Getting quotas for project fc02f444ea474300a879336c8b122303. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:49:21.190064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Getting quotas for user a5c5f856a38849a39d84b6cd0706da4e and project fc02f444ea474300a879336c8b122303. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:49:21.207799 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Going to run 1 instances... {{(pid=129295) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 22:49:21.211740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 22:49:21.369142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-262d6ece-f137-4752-813f-26913b8881f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.287033 Jul 27 22:49:21.373233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 6/13] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 22:49:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 4292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 22:49:21.523255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Flavor limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 22:49:21.523758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Image limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 22:49:21.524662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Flavor pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 22:49:21.525481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Image pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 22:49:21.525899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 22:49:21.548126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:21.549812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:21.550755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:21.551446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:21.603875 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Getting quotas for project 36a5b2a855d34489af859c37cbc65553. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:49:21.613589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Getting quotas for user 7c2f8af22ac3469cb3948d4c2d32d519 and project 36a5b2a855d34489af859c37cbc65553. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:49:21.639060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Going to run 1 instances... {{(pid=129294) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 22:49:21.644251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129294) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 22:49:21.842840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2f712cfb-1146-40f0-b76d-a6c3d24a3f3f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.012393 Jul 27 22:49:21.843868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 8/14] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 22:49:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 22:49:21.856465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-81a8a3a6-0802-424e-8300-9b3d9e60c75a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:21.857839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-81a8a3a6-0802-424e-8300-9b3d9e60c75a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:21.935868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-725d2c19-6e56-4210-931f-001bf91a4cf3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Action: 'create', calling method: .version_select at 0x7f696b694670>, body: {"keypair": {"name": "tempest-keypair-1650605654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMd0wGn8TjII7hFlfBLSmsrW0gVTF7074HhvFc+cLyB1Q8uG/775v4OOzvUDeB1/BMulvPOpDK+1yUNjrR3CW1tKztot5bd/U/2hkBpq0Rdk/zje5rguI9z3BF5qwTI+Dg=="}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:49:21.999765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-725d2c19-6e56-4210-931f-001bf91a4cf3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Getting quotas for project 0d65941ddb4346e0b3fdc6b751a6aa07. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:49:22.008208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-725d2c19-6e56-4210-931f-001bf91a4cf3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Getting quotas for user 51db745daefd448b80630ef1bceca4c4 and project 0d65941ddb4346e0b3fdc6b751a6aa07. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:49:22.128120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-725d2c19-6e56-4210-931f-001bf91a4cf3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.752677 Jul 27 22:49:22.130079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 7/15] 10.222.0.47 () {62 vars in 1200 bytes} [Wed Jul 27 22:49:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 755 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 27 22:49:22.146480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-207c8a86-d454-4b3b-b6a4-4d496028cb90 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:22.147107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-207c8a86-d454-4b3b-b6a4-4d496028cb90 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:22.238848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-81a8a3a6-0802-424e-8300-9b3d9e60c75a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:22.306164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-81a8a3a6-0802-424e-8300-9b3d9e60c75a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1222 microversion: 2.1 time: 0.445705 Jul 27 22:49:22.308383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 9/16] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:21 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1222 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:22.362847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-207c8a86-d454-4b3b-b6a4-4d496028cb90 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:22.403410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-207c8a86-d454-4b3b-b6a4-4d496028cb90 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1214 microversion: 2.1 time: 0.271926 Jul 27 22:49:22.404161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 8/17] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:22 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1214 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:22.777286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1018945694", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:49:22.920100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.network.neutron [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] validate_networks() for [('b15daecf-7efc-40e4-aa11-6d83d979ffdf', None, None, None, None, None)] {{(pid=129294) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 22:49:23.429629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-12f824af-53bb-4a76-b01b-a33912c8661b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:23.430369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-12f824af-53bb-4a76-b01b-a33912c8661b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:23.701776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-12f824af-53bb-4a76-b01b-a33912c8661b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:23.713287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-12f824af-53bb-4a76-b01b-a33912c8661b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1214 microversion: 2.1 time: 0.287763 Jul 27 22:49:23.716456 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 9/18] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:23 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1214 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:24.634526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1014431081", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23355fc2-605c-41a1-9f14-303ff46ef32c"}], "security_groups": [{"name": "tempest-securitygroup--1491624928"}], "key_name": "tempest-keypair-1171337682", "user_data": "}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:49:25.295457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.network.neutron [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] validate_networks() for [('23355fc2-605c-41a1-9f14-303ff46ef32c', None, None, None, None, None)] {{(pid=129295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 22:49:25.491814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Flavor limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 22:49:25.492530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Image limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 22:49:25.492857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Flavor pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 22:49:25.493308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Image pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 22:49:25.494101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 22:49:25.514678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:25.516002 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:25.519324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:25.520975 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:25.619495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Getting quotas for project fc02f444ea474300a879336c8b122303. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:49:25.641442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Getting quotas for user a5c5f856a38849a39d84b6cd0706da4e and project fc02f444ea474300a879336c8b122303. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:49:25.685560 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Going to run 1 instances... {{(pid=129294) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 22:49:25.691905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129294) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 22:49:25.787753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a8393257-1a39-4e65-9cbb-5c946f580d5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.012136 Jul 27 22:49:25.788902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 10/19] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 22:49:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 3017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 22:49:25.817704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9d8b5fd3-f0d3-44ed-9ea7-03cdf656cb1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:25.821483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9d8b5fd3-f0d3-44ed-9ea7-03cdf656cb1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:25.833660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d8b5fd3-f0d3-44ed-9ea7-03cdf656cb1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:25.834311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d8b5fd3-f0d3-44ed-9ea7-03cdf656cb1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:25.835252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d8b5fd3-f0d3-44ed-9ea7-03cdf656cb1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:25.835886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d8b5fd3-f0d3-44ed-9ea7-03cdf656cb1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:27.033814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9d8b5fd3-f0d3-44ed-9ea7-03cdf656cb1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:27.069968 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9d8b5fd3-f0d3-44ed-9ea7-03cdf656cb1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1266 microversion: 2.1 time: 1.279939 Jul 27 22:49:27.075066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 11/20] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:25 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1266 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:27.134633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-eba962cc-4c75-4816-9aee-bcce96f0e579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:27.135570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-eba962cc-4c75-4816-9aee-bcce96f0e579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:27.188840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eba962cc-4c75-4816-9aee-bcce96f0e579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:27.189420 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eba962cc-4c75-4816-9aee-bcce96f0e579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:27.190276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eba962cc-4c75-4816-9aee-bcce96f0e579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:27.190910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eba962cc-4c75-4816-9aee-bcce96f0e579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:27.261870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Flavor limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 22:49:27.262640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Image limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 22:49:27.263388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Flavor pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 22:49:27.263952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Image pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 22:49:27.277394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 22:49:27.331239 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:27.333715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:27.337416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:27.338993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:27.442546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Getting quotas for project 161af2d8dc8f4aa99d4cc112a89ff674. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:49:27.449910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eba962cc-4c75-4816-9aee-bcce96f0e579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:27.460609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-eba962cc-4c75-4816-9aee-bcce96f0e579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1226 microversion: 2.1 time: 0.383215 Jul 27 22:49:27.461156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Getting quotas for user 3aa05eaf07f14de6b6ef97f08e6e5123 and project 161af2d8dc8f4aa99d4cc112a89ff674. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:49:27.463086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 12/21] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:27 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1226 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:27.531922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Going to run 1 instances... {{(pid=129295) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 22:49:27.535390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 22:49:27.673314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-de51fd4e-af94-4dc4-87c1-a3f3d917ead0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.043801 Jul 27 22:49:27.675712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 10/22] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 22:49:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 3048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 22:49:27.688289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fb7935c9-7d08-4276-9263-5cdbeb89c9d1 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:27.689229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fb7935c9-7d08-4276-9263-5cdbeb89c9d1 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:27.750663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fb7935c9-7d08-4276-9263-5cdbeb89c9d1 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:27.759480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fb7935c9-7d08-4276-9263-5cdbeb89c9d1 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1238 microversion: 2.1 time: 0.075996 Jul 27 22:49:27.760182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 13/23] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:27 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:28.107557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e0076f4f-47e3-4784-9033-17a63c22d4bf tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:28.108343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e0076f4f-47e3-4784-9033-17a63c22d4bf tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:28.125123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e0076f4f-47e3-4784-9033-17a63c22d4bf tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:28.125737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e0076f4f-47e3-4784-9033-17a63c22d4bf tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:28.129412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e0076f4f-47e3-4784-9033-17a63c22d4bf tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:28.130124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e0076f4f-47e3-4784-9033-17a63c22d4bf tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:28.484476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-43851965-f3d6-4f6b-8a32-532b97b90ecc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:28.485303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-43851965-f3d6-4f6b-8a32-532b97b90ecc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:28.503750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43851965-f3d6-4f6b-8a32-532b97b90ecc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:28.504220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43851965-f3d6-4f6b-8a32-532b97b90ecc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:28.505200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43851965-f3d6-4f6b-8a32-532b97b90ecc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:28.520036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43851965-f3d6-4f6b-8a32-532b97b90ecc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:28.654972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e0076f4f-47e3-4784-9033-17a63c22d4bf tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:28.677826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e0076f4f-47e3-4784-9033-17a63c22d4bf tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1272 microversion: 2.1 time: 0.574722 Jul 27 22:49:28.678474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 11/24] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:28 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1272 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:28.683583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-552685340", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e91465a7-4c6d-43c7-ad8f-466fa76b142b"}], "security_groups": [{"name": "tempest-securitygroup--1308356511"}], "key_name": "tempest-keypair-1650605654", "user_data": "}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:49:28.770369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-43851965-f3d6-4f6b-8a32-532b97b90ecc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:28.781023 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-43851965-f3d6-4f6b-8a32-532b97b90ecc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1274 microversion: 2.1 time: 0.301178 Jul 27 22:49:28.782287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 14/25] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:28 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1274 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:28.802562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1b8b7534-c7a4-4d80-888f-c892a7682ca6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:28.803193 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1b8b7534-c7a4-4d80-888f-c892a7682ca6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:28.821417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b8b7534-c7a4-4d80-888f-c892a7682ca6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:28.821871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b8b7534-c7a4-4d80-888f-c892a7682ca6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:28.825023 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b8b7534-c7a4-4d80-888f-c892a7682ca6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:28.828045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b8b7534-c7a4-4d80-888f-c892a7682ca6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:28.884710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.network.neutron [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] validate_networks() for [('e91465a7-4c6d-43c7-ad8f-466fa76b142b', None, None, None, None, None)] {{(pid=129295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 22:49:28.990258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1b8b7534-c7a4-4d80-888f-c892a7682ca6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:28.999785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1b8b7534-c7a4-4d80-888f-c892a7682ca6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1242 microversion: 2.1 time: 0.206604 Jul 27 22:49:29.001472 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 15/26] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:28 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1242 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:29.521205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Flavor limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 22:49:29.521955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Image limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 22:49:29.522558 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Flavor pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 22:49:29.523013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Image pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 22:49:29.523508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 22:49:29.534818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:29.535578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:29.536598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:29.537169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:29.555396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Getting quotas for project 0d65941ddb4346e0b3fdc6b751a6aa07. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:49:29.559708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Getting quotas for user 51db745daefd448b80630ef1bceca4c4 and project 0d65941ddb4346e0b3fdc6b751a6aa07. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:49:29.571767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Going to run 1 instances... {{(pid=129295) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 22:49:29.574280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 22:49:29.633751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a9dcfb95-1a17-460a-8dca-7c75c19cb8e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.954030 Jul 27 22:49:29.634723 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 12/27] 10.222.0.47 () {62 vars in 1188 bytes} [Wed Jul 27 22:49:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 22:49:29.645755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bccd0052-5e6c-42e4-8f9c-a5f5f0171a6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:29.646944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bccd0052-5e6c-42e4-8f9c-a5f5f0171a6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:29.699298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0572a725-a4f2-4da5-8d74-cc0f73410b16 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:29.700240 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0572a725-a4f2-4da5-8d74-cc0f73410b16 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:29.716645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0572a725-a4f2-4da5-8d74-cc0f73410b16 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:29.724906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0572a725-a4f2-4da5-8d74-cc0f73410b16 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:29.727865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0572a725-a4f2-4da5-8d74-cc0f73410b16 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:29.728507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0572a725-a4f2-4da5-8d74-cc0f73410b16 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:29.745875 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bccd0052-5e6c-42e4-8f9c-a5f5f0171a6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:29.759466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bccd0052-5e6c-42e4-8f9c-a5f5f0171a6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:29.778453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bccd0052-5e6c-42e4-8f9c-a5f5f0171a6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:29.779649 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bccd0052-5e6c-42e4-8f9c-a5f5f0171a6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1281 microversion: 2.20 time: 0.137616 Jul 27 22:49:29.795863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 16/28] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:29 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:29.811947 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a348f8e7-53e2-412f-ba62-558a492a9131 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:29.813387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a348f8e7-53e2-412f-ba62-558a492a9131 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:29.821252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a348f8e7-53e2-412f-ba62-558a492a9131 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:29.822910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a348f8e7-53e2-412f-ba62-558a492a9131 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:29.824176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a348f8e7-53e2-412f-ba62-558a492a9131 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:29.824825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a348f8e7-53e2-412f-ba62-558a492a9131 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:29.933973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0572a725-a4f2-4da5-8d74-cc0f73410b16 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:29.943935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0572a725-a4f2-4da5-8d74-cc0f73410b16 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1272 microversion: 2.1 time: 0.249184 Jul 27 22:49:29.958724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 13/29] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:29 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1272 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:30.026645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-68fadc48-7015-469b-96a3-17a8b494eb5b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:30.027521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-68fadc48-7015-469b-96a3-17a8b494eb5b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:30.035325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68fadc48-7015-469b-96a3-17a8b494eb5b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:30.036426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a348f8e7-53e2-412f-ba62-558a492a9131 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:30.038450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68fadc48-7015-469b-96a3-17a8b494eb5b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:30.043528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68fadc48-7015-469b-96a3-17a8b494eb5b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:30.045151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68fadc48-7015-469b-96a3-17a8b494eb5b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:30.051190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a348f8e7-53e2-412f-ba62-558a492a9131 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1274 microversion: 2.1 time: 0.249125 Jul 27 22:49:30.053453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 17/30] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:29 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1274 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:30.182600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-68fadc48-7015-469b-96a3-17a8b494eb5b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:30.192153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-68fadc48-7015-469b-96a3-17a8b494eb5b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1242 microversion: 2.1 time: 0.172603 Jul 27 22:49:30.197169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 14/31] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:30 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1242 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:30.803419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6f444e83-abb3-4894-9fef-6ae5a2cf221e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:30.804021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6f444e83-abb3-4894-9fef-6ae5a2cf221e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:30.813669 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f444e83-abb3-4894-9fef-6ae5a2cf221e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:30.814330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f444e83-abb3-4894-9fef-6ae5a2cf221e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:30.815323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f444e83-abb3-4894-9fef-6ae5a2cf221e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:30.815906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f444e83-abb3-4894-9fef-6ae5a2cf221e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:30.968917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d2927061-3bb5-4f3f-90b2-454d0b085ad1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:30.982841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d2927061-3bb5-4f3f-90b2-454d0b085ad1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:30.983612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6f444e83-abb3-4894-9fef-6ae5a2cf221e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:30.983711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2927061-3bb5-4f3f-90b2-454d0b085ad1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:30.986170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2927061-3bb5-4f3f-90b2-454d0b085ad1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:30.988770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2927061-3bb5-4f3f-90b2-454d0b085ad1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:30.994904 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2927061-3bb5-4f3f-90b2-454d0b085ad1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:30.996227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6f444e83-abb3-4894-9fef-6ae5a2cf221e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:31.003633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6f444e83-abb3-4894-9fef-6ae5a2cf221e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:31.007232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6f444e83-abb3-4894-9fef-6ae5a2cf221e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1285 microversion: 2.20 time: 0.206886 Jul 27 22:49:31.010302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 18/32] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:31.083332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-24d09907-d47c-4057-8d00-ab229df3a840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:31.083977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-24d09907-d47c-4057-8d00-ab229df3a840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:31.113783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24d09907-d47c-4057-8d00-ab229df3a840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:31.113783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24d09907-d47c-4057-8d00-ab229df3a840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:31.120348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24d09907-d47c-4057-8d00-ab229df3a840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:31.125578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24d09907-d47c-4057-8d00-ab229df3a840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:31.208353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d2927061-3bb5-4f3f-90b2-454d0b085ad1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:31.222320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d2927061-3bb5-4f3f-90b2-454d0b085ad1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1272 microversion: 2.1 time: 0.252556 Jul 27 22:49:31.225695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 15/33] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:30 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:31.243557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e31f9943-cc94-4f38-90aa-a264bef2fd3e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:31.261843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e31f9943-cc94-4f38-90aa-a264bef2fd3e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:31.287960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e31f9943-cc94-4f38-90aa-a264bef2fd3e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:31.297315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e31f9943-cc94-4f38-90aa-a264bef2fd3e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:31.304414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e31f9943-cc94-4f38-90aa-a264bef2fd3e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:31.305167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e31f9943-cc94-4f38-90aa-a264bef2fd3e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:31.417277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-24d09907-d47c-4057-8d00-ab229df3a840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:31.430260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-24d09907-d47c-4057-8d00-ab229df3a840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1274 microversion: 2.1 time: 0.358866 Jul 27 22:49:31.430840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 19/34] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:31 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1274 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:31.538007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e31f9943-cc94-4f38-90aa-a264bef2fd3e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:31.550096 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e31f9943-cc94-4f38-90aa-a264bef2fd3e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1242 microversion: 2.1 time: 0.320130 Jul 27 22:49:31.553777 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 16/35] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:31 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1242 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:32.030584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-52f28e74-59bf-410c-88f7-fd32e6fcb880 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:32.031199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-52f28e74-59bf-410c-88f7-fd32e6fcb880 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:32.043371 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52f28e74-59bf-410c-88f7-fd32e6fcb880 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:32.050483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52f28e74-59bf-410c-88f7-fd32e6fcb880 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:32.051690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52f28e74-59bf-410c-88f7-fd32e6fcb880 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:32.052358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52f28e74-59bf-410c-88f7-fd32e6fcb880 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:32.261279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d252bb33-79cb-4d64-a26a-c4201d92d991 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:32.263951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d252bb33-79cb-4d64-a26a-c4201d92d991 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:32.280543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d252bb33-79cb-4d64-a26a-c4201d92d991 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:32.281172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d252bb33-79cb-4d64-a26a-c4201d92d991 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:32.281356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-52f28e74-59bf-410c-88f7-fd32e6fcb880 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:32.282597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d252bb33-79cb-4d64-a26a-c4201d92d991 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:32.283077 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d252bb33-79cb-4d64-a26a-c4201d92d991 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:32.297134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-52f28e74-59bf-410c-88f7-fd32e6fcb880 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:32.301615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-52f28e74-59bf-410c-88f7-fd32e6fcb880 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:32.308429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-52f28e74-59bf-410c-88f7-fd32e6fcb880 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1333 microversion: 2.20 time: 0.279689 Jul 27 22:49:32.309603 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 20/36] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:32 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1333 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:32.377850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d252bb33-79cb-4d64-a26a-c4201d92d991 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:32.389727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d252bb33-79cb-4d64-a26a-c4201d92d991 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1272 microversion: 2.1 time: 0.142792 Jul 27 22:49:32.391154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 17/37] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:32 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:32.458290 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-613a9f61-5984-446d-8a91-536c85484124 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:32.458918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-613a9f61-5984-446d-8a91-536c85484124 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:32.486583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-613a9f61-5984-446d-8a91-536c85484124 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:32.487038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-613a9f61-5984-446d-8a91-536c85484124 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:32.509619 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-613a9f61-5984-446d-8a91-536c85484124 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:32.510945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-613a9f61-5984-446d-8a91-536c85484124 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:32.575453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-62a6118f-ed10-4c2c-81b5-6ac9fd455d0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:32.576081 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-62a6118f-ed10-4c2c-81b5-6ac9fd455d0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:32.586659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62a6118f-ed10-4c2c-81b5-6ac9fd455d0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:32.599923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62a6118f-ed10-4c2c-81b5-6ac9fd455d0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:32.601670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62a6118f-ed10-4c2c-81b5-6ac9fd455d0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:32.602221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62a6118f-ed10-4c2c-81b5-6ac9fd455d0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:32.726795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-613a9f61-5984-446d-8a91-536c85484124 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:32.748229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-613a9f61-5984-446d-8a91-536c85484124 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1280 microversion: 2.1 time: 0.298232 Jul 27 22:49:32.749438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 21/38] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:32 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1280 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:32.859267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-62a6118f-ed10-4c2c-81b5-6ac9fd455d0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:32.876824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-62a6118f-ed10-4c2c-81b5-6ac9fd455d0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1290 microversion: 2.1 time: 0.301146 Jul 27 22:49:32.882099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 18/39] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:32 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1290 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:33.337831 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cfecb08a-1884-4202-92ab-6a107acdce1f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:33.338671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cfecb08a-1884-4202-92ab-6a107acdce1f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:33.346008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cfecb08a-1884-4202-92ab-6a107acdce1f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:33.346591 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cfecb08a-1884-4202-92ab-6a107acdce1f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:33.348257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cfecb08a-1884-4202-92ab-6a107acdce1f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:33.348891 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cfecb08a-1884-4202-92ab-6a107acdce1f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:33.410368 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-585ea69c-2bc0-47b3-988a-b79fb8099364 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:33.411912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-585ea69c-2bc0-47b3-988a-b79fb8099364 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:33.418317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-585ea69c-2bc0-47b3-988a-b79fb8099364 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:33.418792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-585ea69c-2bc0-47b3-988a-b79fb8099364 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:33.420050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-585ea69c-2bc0-47b3-988a-b79fb8099364 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:33.420665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-585ea69c-2bc0-47b3-988a-b79fb8099364 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:33.423879 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cfecb08a-1884-4202-92ab-6a107acdce1f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:33.431812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cfecb08a-1884-4202-92ab-6a107acdce1f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:33.433377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cfecb08a-1884-4202-92ab-6a107acdce1f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:33.434493 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cfecb08a-1884-4202-92ab-6a107acdce1f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1341 microversion: 2.20 time: 0.101758 Jul 27 22:49:33.435599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 22/40] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1341 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:33.496997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-585ea69c-2bc0-47b3-988a-b79fb8099364 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:33.514243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-585ea69c-2bc0-47b3-988a-b79fb8099364 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1272 microversion: 2.1 time: 0.107538 Jul 27 22:49:33.514763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 19/41] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:33 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:33.775320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b02c3773-d011-4edd-9532-b83a37f9fc5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:33.776225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b02c3773-d011-4edd-9532-b83a37f9fc5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:33.788301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b02c3773-d011-4edd-9532-b83a37f9fc5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:33.789160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b02c3773-d011-4edd-9532-b83a37f9fc5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:33.790105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b02c3773-d011-4edd-9532-b83a37f9fc5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:33.790699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b02c3773-d011-4edd-9532-b83a37f9fc5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:33.898261 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-346cbb7b-0453-44bb-9216-bdcc6b592c8b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:33.898889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-346cbb7b-0453-44bb-9216-bdcc6b592c8b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:33.922898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-346cbb7b-0453-44bb-9216-bdcc6b592c8b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:33.923367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-346cbb7b-0453-44bb-9216-bdcc6b592c8b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:33.925019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-346cbb7b-0453-44bb-9216-bdcc6b592c8b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:33.925462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-346cbb7b-0453-44bb-9216-bdcc6b592c8b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:33.949777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b02c3773-d011-4edd-9532-b83a37f9fc5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:33.960915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b02c3773-d011-4edd-9532-b83a37f9fc5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1280 microversion: 2.1 time: 0.189126 Jul 27 22:49:33.970212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 23/42] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:33 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1280 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:34.135342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-346cbb7b-0453-44bb-9216-bdcc6b592c8b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:34.152295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-346cbb7b-0453-44bb-9216-bdcc6b592c8b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1290 microversion: 2.1 time: 0.251912 Jul 27 22:49:34.156449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 20/43] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:33 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1290 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:34.463149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5ba60447-c6e3-49f2-9b64-7c523bbe0112 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:34.463821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5ba60447-c6e3-49f2-9b64-7c523bbe0112 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:34.471396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5ba60447-c6e3-49f2-9b64-7c523bbe0112 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:34.471838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5ba60447-c6e3-49f2-9b64-7c523bbe0112 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:34.473228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5ba60447-c6e3-49f2-9b64-7c523bbe0112 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:34.473937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5ba60447-c6e3-49f2-9b64-7c523bbe0112 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:34.537077 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-393006af-c958-4817-b487-966207a6d2f7 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:34.537707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-393006af-c958-4817-b487-966207a6d2f7 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:34.549590 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-393006af-c958-4817-b487-966207a6d2f7 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:34.550686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-393006af-c958-4817-b487-966207a6d2f7 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:34.551645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-393006af-c958-4817-b487-966207a6d2f7 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:34.552222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-393006af-c958-4817-b487-966207a6d2f7 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:34.585393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5ba60447-c6e3-49f2-9b64-7c523bbe0112 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:34.599888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5ba60447-c6e3-49f2-9b64-7c523bbe0112 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:34.601708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5ba60447-c6e3-49f2-9b64-7c523bbe0112 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:34.603311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5ba60447-c6e3-49f2-9b64-7c523bbe0112 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1341 microversion: 2.20 time: 0.145039 Jul 27 22:49:34.617271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 24/44] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:34 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1341 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:34.807857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-393006af-c958-4817-b487-966207a6d2f7 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:34.817056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-393006af-c958-4817-b487-966207a6d2f7 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.285347 Jul 27 22:49:34.817622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 21/45] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:34 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:34.984101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c594037d-b913-4144-a094-cf01b223631b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:34.985373 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c594037d-b913-4144-a094-cf01b223631b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:34.996803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c594037d-b913-4144-a094-cf01b223631b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:34.997520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c594037d-b913-4144-a094-cf01b223631b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:34.998459 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c594037d-b913-4144-a094-cf01b223631b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:34.999040 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c594037d-b913-4144-a094-cf01b223631b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:35.174578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c594037d-b913-4144-a094-cf01b223631b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:35.178417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b821f8cf-b491-412e-b95a-6350da601bc5 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:35.179647 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b821f8cf-b491-412e-b95a-6350da601bc5 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:35.183444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c594037d-b913-4144-a094-cf01b223631b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.203394 Jul 27 22:49:35.184758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 25/46] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:34 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:35.189682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b821f8cf-b491-412e-b95a-6350da601bc5 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:35.189682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b821f8cf-b491-412e-b95a-6350da601bc5 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:35.198690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b821f8cf-b491-412e-b95a-6350da601bc5 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:35.204066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b821f8cf-b491-412e-b95a-6350da601bc5 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:35.275134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b821f8cf-b491-412e-b95a-6350da601bc5 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:35.283331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b821f8cf-b491-412e-b95a-6350da601bc5 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1290 microversion: 2.1 time: 0.109315 Jul 27 22:49:35.283910 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 22/47] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:35 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1290 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:35.631475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-23b09e97-8ca4-4757-9e11-5701e73b2f52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:35.633123 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-23b09e97-8ca4-4757-9e11-5701e73b2f52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:35.636751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=4 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:35.650332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23b09e97-8ca4-4757-9e11-5701e73b2f52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:35.651449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23b09e97-8ca4-4757-9e11-5701e73b2f52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:35.653197 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23b09e97-8ca4-4757-9e11-5701e73b2f52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:35.656277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23b09e97-8ca4-4757-9e11-5701e73b2f52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:35.758361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-23b09e97-8ca4-4757-9e11-5701e73b2f52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:35.767474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-23b09e97-8ca4-4757-9e11-5701e73b2f52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:35.768962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-23b09e97-8ca4-4757-9e11-5701e73b2f52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:35.770041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-23b09e97-8ca4-4757-9e11-5701e73b2f52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1341 microversion: 2.20 time: 0.143846 Jul 27 22:49:35.770598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 26/48] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1341 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:35.837261 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3d6cb747-a103-49a4-825a-2ac4f6d5438e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:35.838014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3d6cb747-a103-49a4-825a-2ac4f6d5438e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:35.857912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3d6cb747-a103-49a4-825a-2ac4f6d5438e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:35.859851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3d6cb747-a103-49a4-825a-2ac4f6d5438e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:35.860871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3d6cb747-a103-49a4-825a-2ac4f6d5438e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:35.861638 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3d6cb747-a103-49a4-825a-2ac4f6d5438e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:36.092717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3d6cb747-a103-49a4-825a-2ac4f6d5438e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:36.103151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3d6cb747-a103-49a4-825a-2ac4f6d5438e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.268814 Jul 27 22:49:36.116936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 23/49] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:35 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:36.204866 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3e33d80c-1a80-4dab-a6ec-7e0c20cf1d2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:36.205506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3e33d80c-1a80-4dab-a6ec-7e0c20cf1d2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:36.213895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e33d80c-1a80-4dab-a6ec-7e0c20cf1d2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:36.215991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e33d80c-1a80-4dab-a6ec-7e0c20cf1d2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:36.219001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e33d80c-1a80-4dab-a6ec-7e0c20cf1d2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:36.221007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e33d80c-1a80-4dab-a6ec-7e0c20cf1d2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:36.333490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-20e8da25-c23c-48d6-acb1-39c575686713 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:36.334627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-20e8da25-c23c-48d6-acb1-39c575686713 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:36.359365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20e8da25-c23c-48d6-acb1-39c575686713 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:36.359813 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20e8da25-c23c-48d6-acb1-39c575686713 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:36.362071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20e8da25-c23c-48d6-acb1-39c575686713 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:36.364702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20e8da25-c23c-48d6-acb1-39c575686713 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:36.474600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-20e8da25-c23c-48d6-acb1-39c575686713 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:36.486566 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-20e8da25-c23c-48d6-acb1-39c575686713 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1298 microversion: 2.1 time: 0.164194 Jul 27 22:49:36.487454 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 24/50] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:36 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1298 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:36.491079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3e33d80c-1a80-4dab-a6ec-7e0c20cf1d2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:36.500272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3e33d80c-1a80-4dab-a6ec-7e0c20cf1d2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.299248 Jul 27 22:49:36.501116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 27/51] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:36 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:36.808039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6816d73b-33bb-4086-9dd1-c7edaa004723 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:36.809092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6816d73b-33bb-4086-9dd1-c7edaa004723 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:36.813136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:36.828091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6816d73b-33bb-4086-9dd1-c7edaa004723 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:36.830596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6816d73b-33bb-4086-9dd1-c7edaa004723 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:36.832664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6816d73b-33bb-4086-9dd1-c7edaa004723 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:36.833109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6816d73b-33bb-4086-9dd1-c7edaa004723 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:36.968232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6816d73b-33bb-4086-9dd1-c7edaa004723 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:36.984071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6816d73b-33bb-4086-9dd1-c7edaa004723 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:36.985786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6816d73b-33bb-4086-9dd1-c7edaa004723 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:36.986913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6816d73b-33bb-4086-9dd1-c7edaa004723 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1341 microversion: 2.20 time: 0.196281 Jul 27 22:49:36.990631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 25/52] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:37.127153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5e452c22-b20b-4020-b0eb-b82b64092643 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:37.128915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5e452c22-b20b-4020-b0eb-b82b64092643 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:37.145616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e452c22-b20b-4020-b0eb-b82b64092643 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:37.146204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e452c22-b20b-4020-b0eb-b82b64092643 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:37.147074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e452c22-b20b-4020-b0eb-b82b64092643 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:37.147725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e452c22-b20b-4020-b0eb-b82b64092643 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:37.404930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5e452c22-b20b-4020-b0eb-b82b64092643 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:37.412610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:37.418259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5e452c22-b20b-4020-b0eb-b82b64092643 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.295015 Jul 27 22:49:37.418844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 28/53] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:37 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:37.507783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-09479716-597a-486a-b587-f85a42294dd2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:37.509178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-09479716-597a-486a-b587-f85a42294dd2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:37.522803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-09479716-597a-486a-b587-f85a42294dd2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:37.523448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-09479716-597a-486a-b587-f85a42294dd2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:37.524505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-09479716-597a-486a-b587-f85a42294dd2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:37.525089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-09479716-597a-486a-b587-f85a42294dd2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:37.530304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fde96bc6-7740-4209-aa67-a3256641bb1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:37.531219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fde96bc6-7740-4209-aa67-a3256641bb1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:37.538694 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fde96bc6-7740-4209-aa67-a3256641bb1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:37.553762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fde96bc6-7740-4209-aa67-a3256641bb1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:37.555533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fde96bc6-7740-4209-aa67-a3256641bb1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:37.555958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fde96bc6-7740-4209-aa67-a3256641bb1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:37.652847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-09479716-597a-486a-b587-f85a42294dd2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:37.663129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-09479716-597a-486a-b587-f85a42294dd2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1298 microversion: 2.1 time: 0.159376 Jul 27 22:49:37.666706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 26/54] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:37 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:37.770853 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fde96bc6-7740-4209-aa67-a3256641bb1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:37.778950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fde96bc6-7740-4209-aa67-a3256641bb1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.260408 Jul 27 22:49:37.780527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 29/55] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:37 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:38.029104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-88b41dbc-4c20-4685-8259-22e9106ac96f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:38.030694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-88b41dbc-4c20-4685-8259-22e9106ac96f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:38.044010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-88b41dbc-4c20-4685-8259-22e9106ac96f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:38.045155 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-88b41dbc-4c20-4685-8259-22e9106ac96f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:38.045909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-88b41dbc-4c20-4685-8259-22e9106ac96f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:38.046332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-88b41dbc-4c20-4685-8259-22e9106ac96f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:38.080089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:38.139000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-88b41dbc-4c20-4685-8259-22e9106ac96f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:38.148828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-88b41dbc-4c20-4685-8259-22e9106ac96f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:38.156403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-88b41dbc-4c20-4685-8259-22e9106ac96f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:38.157603 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-88b41dbc-4c20-4685-8259-22e9106ac96f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1341 microversion: 2.20 time: 0.133787 Jul 27 22:49:38.158201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 27/56] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:38 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1341 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:38.447729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ea859588-918d-4a0b-923e-09c19459ca82 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:38.448666 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ea859588-918d-4a0b-923e-09c19459ca82 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:38.457832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ea859588-918d-4a0b-923e-09c19459ca82 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:38.458450 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ea859588-918d-4a0b-923e-09c19459ca82 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:38.459559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ea859588-918d-4a0b-923e-09c19459ca82 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:38.460169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ea859588-918d-4a0b-923e-09c19459ca82 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:38.619824 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ea859588-918d-4a0b-923e-09c19459ca82 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:38.635299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ea859588-918d-4a0b-923e-09c19459ca82 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.193572 Jul 27 22:49:38.635878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 30/57] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:38 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:38.698099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f3c53478-a4c4-481a-827e-f6af024c4b4b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:38.698714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f3c53478-a4c4-481a-827e-f6af024c4b4b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:38.709585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f3c53478-a4c4-481a-827e-f6af024c4b4b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:38.709585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f3c53478-a4c4-481a-827e-f6af024c4b4b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:38.709585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f3c53478-a4c4-481a-827e-f6af024c4b4b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:38.709585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f3c53478-a4c4-481a-827e-f6af024c4b4b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:38.778151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f3c53478-a4c4-481a-827e-f6af024c4b4b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:38.786648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f3c53478-a4c4-481a-827e-f6af024c4b4b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1298 microversion: 2.1 time: 0.093591 Jul 27 22:49:38.787309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 28/58] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:38 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:38.800705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3d251a86-bbc9-4bb5-86ee-282f787fef19 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:38.801643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3d251a86-bbc9-4bb5-86ee-282f787fef19 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:38.811202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d251a86-bbc9-4bb5-86ee-282f787fef19 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:38.811666 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d251a86-bbc9-4bb5-86ee-282f787fef19 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:38.812641 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d251a86-bbc9-4bb5-86ee-282f787fef19 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:38.813120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d251a86-bbc9-4bb5-86ee-282f787fef19 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:38.956606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3d251a86-bbc9-4bb5-86ee-282f787fef19 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:38.963885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3d251a86-bbc9-4bb5-86ee-282f787fef19 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.167143 Jul 27 22:49:38.964445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 31/59] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:38 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:39.188198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8b6fb46e-cb81-4c98-a00a-a1538437e6c3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:39.189141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8b6fb46e-cb81-4c98-a00a-a1538437e6c3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:39.203466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b6fb46e-cb81-4c98-a00a-a1538437e6c3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:39.203989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b6fb46e-cb81-4c98-a00a-a1538437e6c3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:39.204980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b6fb46e-cb81-4c98-a00a-a1538437e6c3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:39.205410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b6fb46e-cb81-4c98-a00a-a1538437e6c3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:39.268718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8b6fb46e-cb81-4c98-a00a-a1538437e6c3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:39.276741 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8b6fb46e-cb81-4c98-a00a-a1538437e6c3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:39.278361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8b6fb46e-cb81-4c98-a00a-a1538437e6c3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:39.279460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8b6fb46e-cb81-4c98-a00a-a1538437e6c3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1341 microversion: 2.20 time: 0.096355 Jul 27 22:49:39.280010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 29/60] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1341 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:39.658734 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6f6ab324-f6a7-4e78-a90b-0d2f6c60c6ed tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:39.659369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6f6ab324-f6a7-4e78-a90b-0d2f6c60c6ed tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:39.665521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f6ab324-f6a7-4e78-a90b-0d2f6c60c6ed tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:39.665962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f6ab324-f6a7-4e78-a90b-0d2f6c60c6ed tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:39.666719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f6ab324-f6a7-4e78-a90b-0d2f6c60c6ed tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:39.667146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f6ab324-f6a7-4e78-a90b-0d2f6c60c6ed tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:39.752363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=22 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:39.816120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6f6ab324-f6a7-4e78-a90b-0d2f6c60c6ed tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:39.817535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-439d2fff-e641-4b05-aaf3-b9c3b141c293 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:39.820695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-439d2fff-e641-4b05-aaf3-b9c3b141c293 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:39.827348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=6 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:39.828012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=26 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:39.828416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6f6ab324-f6a7-4e78-a90b-0d2f6c60c6ed tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.172510 Jul 27 22:49:39.829679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 32/61] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:39 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:39.832274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-439d2fff-e641-4b05-aaf3-b9c3b141c293 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:39.833180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-439d2fff-e641-4b05-aaf3-b9c3b141c293 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:39.834216 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-439d2fff-e641-4b05-aaf3-b9c3b141c293 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:39.834842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-439d2fff-e641-4b05-aaf3-b9c3b141c293 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:39.911875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-439d2fff-e641-4b05-aaf3-b9c3b141c293 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:39.925549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-439d2fff-e641-4b05-aaf3-b9c3b141c293 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1298 microversion: 2.1 time: 0.112041 Jul 27 22:49:39.926393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 30/62] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:39 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:39.985055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e5b1764c-9cdb-45de-b743-f301400d7488 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:39.985596 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e5b1764c-9cdb-45de-b743-f301400d7488 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:39.991712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5b1764c-9cdb-45de-b743-f301400d7488 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:39.992144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5b1764c-9cdb-45de-b743-f301400d7488 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:39.992914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5b1764c-9cdb-45de-b743-f301400d7488 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:39.993335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5b1764c-9cdb-45de-b743-f301400d7488 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:40.150847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e5b1764c-9cdb-45de-b743-f301400d7488 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:40.159815 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e5b1764c-9cdb-45de-b743-f301400d7488 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.178542 Jul 27 22:49:40.160656 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 33/63] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:39 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:40.305721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0d069f30-c31b-43ff-8644-1ab1db6d5ae2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:40.306323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0d069f30-c31b-43ff-8644-1ab1db6d5ae2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:40.322301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d069f30-c31b-43ff-8644-1ab1db6d5ae2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:40.322746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d069f30-c31b-43ff-8644-1ab1db6d5ae2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:40.323555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d069f30-c31b-43ff-8644-1ab1db6d5ae2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:40.324010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d069f30-c31b-43ff-8644-1ab1db6d5ae2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:40.410348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0d069f30-c31b-43ff-8644-1ab1db6d5ae2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:40.423059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0d069f30-c31b-43ff-8644-1ab1db6d5ae2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:40.424595 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0d069f30-c31b-43ff-8644-1ab1db6d5ae2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:40.425771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0d069f30-c31b-43ff-8644-1ab1db6d5ae2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1341 microversion: 2.20 time: 0.124701 Jul 27 22:49:40.426633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 31/64] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1341 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:40.855351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-92b47baa-fb7d-4d43-a167-d07ebd018b55 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:40.856757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-92b47baa-fb7d-4d43-a167-d07ebd018b55 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:40.877854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:40.883578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-92b47baa-fb7d-4d43-a167-d07ebd018b55 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:40.884038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-92b47baa-fb7d-4d43-a167-d07ebd018b55 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:40.885094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-92b47baa-fb7d-4d43-a167-d07ebd018b55 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:40.885991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-92b47baa-fb7d-4d43-a167-d07ebd018b55 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:40.947967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0b378f8b-c848-4f79-9735-648f7bd902e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:40.948808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0b378f8b-c848-4f79-9735-648f7bd902e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:40.969924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0b378f8b-c848-4f79-9735-648f7bd902e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:40.970514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0b378f8b-c848-4f79-9735-648f7bd902e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:40.971363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0b378f8b-c848-4f79-9735-648f7bd902e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:40.972164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0b378f8b-c848-4f79-9735-648f7bd902e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:41.090239 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0b378f8b-c848-4f79-9735-648f7bd902e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:41.099665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0b378f8b-c848-4f79-9735-648f7bd902e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1298 microversion: 2.1 time: 0.155944 Jul 27 22:49:41.100599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 32/65] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:40 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:41.182400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-938c3e56-8c40-4556-aeed-1e060894c8da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:41.182952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-938c3e56-8c40-4556-aeed-1e060894c8da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:41.195744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-938c3e56-8c40-4556-aeed-1e060894c8da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:41.197847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-938c3e56-8c40-4556-aeed-1e060894c8da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:41.201072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-938c3e56-8c40-4556-aeed-1e060894c8da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:41.202985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-938c3e56-8c40-4556-aeed-1e060894c8da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:41.213481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-92b47baa-fb7d-4d43-a167-d07ebd018b55 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:41.227235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-92b47baa-fb7d-4d43-a167-d07ebd018b55 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.379229 Jul 27 22:49:41.228295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 34/66] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:40 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:41.460408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-278f60fb-df1c-465f-bf55-a9b07a623c79 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:41.461342 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-278f60fb-df1c-465f-bf55-a9b07a623c79 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:41.471209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-938c3e56-8c40-4556-aeed-1e060894c8da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:41.479783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-278f60fb-df1c-465f-bf55-a9b07a623c79 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:41.480281 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-278f60fb-df1c-465f-bf55-a9b07a623c79 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:41.481190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-278f60fb-df1c-465f-bf55-a9b07a623c79 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:41.482304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-278f60fb-df1c-465f-bf55-a9b07a623c79 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:41.485193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-938c3e56-8c40-4556-aeed-1e060894c8da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.307000 Jul 27 22:49:41.486111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 33/67] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:41 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:41.578404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-278f60fb-df1c-465f-bf55-a9b07a623c79 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:41.586901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-278f60fb-df1c-465f-bf55-a9b07a623c79 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:41.588675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-278f60fb-df1c-465f-bf55-a9b07a623c79 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:41.589815 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-278f60fb-df1c-465f-bf55-a9b07a623c79 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1341 microversion: 2.20 time: 0.133992 Jul 27 22:49:41.590339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1341 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:42.122334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8a385e61-ab32-497d-943c-259655432607 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:42.122944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8a385e61-ab32-497d-943c-259655432607 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:42.128898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8a385e61-ab32-497d-943c-259655432607 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:42.129340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8a385e61-ab32-497d-943c-259655432607 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:42.130094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8a385e61-ab32-497d-943c-259655432607 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:42.130520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8a385e61-ab32-497d-943c-259655432607 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:42.196956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8a385e61-ab32-497d-943c-259655432607 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:42.205600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8a385e61-ab32-497d-943c-259655432607 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1298 microversion: 2.1 time: 0.087167 Jul 27 22:49:42.206225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 34/69] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:42 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:42.250107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-df60af79-d7a7-4ac6-8b8b-83c673eebfc1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:42.250828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-df60af79-d7a7-4ac6-8b8b-83c673eebfc1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:42.258223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df60af79-d7a7-4ac6-8b8b-83c673eebfc1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:42.258671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df60af79-d7a7-4ac6-8b8b-83c673eebfc1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:42.259460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df60af79-d7a7-4ac6-8b8b-83c673eebfc1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:42.260134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df60af79-d7a7-4ac6-8b8b-83c673eebfc1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:42.411572 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-df60af79-d7a7-4ac6-8b8b-83c673eebfc1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:42.419612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-df60af79-d7a7-4ac6-8b8b-83c673eebfc1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.173753 Jul 27 22:49:42.420578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 36/70] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:42 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:42.507174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1619e2c1-a5e8-41ea-9fd6-e28a3e834fee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:42.507921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1619e2c1-a5e8-41ea-9fd6-e28a3e834fee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:42.514985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1619e2c1-a5e8-41ea-9fd6-e28a3e834fee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:42.515730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1619e2c1-a5e8-41ea-9fd6-e28a3e834fee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:42.516803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1619e2c1-a5e8-41ea-9fd6-e28a3e834fee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:42.517189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1619e2c1-a5e8-41ea-9fd6-e28a3e834fee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:42.614215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-80e4b908-1ebb-4fb8-b84f-30d507c0f850 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:42.615126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-80e4b908-1ebb-4fb8-b84f-30d507c0f850 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:42.622514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80e4b908-1ebb-4fb8-b84f-30d507c0f850 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:42.623283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80e4b908-1ebb-4fb8-b84f-30d507c0f850 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:42.624517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80e4b908-1ebb-4fb8-b84f-30d507c0f850 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:42.625122 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80e4b908-1ebb-4fb8-b84f-30d507c0f850 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:42.722683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-80e4b908-1ebb-4fb8-b84f-30d507c0f850 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:42.736902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-80e4b908-1ebb-4fb8-b84f-30d507c0f850 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:42.738465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-80e4b908-1ebb-4fb8-b84f-30d507c0f850 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:42.739588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-80e4b908-1ebb-4fb8-b84f-30d507c0f850 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1341 microversion: 2.20 time: 0.130389 Jul 27 22:49:42.740139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 37/71] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1341 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:42.751927 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1619e2c1-a5e8-41ea-9fd6-e28a3e834fee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:42.765139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1619e2c1-a5e8-41ea-9fd6-e28a3e834fee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.261875 Jul 27 22:49:42.766115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 35/72] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:42 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:43.227854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8fd3a69a-0e71-4d4c-ae2b-fbd6391e9891 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:43.228486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8fd3a69a-0e71-4d4c-ae2b-fbd6391e9891 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:43.234360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8fd3a69a-0e71-4d4c-ae2b-fbd6391e9891 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:43.234797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8fd3a69a-0e71-4d4c-ae2b-fbd6391e9891 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:43.235542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8fd3a69a-0e71-4d4c-ae2b-fbd6391e9891 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:43.235964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8fd3a69a-0e71-4d4c-ae2b-fbd6391e9891 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:43.303236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8fd3a69a-0e71-4d4c-ae2b-fbd6391e9891 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:43.311447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8fd3a69a-0e71-4d4c-ae2b-fbd6391e9891 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1298 microversion: 2.1 time: 0.087413 Jul 27 22:49:43.312023 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 38/73] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:43 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:43.441308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fc1bda8f-de9a-47ae-a9fe-1d4436ef031d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:43.441918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fc1bda8f-de9a-47ae-a9fe-1d4436ef031d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:43.447925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc1bda8f-de9a-47ae-a9fe-1d4436ef031d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:43.448370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc1bda8f-de9a-47ae-a9fe-1d4436ef031d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:43.449145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc1bda8f-de9a-47ae-a9fe-1d4436ef031d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:43.450149 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc1bda8f-de9a-47ae-a9fe-1d4436ef031d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:43.584273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fc1bda8f-de9a-47ae-a9fe-1d4436ef031d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:43.592712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fc1bda8f-de9a-47ae-a9fe-1d4436ef031d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.155268 Jul 27 22:49:43.593641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 36/74] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:43 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:43.765160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-934c69ef-0f33-459d-a1b3-c4347aca4af6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:43.765842 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-934c69ef-0f33-459d-a1b3-c4347aca4af6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:43.772375 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-934c69ef-0f33-459d-a1b3-c4347aca4af6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:43.772858 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-934c69ef-0f33-459d-a1b3-c4347aca4af6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:43.773630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-934c69ef-0f33-459d-a1b3-c4347aca4af6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:43.774065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-934c69ef-0f33-459d-a1b3-c4347aca4af6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:43.786536 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bda01179-d46f-49f6-9b7b-09c1e028d4ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:43.787177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bda01179-d46f-49f6-9b7b-09c1e028d4ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:43.797434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bda01179-d46f-49f6-9b7b-09c1e028d4ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:43.797880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bda01179-d46f-49f6-9b7b-09c1e028d4ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:43.798660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bda01179-d46f-49f6-9b7b-09c1e028d4ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:43.800597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bda01179-d46f-49f6-9b7b-09c1e028d4ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:43.852319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-934c69ef-0f33-459d-a1b3-c4347aca4af6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:43.865120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-934c69ef-0f33-459d-a1b3-c4347aca4af6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:43.866660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-934c69ef-0f33-459d-a1b3-c4347aca4af6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:43.868466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-934c69ef-0f33-459d-a1b3-c4347aca4af6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1341 microversion: 2.20 time: 0.106809 Jul 27 22:49:43.869364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 39/75] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1341 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:43.964435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bda01179-d46f-49f6-9b7b-09c1e028d4ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:43.972341 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bda01179-d46f-49f6-9b7b-09c1e028d4ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.189890 Jul 27 22:49:43.973180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 37/76] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:43 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:44.332600 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2cb94a58-d3b8-4ab7-81e3-e8051b224781 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:44.333407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2cb94a58-d3b8-4ab7-81e3-e8051b224781 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:44.339369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2cb94a58-d3b8-4ab7-81e3-e8051b224781 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:44.339809 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2cb94a58-d3b8-4ab7-81e3-e8051b224781 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:44.340580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2cb94a58-d3b8-4ab7-81e3-e8051b224781 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:44.341598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2cb94a58-d3b8-4ab7-81e3-e8051b224781 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:44.406449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2cb94a58-d3b8-4ab7-81e3-e8051b224781 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:44.413723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2cb94a58-d3b8-4ab7-81e3-e8051b224781 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1298 microversion: 2.1 time: 0.085052 Jul 27 22:49:44.414289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 40/77] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:44 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:44.616192 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-eaebf45f-cbb6-4624-b047-743560dcc3ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:44.617372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-eaebf45f-cbb6-4624-b047-743560dcc3ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:44.623891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eaebf45f-cbb6-4624-b047-743560dcc3ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:44.624336 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eaebf45f-cbb6-4624-b047-743560dcc3ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:44.625257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eaebf45f-cbb6-4624-b047-743560dcc3ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:44.625691 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eaebf45f-cbb6-4624-b047-743560dcc3ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:44.895383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b3ab6a52-1f5d-4999-8ac6-fbd11fba0c39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:44.896066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b3ab6a52-1f5d-4999-8ac6-fbd11fba0c39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:44.911081 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eaebf45f-cbb6-4624-b047-743560dcc3ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:44.911494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3ab6a52-1f5d-4999-8ac6-fbd11fba0c39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:44.912579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3ab6a52-1f5d-4999-8ac6-fbd11fba0c39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:44.914323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3ab6a52-1f5d-4999-8ac6-fbd11fba0c39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:44.921700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-eaebf45f-cbb6-4624-b047-743560dcc3ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.308598 Jul 27 22:49:44.935507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 38/78] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:44 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:44.935690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3ab6a52-1f5d-4999-8ac6-fbd11fba0c39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:44.996515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7e92cd08-724b-46cf-ab13-28a7f071183f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:44.997778 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7e92cd08-724b-46cf-ab13-28a7f071183f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:45.012196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e92cd08-724b-46cf-ab13-28a7f071183f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:45.012493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e92cd08-724b-46cf-ab13-28a7f071183f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:45.013223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e92cd08-724b-46cf-ab13-28a7f071183f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:45.013652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e92cd08-724b-46cf-ab13-28a7f071183f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:45.051303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b3ab6a52-1f5d-4999-8ac6-fbd11fba0c39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:45.065347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b3ab6a52-1f5d-4999-8ac6-fbd11fba0c39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:45.069288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b3ab6a52-1f5d-4999-8ac6-fbd11fba0c39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:45.072171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b3ab6a52-1f5d-4999-8ac6-fbd11fba0c39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1351 microversion: 2.20 time: 0.180498 Jul 27 22:49:45.074160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 41/79] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:44 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1351 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:45.246094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7e92cd08-724b-46cf-ab13-28a7f071183f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:45.253899 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7e92cd08-724b-46cf-ab13-28a7f071183f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.263730 Jul 27 22:49:45.258046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 39/80] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:44 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:45.436046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b59adca3-61b6-4eaf-911e-9312da10d066 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:45.437001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b59adca3-61b6-4eaf-911e-9312da10d066 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:45.443421 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b59adca3-61b6-4eaf-911e-9312da10d066 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:45.443778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b59adca3-61b6-4eaf-911e-9312da10d066 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:45.444543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b59adca3-61b6-4eaf-911e-9312da10d066 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:45.445060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b59adca3-61b6-4eaf-911e-9312da10d066 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:45.519143 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b59adca3-61b6-4eaf-911e-9312da10d066 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:45.527497 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b59adca3-61b6-4eaf-911e-9312da10d066 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1296 microversion: 2.1 time: 0.096874 Jul 27 22:49:45.528356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 42/81] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:45 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:45.944873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-78cde680-ff6d-4479-a38e-8235d2342ffa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:45.945566 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-78cde680-ff6d-4479-a38e-8235d2342ffa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:45.953378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78cde680-ff6d-4479-a38e-8235d2342ffa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:45.954116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78cde680-ff6d-4479-a38e-8235d2342ffa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:45.955134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78cde680-ff6d-4479-a38e-8235d2342ffa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:45.955633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78cde680-ff6d-4479-a38e-8235d2342ffa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:46.095826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-78cde680-ff6d-4479-a38e-8235d2342ffa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:46.100695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d5160a8b-49b0-4973-88b5-7808489e113e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:46.101313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d5160a8b-49b0-4973-88b5-7808489e113e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:46.104389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-78cde680-ff6d-4479-a38e-8235d2342ffa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.164529 Jul 27 22:49:46.107628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d5160a8b-49b0-4973-88b5-7808489e113e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:46.108075 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d5160a8b-49b0-4973-88b5-7808489e113e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:46.108880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d5160a8b-49b0-4973-88b5-7808489e113e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:46.109310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d5160a8b-49b0-4973-88b5-7808489e113e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:46.115772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 40/82] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:45 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:46.173096 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d5160a8b-49b0-4973-88b5-7808489e113e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:46.181604 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d5160a8b-49b0-4973-88b5-7808489e113e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:46.183116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d5160a8b-49b0-4973-88b5-7808489e113e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:46.185557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d5160a8b-49b0-4973-88b5-7808489e113e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1339 microversion: 2.20 time: 0.088214 Jul 27 22:49:46.186419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 43/83] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:49:46.275348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-13df97bb-f54e-4349-b38b-c4492196ca8d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:46.275886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-13df97bb-f54e-4349-b38b-c4492196ca8d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:46.282658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-13df97bb-f54e-4349-b38b-c4492196ca8d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:46.283103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-13df97bb-f54e-4349-b38b-c4492196ca8d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:46.283856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-13df97bb-f54e-4349-b38b-c4492196ca8d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:46.284287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-13df97bb-f54e-4349-b38b-c4492196ca8d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:46.428941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-13df97bb-f54e-4349-b38b-c4492196ca8d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:46.437752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-13df97bb-f54e-4349-b38b-c4492196ca8d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.166239 Jul 27 22:49:46.455274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 41/84] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:46 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:46.548010 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-58d18540-af4b-4c5b-b50d-bd869e7c92d0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:46.548668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-58d18540-af4b-4c5b-b50d-bd869e7c92d0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:46.556142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58d18540-af4b-4c5b-b50d-bd869e7c92d0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:46.558191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58d18540-af4b-4c5b-b50d-bd869e7c92d0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:46.560175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58d18540-af4b-4c5b-b50d-bd869e7c92d0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:46.561085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58d18540-af4b-4c5b-b50d-bd869e7c92d0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:46.634633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-58d18540-af4b-4c5b-b50d-bd869e7c92d0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:46.643214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-58d18540-af4b-4c5b-b50d-bd869e7c92d0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1296 microversion: 2.1 time: 0.099042 Jul 27 22:49:46.644014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 44/85] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:46 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:47.127038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-29d85a8d-c3ad-465f-8a69-4609475cad1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:47.127999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-29d85a8d-c3ad-465f-8a69-4609475cad1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:47.135750 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29d85a8d-c3ad-465f-8a69-4609475cad1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:47.136293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29d85a8d-c3ad-465f-8a69-4609475cad1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:47.137208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29d85a8d-c3ad-465f-8a69-4609475cad1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:47.138541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29d85a8d-c3ad-465f-8a69-4609475cad1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:47.212951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-41344843-ee09-4ecd-a550-5ee268f1948e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:47.213575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-41344843-ee09-4ecd-a550-5ee268f1948e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:47.226365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41344843-ee09-4ecd-a550-5ee268f1948e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:47.226816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41344843-ee09-4ecd-a550-5ee268f1948e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:47.227600 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41344843-ee09-4ecd-a550-5ee268f1948e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:47.230601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41344843-ee09-4ecd-a550-5ee268f1948e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:47.261010 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:47.313325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-41344843-ee09-4ecd-a550-5ee268f1948e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:47.321733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-41344843-ee09-4ecd-a550-5ee268f1948e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:47.323312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-41344843-ee09-4ecd-a550-5ee268f1948e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:47.324463 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-41344843-ee09-4ecd-a550-5ee268f1948e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1339 microversion: 2.20 time: 0.117204 Jul 27 22:49:47.326099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 45/86] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1339 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:47.340519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-29d85a8d-c3ad-465f-8a69-4609475cad1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:47.352795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-29d85a8d-c3ad-465f-8a69-4609475cad1b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.232263 Jul 27 22:49:47.353374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 42/87] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:47 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:47.390475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-6a08c127-40ed-4c0d-a902-d0d587a4aabe req-223eca13-b7eb-43b4-968a-dad42ca1428a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "399d83c4-59b5-40ab-8d79-90974eba0ba8", "tag": "2a3662c6-57e8-463f-ac7e-d0aa5bfe5bc9"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:49:47.402633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-6a08c127-40ed-4c0d-a902-d0d587a4aabe req-223eca13-b7eb-43b4-968a-dad42ca1428a service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:47.403098 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-6a08c127-40ed-4c0d-a902-d0d587a4aabe req-223eca13-b7eb-43b4-968a-dad42ca1428a service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:47.423249 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-6a08c127-40ed-4c0d-a902-d0d587a4aabe req-223eca13-b7eb-43b4-968a-dad42ca1428a service nova] Creating event network-changed:2a3662c6-57e8-463f-ac7e-d0aa5bfe5bc9 for instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 on hv-cinder-85124 Jul 27 22:49:47.423778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-6a08c127-40ed-4c0d-a902-d0d587a4aabe req-223eca13-b7eb-43b4-968a-dad42ca1428a service nova] Acquired lock "compute-rpcapi-router" {{(pid=129294) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 22:49:47.424911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-278a9bda-a3b0-4dd8-91e9-d3e2845e8d59 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:47.425348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-278a9bda-a3b0-4dd8-91e9-d3e2845e8d59 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:47.426282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-278a9bda-a3b0-4dd8-91e9-d3e2845e8d59 None None] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:47.426710 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-278a9bda-a3b0-4dd8-91e9-d3e2845e8d59 None None] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:47.436500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.compute.rpcapi [None req-278a9bda-a3b0-4dd8-91e9-d3e2845e8d59 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 22:49:47.437412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-278a9bda-a3b0-4dd8-91e9-d3e2845e8d59 None None] Releasing lock "compute-rpcapi-router" {{(pid=129294) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 22:49:47.453716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-278a9bda-a3b0-4dd8-91e9-d3e2845e8d59 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126205 Jul 27 22:49:47.454455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 46/88] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:49:47.458651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5c47d138-e030-4aaf-b98e-e844a03fbb88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:47.459294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5c47d138-e030-4aaf-b98e-e844a03fbb88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:47.465480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c47d138-e030-4aaf-b98e-e844a03fbb88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:47.466027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c47d138-e030-4aaf-b98e-e844a03fbb88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:47.466795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c47d138-e030-4aaf-b98e-e844a03fbb88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:47.467231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c47d138-e030-4aaf-b98e-e844a03fbb88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:47.608343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5c47d138-e030-4aaf-b98e-e844a03fbb88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:47.615844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5c47d138-e030-4aaf-b98e-e844a03fbb88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.161213 Jul 27 22:49:47.616407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 43/89] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:47 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:47.665453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b679b60b-c63f-436d-a5d2-48be0ab7c84f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:47.666138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b679b60b-c63f-436d-a5d2-48be0ab7c84f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:47.672849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b679b60b-c63f-436d-a5d2-48be0ab7c84f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:47.673284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b679b60b-c63f-436d-a5d2-48be0ab7c84f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:47.674030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b679b60b-c63f-436d-a5d2-48be0ab7c84f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:47.674466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b679b60b-c63f-436d-a5d2-48be0ab7c84f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:47.734808 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b679b60b-c63f-436d-a5d2-48be0ab7c84f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:47.742035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b679b60b-c63f-436d-a5d2-48be0ab7c84f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1296 microversion: 2.1 time: 0.080849 Jul 27 22:49:47.742608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 47/90] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:47 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1296 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:48.349825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2701d96d-1229-4cb6-807a-f8eb20aa72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:48.350436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2701d96d-1229-4cb6-807a-f8eb20aa72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:48.356465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2701d96d-1229-4cb6-807a-f8eb20aa72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:48.356944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2701d96d-1229-4cb6-807a-f8eb20aa72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:48.357704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2701d96d-1229-4cb6-807a-f8eb20aa72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:48.358141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2701d96d-1229-4cb6-807a-f8eb20aa72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:48.362932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:48.373878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0ccaba19-960c-423e-8efd-2dc83ad52bdb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:48.374729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0ccaba19-960c-423e-8efd-2dc83ad52bdb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:48.381107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ccaba19-960c-423e-8efd-2dc83ad52bdb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:48.381601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ccaba19-960c-423e-8efd-2dc83ad52bdb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:48.382307 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ccaba19-960c-423e-8efd-2dc83ad52bdb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:48.382728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ccaba19-960c-423e-8efd-2dc83ad52bdb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:48.421947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2701d96d-1229-4cb6-807a-f8eb20aa72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:48.430568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2701d96d-1229-4cb6-807a-f8eb20aa72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:48.432076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2701d96d-1229-4cb6-807a-f8eb20aa72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:48.433260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2701d96d-1229-4cb6-807a-f8eb20aa72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1339 microversion: 2.20 time: 0.087584 Jul 27 22:49:48.433811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 44/91] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:48 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:48.525857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0ccaba19-960c-423e-8efd-2dc83ad52bdb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:48.533233 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0ccaba19-960c-423e-8efd-2dc83ad52bdb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.163667 Jul 27 22:49:48.533812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 48/92] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:48 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:48.637387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-03c4e9d4-0e7e-48e0-98d7-01c1c9710921 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:48.638678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-03c4e9d4-0e7e-48e0-98d7-01c1c9710921 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:48.644922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-03c4e9d4-0e7e-48e0-98d7-01c1c9710921 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:48.645366 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-03c4e9d4-0e7e-48e0-98d7-01c1c9710921 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:48.646223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-03c4e9d4-0e7e-48e0-98d7-01c1c9710921 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:48.646649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-03c4e9d4-0e7e-48e0-98d7-01c1c9710921 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:48.764171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f6b03e00-a284-4200-a2d0-463949699c20 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:48.764805 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f6b03e00-a284-4200-a2d0-463949699c20 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:48.771232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6b03e00-a284-4200-a2d0-463949699c20 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:48.771866 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6b03e00-a284-4200-a2d0-463949699c20 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:48.772818 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6b03e00-a284-4200-a2d0-463949699c20 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:48.773471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6b03e00-a284-4200-a2d0-463949699c20 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:48.778465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-03c4e9d4-0e7e-48e0-98d7-01c1c9710921 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:48.786104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-03c4e9d4-0e7e-48e0-98d7-01c1c9710921 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.152667 Jul 27 22:49:48.787018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 45/93] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:48 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:48.837139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f6b03e00-a284-4200-a2d0-463949699c20 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:48.844521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f6b03e00-a284-4200-a2d0-463949699c20 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1296 microversion: 2.1 time: 0.085437 Jul 27 22:49:48.845107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 49/94] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:48 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:49.456574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cc1edfb5-4ab6-4860-9bbe-cbfcaf7c2c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:49.457231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cc1edfb5-4ab6-4860-9bbe-cbfcaf7c2c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:49.463244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cc1edfb5-4ab6-4860-9bbe-cbfcaf7c2c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:49.463691 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cc1edfb5-4ab6-4860-9bbe-cbfcaf7c2c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:49.464461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cc1edfb5-4ab6-4860-9bbe-cbfcaf7c2c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:49.465022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cc1edfb5-4ab6-4860-9bbe-cbfcaf7c2c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:49.478761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-72f0bf64-89c8-4a76-bb54-990fd6f7d6dc req-516afe75-0ec0-4d5f-8076-51ddaf86f182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6", "tag": "375463fd-0894-4aa2-b316-8b4f2c64de4d"}, {"name": "network-changed", "server_uuid": "d3c90c3b-021d-449c-8d25-b38e625ffc54", "tag": "00778e2c-f71b-4986-8a16-14796fb6efad"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:49:49.491219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-72f0bf64-89c8-4a76-bb54-990fd6f7d6dc req-516afe75-0ec0-4d5f-8076-51ddaf86f182 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:49.491777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-72f0bf64-89c8-4a76-bb54-990fd6f7d6dc req-516afe75-0ec0-4d5f-8076-51ddaf86f182 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:49.505977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-72f0bf64-89c8-4a76-bb54-990fd6f7d6dc req-516afe75-0ec0-4d5f-8076-51ddaf86f182 service nova] Creating event network-changed:375463fd-0894-4aa2-b316-8b4f2c64de4d for instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 on hv-cinder-85124 Jul 27 22:49:49.506772 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-72f0bf64-89c8-4a76-bb54-990fd6f7d6dc req-516afe75-0ec0-4d5f-8076-51ddaf86f182 service nova] Creating event network-changed:00778e2c-f71b-4986-8a16-14796fb6efad for instance d3c90c3b-021d-449c-8d25-b38e625ffc54 on hv-cinder-85124 Jul 27 22:49:49.513940 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-72f0bf64-89c8-4a76-bb54-990fd6f7d6dc req-516afe75-0ec0-4d5f-8076-51ddaf86f182 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038858 Jul 27 22:49:49.514767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 50/95] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:49:49.561241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d87cb2d1-9e71-43da-92a3-b6ebcae734eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:49.568083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d87cb2d1-9e71-43da-92a3-b6ebcae734eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:49.576020 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d87cb2d1-9e71-43da-92a3-b6ebcae734eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:49.576956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d87cb2d1-9e71-43da-92a3-b6ebcae734eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:49.578543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d87cb2d1-9e71-43da-92a3-b6ebcae734eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:49.579958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d87cb2d1-9e71-43da-92a3-b6ebcae734eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:49.676305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cc1edfb5-4ab6-4860-9bbe-cbfcaf7c2c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:49.684725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cc1edfb5-4ab6-4860-9bbe-cbfcaf7c2c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:49.686220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cc1edfb5-4ab6-4860-9bbe-cbfcaf7c2c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:49.687329 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cc1edfb5-4ab6-4860-9bbe-cbfcaf7c2c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.234780 Jul 27 22:49:49.687879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 46/96] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:49 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:49:49.744265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d87cb2d1-9e71-43da-92a3-b6ebcae734eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:49.752166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d87cb2d1-9e71-43da-92a3-b6ebcae734eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.201382 Jul 27 22:49:49.752806 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 51/97] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:49 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:49.807318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-35a19d4e-638d-4267-82f3-7d8f26ba9ab3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:49.808139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-35a19d4e-638d-4267-82f3-7d8f26ba9ab3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:49.814480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35a19d4e-638d-4267-82f3-7d8f26ba9ab3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:49.814915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35a19d4e-638d-4267-82f3-7d8f26ba9ab3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:49.815684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35a19d4e-638d-4267-82f3-7d8f26ba9ab3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:49.816107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35a19d4e-638d-4267-82f3-7d8f26ba9ab3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:49.865419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-051aa217-9fd3-42c7-b0a3-7f7ab6d5a9cd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:49.866031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-051aa217-9fd3-42c7-b0a3-7f7ab6d5a9cd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:49.873449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-051aa217-9fd3-42c7-b0a3-7f7ab6d5a9cd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:49.873896 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-051aa217-9fd3-42c7-b0a3-7f7ab6d5a9cd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:49.874854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-051aa217-9fd3-42c7-b0a3-7f7ab6d5a9cd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:49.875755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-051aa217-9fd3-42c7-b0a3-7f7ab6d5a9cd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:50.020652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-35a19d4e-638d-4267-82f3-7d8f26ba9ab3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:50.028144 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-35a19d4e-638d-4267-82f3-7d8f26ba9ab3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.224709 Jul 27 22:49:50.030843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 47/98] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:49 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:50.066143 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-051aa217-9fd3-42c7-b0a3-7f7ab6d5a9cd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:50.073623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-051aa217-9fd3-42c7-b0a3-7f7ab6d5a9cd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.212158 Jul 27 22:49:50.074174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 52/99] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:49 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:50.710090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-34992ee0-07da-4042-bb1b-01962650321e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:50.710639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-34992ee0-07da-4042-bb1b-01962650321e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:50.717407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34992ee0-07da-4042-bb1b-01962650321e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:50.717854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34992ee0-07da-4042-bb1b-01962650321e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:50.718613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34992ee0-07da-4042-bb1b-01962650321e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:50.719046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34992ee0-07da-4042-bb1b-01962650321e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:50.773286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d347a05b-9b1f-475c-8543-9d4345b6464d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:50.773899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d347a05b-9b1f-475c-8543-9d4345b6464d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:50.780302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d347a05b-9b1f-475c-8543-9d4345b6464d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:50.780780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d347a05b-9b1f-475c-8543-9d4345b6464d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:50.781548 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d347a05b-9b1f-475c-8543-9d4345b6464d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:50.781980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d347a05b-9b1f-475c-8543-9d4345b6464d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:50.885973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-34992ee0-07da-4042-bb1b-01962650321e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:50.893877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-34992ee0-07da-4042-bb1b-01962650321e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:50.895379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-34992ee0-07da-4042-bb1b-01962650321e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:50.896476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-34992ee0-07da-4042-bb1b-01962650321e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.190343 Jul 27 22:49:50.897053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 48/100] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:50 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:50.934024 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d347a05b-9b1f-475c-8543-9d4345b6464d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:50.942877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d347a05b-9b1f-475c-8543-9d4345b6464d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.173181 Jul 27 22:49:50.943753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 53/101] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:50 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:51.053903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6e32ef09-d46f-4b8d-8f74-4910025d8a74 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:51.054589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6e32ef09-d46f-4b8d-8f74-4910025d8a74 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:51.067213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e32ef09-d46f-4b8d-8f74-4910025d8a74 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:51.067659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e32ef09-d46f-4b8d-8f74-4910025d8a74 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:51.068586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e32ef09-d46f-4b8d-8f74-4910025d8a74 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:51.069054 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e32ef09-d46f-4b8d-8f74-4910025d8a74 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:51.097208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c02c6130-14eb-48d0-8093-a1e7d448d264 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:51.097916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c02c6130-14eb-48d0-8093-a1e7d448d264 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:51.107357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c02c6130-14eb-48d0-8093-a1e7d448d264 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:51.107916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c02c6130-14eb-48d0-8093-a1e7d448d264 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:51.108892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c02c6130-14eb-48d0-8093-a1e7d448d264 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:51.109429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c02c6130-14eb-48d0-8093-a1e7d448d264 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:51.271459 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6e32ef09-d46f-4b8d-8f74-4910025d8a74 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:51.281380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6e32ef09-d46f-4b8d-8f74-4910025d8a74 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.232757 Jul 27 22:49:51.281961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 49/102] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:51 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:51.310590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c02c6130-14eb-48d0-8093-a1e7d448d264 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:51.318405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c02c6130-14eb-48d0-8093-a1e7d448d264 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.227742 Jul 27 22:49:51.327898 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 54/103] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:51 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:51.920427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cebfcbdd-0560-470d-aed7-9cc5c53ed504 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:51.921037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cebfcbdd-0560-470d-aed7-9cc5c53ed504 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:51.926893 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cebfcbdd-0560-470d-aed7-9cc5c53ed504 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:51.927323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cebfcbdd-0560-470d-aed7-9cc5c53ed504 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:51.928073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cebfcbdd-0560-470d-aed7-9cc5c53ed504 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:51.928493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cebfcbdd-0560-470d-aed7-9cc5c53ed504 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:51.971500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c30615fa-5855-4e61-a739-6982efb79f64 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:51.972342 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c30615fa-5855-4e61-a739-6982efb79f64 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:51.986489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c30615fa-5855-4e61-a739-6982efb79f64 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:51.987173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c30615fa-5855-4e61-a739-6982efb79f64 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:51.988148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c30615fa-5855-4e61-a739-6982efb79f64 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:51.988847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c30615fa-5855-4e61-a739-6982efb79f64 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:52.171686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cebfcbdd-0560-470d-aed7-9cc5c53ed504 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:52.199939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cebfcbdd-0560-470d-aed7-9cc5c53ed504 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:52.206470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cebfcbdd-0560-470d-aed7-9cc5c53ed504 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:52.207779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cebfcbdd-0560-470d-aed7-9cc5c53ed504 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.291675 Jul 27 22:49:52.229384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 50/104] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:51 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:52.308134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-db1b3440-45e1-401f-9716-dbfae34fe068 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:52.311364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-db1b3440-45e1-401f-9716-dbfae34fe068 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:52.332022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db1b3440-45e1-401f-9716-dbfae34fe068 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:52.365348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c30615fa-5855-4e61-a739-6982efb79f64 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:52.366645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db1b3440-45e1-401f-9716-dbfae34fe068 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:52.369963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db1b3440-45e1-401f-9716-dbfae34fe068 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:52.370755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db1b3440-45e1-401f-9716-dbfae34fe068 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:52.375900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c30615fa-5855-4e61-a739-6982efb79f64 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.407909 Jul 27 22:49:52.380983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 55/105] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:51 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:52.390872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ca0b6f02-b846-4499-a155-f5a8f7c9f41f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:52.391547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ca0b6f02-b846-4499-a155-f5a8f7c9f41f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:52.405785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca0b6f02-b846-4499-a155-f5a8f7c9f41f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:52.406243 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca0b6f02-b846-4499-a155-f5a8f7c9f41f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:52.407758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca0b6f02-b846-4499-a155-f5a8f7c9f41f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:52.408255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca0b6f02-b846-4499-a155-f5a8f7c9f41f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:52.682533 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-db1b3440-45e1-401f-9716-dbfae34fe068 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:52.690745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-db1b3440-45e1-401f-9716-dbfae34fe068 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.390530 Jul 27 22:49:52.692086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 51/106] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:52 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:52.701032 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-9876ae61-dc79-4762-8cef-6617e5c57945 req-fe68b989-cb64-4379-9e39-385f6a050141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e457f5fc-ae83-4b88-87be-ba1007c5865e", "tag": "977e384c-b17c-446d-945e-7c6a9e7c3e88"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:49:52.724141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ca0b6f02-b846-4499-a155-f5a8f7c9f41f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:52.730824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-9876ae61-dc79-4762-8cef-6617e5c57945 req-fe68b989-cb64-4379-9e39-385f6a050141 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:52.732307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-9876ae61-dc79-4762-8cef-6617e5c57945 req-fe68b989-cb64-4379-9e39-385f6a050141 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:52.738752 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ca0b6f02-b846-4499-a155-f5a8f7c9f41f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.353481 Jul 27 22:49:52.739606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 56/107] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:52 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:52.767452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-9876ae61-dc79-4762-8cef-6617e5c57945 req-fe68b989-cb64-4379-9e39-385f6a050141 service nova] Creating event network-changed:977e384c-b17c-446d-945e-7c6a9e7c3e88 for instance e457f5fc-ae83-4b88-87be-ba1007c5865e on hv-cinder-85124 Jul 27 22:49:52.768263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-9876ae61-dc79-4762-8cef-6617e5c57945 req-fe68b989-cb64-4379-9e39-385f6a050141 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129295) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 22:49:52.769838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ead3b38e-aa9e-414e-b24a-b0cccd32aa9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:52.770466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ead3b38e-aa9e-414e-b24a-b0cccd32aa9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:52.771463 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ead3b38e-aa9e-414e-b24a-b0cccd32aa9a None None] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:52.772074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ead3b38e-aa9e-414e-b24a-b0cccd32aa9a None None] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:52.789103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.compute.rpcapi [None req-ead3b38e-aa9e-414e-b24a-b0cccd32aa9a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 22:49:52.791410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ead3b38e-aa9e-414e-b24a-b0cccd32aa9a None None] Releasing lock "compute-rpcapi-router" {{(pid=129295) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 22:49:52.818758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ead3b38e-aa9e-414e-b24a-b0cccd32aa9a None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121731 Jul 27 22:49:52.819917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 52/108] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:49:53.237601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-78b65d23-69d9-4d40-9046-a27ec97f55b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:53.238147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-78b65d23-69d9-4d40-9046-a27ec97f55b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:53.244136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78b65d23-69d9-4d40-9046-a27ec97f55b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:53.244598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78b65d23-69d9-4d40-9046-a27ec97f55b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:53.245354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78b65d23-69d9-4d40-9046-a27ec97f55b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:53.245782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78b65d23-69d9-4d40-9046-a27ec97f55b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:53.371609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-78b65d23-69d9-4d40-9046-a27ec97f55b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:53.379443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-78b65d23-69d9-4d40-9046-a27ec97f55b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:53.380988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-78b65d23-69d9-4d40-9046-a27ec97f55b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:53.382084 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-78b65d23-69d9-4d40-9046-a27ec97f55b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.148341 Jul 27 22:49:53.382639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 57/109] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:53 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:53.397784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d08379df-aef6-407a-96e4-1fdd46b214c5 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:53.398479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d08379df-aef6-407a-96e4-1fdd46b214c5 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:53.405926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d08379df-aef6-407a-96e4-1fdd46b214c5 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:53.406370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d08379df-aef6-407a-96e4-1fdd46b214c5 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:53.407132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d08379df-aef6-407a-96e4-1fdd46b214c5 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:53.407563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d08379df-aef6-407a-96e4-1fdd46b214c5 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:53.537037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d08379df-aef6-407a-96e4-1fdd46b214c5 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:53.544492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d08379df-aef6-407a-96e4-1fdd46b214c5 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.150904 Jul 27 22:49:53.545070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 53/110] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:53 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:53.712899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-75525f98-3747-4ae5-aa94-ab0375f68e16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:53.713505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-75525f98-3747-4ae5-aa94-ab0375f68e16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:53.719477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75525f98-3747-4ae5-aa94-ab0375f68e16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:53.719914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75525f98-3747-4ae5-aa94-ab0375f68e16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:53.720682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75525f98-3747-4ae5-aa94-ab0375f68e16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:53.721109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75525f98-3747-4ae5-aa94-ab0375f68e16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:53.765882 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-be1c7640-9d57-41f6-940d-cd3b3f1fccc3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:53.766465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-be1c7640-9d57-41f6-940d-cd3b3f1fccc3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:53.772330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be1c7640-9d57-41f6-940d-cd3b3f1fccc3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:53.772808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be1c7640-9d57-41f6-940d-cd3b3f1fccc3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:53.773564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be1c7640-9d57-41f6-940d-cd3b3f1fccc3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:53.773999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be1c7640-9d57-41f6-940d-cd3b3f1fccc3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:53.902226 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-75525f98-3747-4ae5-aa94-ab0375f68e16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:53.911306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-75525f98-3747-4ae5-aa94-ab0375f68e16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.202112 Jul 27 22:49:53.912484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 58/111] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:53 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:53.942294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-be1c7640-9d57-41f6-940d-cd3b3f1fccc3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:53.950614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-be1c7640-9d57-41f6-940d-cd3b3f1fccc3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.188571 Jul 27 22:49:53.951182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 54/112] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:53 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:54.404634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-95b41522-3e29-45c9-ad60-a1af9ec1fe49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:54.405403 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-95b41522-3e29-45c9-ad60-a1af9ec1fe49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:54.411727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-95b41522-3e29-45c9-ad60-a1af9ec1fe49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:54.412173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-95b41522-3e29-45c9-ad60-a1af9ec1fe49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:54.412961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-95b41522-3e29-45c9-ad60-a1af9ec1fe49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:54.413389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-95b41522-3e29-45c9-ad60-a1af9ec1fe49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:54.565962 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f9a53fe9-b80e-4e3f-9874-9f98bdeb56ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:54.566578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f9a53fe9-b80e-4e3f-9874-9f98bdeb56ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:54.573491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f9a53fe9-b80e-4e3f-9874-9f98bdeb56ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:54.574159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f9a53fe9-b80e-4e3f-9874-9f98bdeb56ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:54.575681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f9a53fe9-b80e-4e3f-9874-9f98bdeb56ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:54.576324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f9a53fe9-b80e-4e3f-9874-9f98bdeb56ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:54.585089 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-95b41522-3e29-45c9-ad60-a1af9ec1fe49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:54.593544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-95b41522-3e29-45c9-ad60-a1af9ec1fe49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:54.595049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-95b41522-3e29-45c9-ad60-a1af9ec1fe49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:54.599043 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-95b41522-3e29-45c9-ad60-a1af9ec1fe49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.198431 Jul 27 22:49:54.599582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 59/113] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:54 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:54.730435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f9a53fe9-b80e-4e3f-9874-9f98bdeb56ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:54.739191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f9a53fe9-b80e-4e3f-9874-9f98bdeb56ae tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.176967 Jul 27 22:49:54.739983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 55/114] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:54 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:54.834105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-496a85c3-4fc8-490f-8dfb-3b061a3fd34f req-13f73faa-7fce-42c7-9aa3-819875370d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61a77c9-764c-4eca-a654-dabb4c208454", "tag": "7bf42a6f-daff-4fc8-9bfb-ebb04957bcc1"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:49:54.845730 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-496a85c3-4fc8-490f-8dfb-3b061a3fd34f req-13f73faa-7fce-42c7-9aa3-819875370d29 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:54.846447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-496a85c3-4fc8-490f-8dfb-3b061a3fd34f req-13f73faa-7fce-42c7-9aa3-819875370d29 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:54.860423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-496a85c3-4fc8-490f-8dfb-3b061a3fd34f req-13f73faa-7fce-42c7-9aa3-819875370d29 service nova] Creating event network-changed:7bf42a6f-daff-4fc8-9bfb-ebb04957bcc1 for instance f61a77c9-764c-4eca-a654-dabb4c208454 on hv-cinder-85124 Jul 27 22:49:54.865461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-496a85c3-4fc8-490f-8dfb-3b061a3fd34f req-13f73faa-7fce-42c7-9aa3-819875370d29 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035167 Jul 27 22:49:54.866141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 60/115] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:49:54.938960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a514ef7a-2ab6-409b-bd5a-b8263e8bad5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:54.940700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a514ef7a-2ab6-409b-bd5a-b8263e8bad5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:54.948910 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a514ef7a-2ab6-409b-bd5a-b8263e8bad5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:54.949725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a514ef7a-2ab6-409b-bd5a-b8263e8bad5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:54.950775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a514ef7a-2ab6-409b-bd5a-b8263e8bad5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:54.951430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a514ef7a-2ab6-409b-bd5a-b8263e8bad5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:54.971952 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dc7bec8c-2852-4db7-86f5-b36e0a80b239 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:54.972701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dc7bec8c-2852-4db7-86f5-b36e0a80b239 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:54.981020 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc7bec8c-2852-4db7-86f5-b36e0a80b239 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:54.982267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc7bec8c-2852-4db7-86f5-b36e0a80b239 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:54.983284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc7bec8c-2852-4db7-86f5-b36e0a80b239 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:54.983924 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc7bec8c-2852-4db7-86f5-b36e0a80b239 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:55.163739 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a514ef7a-2ab6-409b-bd5a-b8263e8bad5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:55.175317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a514ef7a-2ab6-409b-bd5a-b8263e8bad5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.242633 Jul 27 22:49:55.177734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 56/116] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:54 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:55.193986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-dc7bec8c-2852-4db7-86f5-b36e0a80b239 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:55.203034 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dc7bec8c-2852-4db7-86f5-b36e0a80b239 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.235292 Jul 27 22:49:55.213105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 61/117] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:54 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:55.624130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-de0d3569-eacf-4de0-8688-216e586c530b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:55.624966 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-de0d3569-eacf-4de0-8688-216e586c530b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:55.631359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de0d3569-eacf-4de0-8688-216e586c530b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:55.631809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de0d3569-eacf-4de0-8688-216e586c530b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:55.632846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de0d3569-eacf-4de0-8688-216e586c530b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:55.633490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de0d3569-eacf-4de0-8688-216e586c530b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:55.763295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-aaba0de9-a469-4b4e-b424-05e689f03099 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:55.763908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-aaba0de9-a469-4b4e-b424-05e689f03099 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:55.775987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aaba0de9-a469-4b4e-b424-05e689f03099 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:55.777605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aaba0de9-a469-4b4e-b424-05e689f03099 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:55.778793 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aaba0de9-a469-4b4e-b424-05e689f03099 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:55.779411 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aaba0de9-a469-4b4e-b424-05e689f03099 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:55.871094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-de0d3569-eacf-4de0-8688-216e586c530b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:55.884459 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-de0d3569-eacf-4de0-8688-216e586c530b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:55.886979 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-de0d3569-eacf-4de0-8688-216e586c530b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:55.888798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-de0d3569-eacf-4de0-8688-216e586c530b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.270956 Jul 27 22:49:55.905008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 57/118] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:55 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:55.954483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-aaba0de9-a469-4b4e-b424-05e689f03099 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:55.964155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-aaba0de9-a469-4b4e-b424-05e689f03099 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.207795 Jul 27 22:49:55.972726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 62/119] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:55 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:56.197802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3026a31c-8533-47ec-be03-8b128ef71f06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:56.198720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3026a31c-8533-47ec-be03-8b128ef71f06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:56.206542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3026a31c-8533-47ec-be03-8b128ef71f06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:56.207255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3026a31c-8533-47ec-be03-8b128ef71f06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:56.208300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3026a31c-8533-47ec-be03-8b128ef71f06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:56.209016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3026a31c-8533-47ec-be03-8b128ef71f06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:56.223851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-407eef39-26d2-46e6-9abf-eb73d01a6abb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:56.224581 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-407eef39-26d2-46e6-9abf-eb73d01a6abb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:56.236392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-407eef39-26d2-46e6-9abf-eb73d01a6abb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:56.237443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-407eef39-26d2-46e6-9abf-eb73d01a6abb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:56.239406 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-407eef39-26d2-46e6-9abf-eb73d01a6abb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:56.244237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-407eef39-26d2-46e6-9abf-eb73d01a6abb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:56.419435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3026a31c-8533-47ec-be03-8b128ef71f06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:56.432830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3026a31c-8533-47ec-be03-8b128ef71f06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.236243 Jul 27 22:49:56.447399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 58/120] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:56 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:56.478923 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-407eef39-26d2-46e6-9abf-eb73d01a6abb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:56.506105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:56.520799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-407eef39-26d2-46e6-9abf-eb73d01a6abb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.301314 Jul 27 22:49:56.521732 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 63/121] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:56 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:56.915766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7f7959d4-67d8-4600-945b-63f74ec15b92 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:56.915766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7f7959d4-67d8-4600-945b-63f74ec15b92 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:56.920121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7f7959d4-67d8-4600-945b-63f74ec15b92 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:56.920587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7f7959d4-67d8-4600-945b-63f74ec15b92 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:56.921365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7f7959d4-67d8-4600-945b-63f74ec15b92 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:56.921797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7f7959d4-67d8-4600-945b-63f74ec15b92 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:56.990608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cfa837a7-ee2f-49ac-8581-dd485eb56005 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:56.991213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cfa837a7-ee2f-49ac-8581-dd485eb56005 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:57.003832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cfa837a7-ee2f-49ac-8581-dd485eb56005 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:57.004727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cfa837a7-ee2f-49ac-8581-dd485eb56005 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:57.005792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cfa837a7-ee2f-49ac-8581-dd485eb56005 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:57.006544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cfa837a7-ee2f-49ac-8581-dd485eb56005 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:57.106561 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7f7959d4-67d8-4600-945b-63f74ec15b92 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:57.117972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7f7959d4-67d8-4600-945b-63f74ec15b92 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:57.119472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7f7959d4-67d8-4600-945b-63f74ec15b92 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:57.127466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7f7959d4-67d8-4600-945b-63f74ec15b92 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.211262 Jul 27 22:49:57.128287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 59/122] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:57.262470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cfa837a7-ee2f-49ac-8581-dd485eb56005 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:57.276822 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cfa837a7-ee2f-49ac-8581-dd485eb56005 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.291435 Jul 27 22:49:57.277726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 64/123] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:56 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:57.454919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-08a9c49f-fcac-4c01-83a6-e18d70e35cb2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:57.456533 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-08a9c49f-fcac-4c01-83a6-e18d70e35cb2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:57.470395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08a9c49f-fcac-4c01-83a6-e18d70e35cb2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:57.487043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08a9c49f-fcac-4c01-83a6-e18d70e35cb2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:57.488130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08a9c49f-fcac-4c01-83a6-e18d70e35cb2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:57.488399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08a9c49f-fcac-4c01-83a6-e18d70e35cb2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:57.545817 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0cee316f-12d2-4ba2-8c34-86b1dcb9cbc6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:57.546529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0cee316f-12d2-4ba2-8c34-86b1dcb9cbc6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:57.553027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=2 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:57.555372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0cee316f-12d2-4ba2-8c34-86b1dcb9cbc6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:57.556250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0cee316f-12d2-4ba2-8c34-86b1dcb9cbc6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:57.557416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0cee316f-12d2-4ba2-8c34-86b1dcb9cbc6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:57.558117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0cee316f-12d2-4ba2-8c34-86b1dcb9cbc6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:57.741877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-08a9c49f-fcac-4c01-83a6-e18d70e35cb2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:57.750730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-08a9c49f-fcac-4c01-83a6-e18d70e35cb2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.300790 Jul 27 22:49:57.751878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 60/124] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:57 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:57.772386 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0cee316f-12d2-4ba2-8c34-86b1dcb9cbc6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:57.780468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0cee316f-12d2-4ba2-8c34-86b1dcb9cbc6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.238914 Jul 27 22:49:57.783268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 65/125] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:57 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:49:58.154988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4fdf62c4-1cc0-443c-a78b-43a944452c9a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:58.155651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4fdf62c4-1cc0-443c-a78b-43a944452c9a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:58.161690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4fdf62c4-1cc0-443c-a78b-43a944452c9a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:58.162125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4fdf62c4-1cc0-443c-a78b-43a944452c9a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:58.162879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4fdf62c4-1cc0-443c-a78b-43a944452c9a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:58.163304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4fdf62c4-1cc0-443c-a78b-43a944452c9a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:58.167859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:58.301364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b510912e-3542-4e08-b55a-0ace3c04d994 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:58.303328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b510912e-3542-4e08-b55a-0ace3c04d994 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:58.313518 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b510912e-3542-4e08-b55a-0ace3c04d994 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:58.314231 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b510912e-3542-4e08-b55a-0ace3c04d994 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:58.315155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b510912e-3542-4e08-b55a-0ace3c04d994 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:58.315575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b510912e-3542-4e08-b55a-0ace3c04d994 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:58.318017 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4fdf62c4-1cc0-443c-a78b-43a944452c9a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:58.330221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4fdf62c4-1cc0-443c-a78b-43a944452c9a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:58.331929 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4fdf62c4-1cc0-443c-a78b-43a944452c9a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:58.333171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4fdf62c4-1cc0-443c-a78b-43a944452c9a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.187555 Jul 27 22:49:58.334433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 61/126] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:58.463442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b510912e-3542-4e08-b55a-0ace3c04d994 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:58.471979 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b510912e-3542-4e08-b55a-0ace3c04d994 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.176476 Jul 27 22:49:58.472543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 66/127] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:58 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:58.774918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9cf30a34-3c9a-40f9-86e3-0168d7c1fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:58.776135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9cf30a34-3c9a-40f9-86e3-0168d7c1fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:58.784176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9cf30a34-3c9a-40f9-86e3-0168d7c1fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:58.784982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9cf30a34-3c9a-40f9-86e3-0168d7c1fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:58.785794 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9cf30a34-3c9a-40f9-86e3-0168d7c1fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:58.786326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9cf30a34-3c9a-40f9-86e3-0168d7c1fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:58.801113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-14fc936e-63fc-4f16-bb21-5186c8836262 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:58.802067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-14fc936e-63fc-4f16-bb21-5186c8836262 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:58.812821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14fc936e-63fc-4f16-bb21-5186c8836262 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:58.813435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14fc936e-63fc-4f16-bb21-5186c8836262 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:58.814215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14fc936e-63fc-4f16-bb21-5186c8836262 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:58.815442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14fc936e-63fc-4f16-bb21-5186c8836262 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:59.017283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9cf30a34-3c9a-40f9-86e3-0168d7c1fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:59.024496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9cf30a34-3c9a-40f9-86e3-0168d7c1fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.255809 Jul 27 22:49:59.025197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 62/128] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:58 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:59.046363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-14fc936e-63fc-4f16-bb21-5186c8836262 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:59.053920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-14fc936e-63fc-4f16-bb21-5186c8836262 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.256509 Jul 27 22:49:59.054481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 67/129] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:58 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:49:59.089006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-f2e488a5-3664-4a19-8709-e94666b4fa8c req-26cf5089-7395-4a12-b478-62808a7586b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6", "name": "network-vif-plugged", "status": "completed", "tag": "375463fd-0894-4aa2-b316-8b4f2c64de4d"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:49:59.099328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-f2e488a5-3664-4a19-8709-e94666b4fa8c req-26cf5089-7395-4a12-b478-62808a7586b4 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:59.099795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-f2e488a5-3664-4a19-8709-e94666b4fa8c req-26cf5089-7395-4a12-b478-62808a7586b4 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:59.111350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-f2e488a5-3664-4a19-8709-e94666b4fa8c req-26cf5089-7395-4a12-b478-62808a7586b4 service nova] Creating event network-vif-plugged:375463fd-0894-4aa2-b316-8b4f2c64de4d for instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 on hv-cinder-85124 Jul 27 22:49:59.116355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-f2e488a5-3664-4a19-8709-e94666b4fa8c req-26cf5089-7395-4a12-b478-62808a7586b4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089940 Jul 27 22:49:59.117059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 63/130] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:49:59.356762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a83b2c9d-b754-45e2-b5fb-f220b9dc3c3d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:59.357370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a83b2c9d-b754-45e2-b5fb-f220b9dc3c3d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:59.363415 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a83b2c9d-b754-45e2-b5fb-f220b9dc3c3d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:59.364068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a83b2c9d-b754-45e2-b5fb-f220b9dc3c3d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:59.365005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a83b2c9d-b754-45e2-b5fb-f220b9dc3c3d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:59.365641 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a83b2c9d-b754-45e2-b5fb-f220b9dc3c3d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:59.498023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-298ffb14-26fa-4dd0-8644-b5672e91c40a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:49:59.498714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-298ffb14-26fa-4dd0-8644-b5672e91c40a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:49:59.506090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-298ffb14-26fa-4dd0-8644-b5672e91c40a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:59.506715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-298ffb14-26fa-4dd0-8644-b5672e91c40a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:59.507813 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-298ffb14-26fa-4dd0-8644-b5672e91c40a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:49:59.508774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-298ffb14-26fa-4dd0-8644-b5672e91c40a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:49:59.539349 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a83b2c9d-b754-45e2-b5fb-f220b9dc3c3d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:59.551116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a83b2c9d-b754-45e2-b5fb-f220b9dc3c3d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:59.553120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a83b2c9d-b754-45e2-b5fb-f220b9dc3c3d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:59.555866 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a83b2c9d-b754-45e2-b5fb-f220b9dc3c3d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.203388 Jul 27 22:49:59.556756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 68/131] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:49:59 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:49:59.668148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-298ffb14-26fa-4dd0-8644-b5672e91c40a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:49:59.676261 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-298ffb14-26fa-4dd0-8644-b5672e91c40a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.185952 Jul 27 22:49:59.676868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 64/132] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:49:59 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:00.047686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a931bf43-e57b-4724-a145-fae31cd184ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:00.048332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a931bf43-e57b-4724-a145-fae31cd184ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:00.054837 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a931bf43-e57b-4724-a145-fae31cd184ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:00.055412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a931bf43-e57b-4724-a145-fae31cd184ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:00.055914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a931bf43-e57b-4724-a145-fae31cd184ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:00.056338 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a931bf43-e57b-4724-a145-fae31cd184ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:00.075282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d16963a9-c857-4f2e-bc06-3ef822c2d85e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:00.075880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d16963a9-c857-4f2e-bc06-3ef822c2d85e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:00.082269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d16963a9-c857-4f2e-bc06-3ef822c2d85e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:00.082709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d16963a9-c857-4f2e-bc06-3ef822c2d85e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:00.083480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d16963a9-c857-4f2e-bc06-3ef822c2d85e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:00.083913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d16963a9-c857-4f2e-bc06-3ef822c2d85e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:00.261686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a931bf43-e57b-4724-a145-fae31cd184ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:00.269982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a931bf43-e57b-4724-a145-fae31cd184ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.227539 Jul 27 22:50:00.283614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 69/133] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:00 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:00.283886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d16963a9-c857-4f2e-bc06-3ef822c2d85e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:00.284403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d16963a9-c857-4f2e-bc06-3ef822c2d85e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.213511 Jul 27 22:50:00.284993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 65/134] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:00 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:00.582607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-47cadf18-f16c-4f04-aaf7-c173514ef0e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:00.583221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-47cadf18-f16c-4f04-aaf7-c173514ef0e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:00.590231 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-47cadf18-f16c-4f04-aaf7-c173514ef0e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:00.590748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-47cadf18-f16c-4f04-aaf7-c173514ef0e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:00.591513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-47cadf18-f16c-4f04-aaf7-c173514ef0e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:00.591942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-47cadf18-f16c-4f04-aaf7-c173514ef0e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:00.697021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-eb0f7d1c-18ec-453c-bbf5-6537592d36d1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:00.697619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-eb0f7d1c-18ec-453c-bbf5-6537592d36d1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:00.705759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb0f7d1c-18ec-453c-bbf5-6537592d36d1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:00.709667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb0f7d1c-18ec-453c-bbf5-6537592d36d1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:00.711506 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb0f7d1c-18ec-453c-bbf5-6537592d36d1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:00.712086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb0f7d1c-18ec-453c-bbf5-6537592d36d1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:00.799751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-47cadf18-f16c-4f04-aaf7-c173514ef0e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:00.808148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-47cadf18-f16c-4f04-aaf7-c173514ef0e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:00.811875 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-47cadf18-f16c-4f04-aaf7-c173514ef0e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:00.815791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-47cadf18-f16c-4f04-aaf7-c173514ef0e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.240877 Jul 27 22:50:00.820984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 70/135] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:50:00 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:50:00.929408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eb0f7d1c-18ec-453c-bbf5-6537592d36d1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:00.946134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-eb0f7d1c-18ec-453c-bbf5-6537592d36d1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.252989 Jul 27 22:50:00.949550 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 66/136] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:00 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:01.292592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-346714ee-c3b1-4a5e-897d-da8a71118039 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:01.294260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-346714ee-c3b1-4a5e-897d-da8a71118039 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:01.301674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-346714ee-c3b1-4a5e-897d-da8a71118039 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:01.301674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-346714ee-c3b1-4a5e-897d-da8a71118039 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:01.301944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-346714ee-c3b1-4a5e-897d-da8a71118039 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:01.303167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-346714ee-c3b1-4a5e-897d-da8a71118039 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:01.307798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ab1b4bc9-b6eb-4260-9e43-3c9eb4795436 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:01.308459 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ab1b4bc9-b6eb-4260-9e43-3c9eb4795436 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:01.315096 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ab1b4bc9-b6eb-4260-9e43-3c9eb4795436 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:01.315741 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ab1b4bc9-b6eb-4260-9e43-3c9eb4795436 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:01.316498 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ab1b4bc9-b6eb-4260-9e43-3c9eb4795436 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:01.316955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ab1b4bc9-b6eb-4260-9e43-3c9eb4795436 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:01.506290 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-346714ee-c3b1-4a5e-897d-da8a71118039 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:01.513743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ab1b4bc9-b6eb-4260-9e43-3c9eb4795436 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:01.515495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-346714ee-c3b1-4a5e-897d-da8a71118039 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.227746 Jul 27 22:50:01.516593 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 71/137] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:01 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:01.521100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ab1b4bc9-b6eb-4260-9e43-3c9eb4795436 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.217448 Jul 27 22:50:01.521644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 67/138] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:01 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:01.848805 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-170330f1-99fe-4003-8a25-0a1c6b3533ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:01.850590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-170330f1-99fe-4003-8a25-0a1c6b3533ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:01.862658 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-170330f1-99fe-4003-8a25-0a1c6b3533ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:01.863754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-170330f1-99fe-4003-8a25-0a1c6b3533ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:01.864912 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-170330f1-99fe-4003-8a25-0a1c6b3533ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:01.865497 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-170330f1-99fe-4003-8a25-0a1c6b3533ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:01.978311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b008096c-be6f-47c2-a34f-3f6592b1781c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:01.979035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b008096c-be6f-47c2-a34f-3f6592b1781c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:01.988231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b008096c-be6f-47c2-a34f-3f6592b1781c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:01.990620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b008096c-be6f-47c2-a34f-3f6592b1781c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:01.994163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b008096c-be6f-47c2-a34f-3f6592b1781c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:01.994833 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b008096c-be6f-47c2-a34f-3f6592b1781c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:02.044640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-170330f1-99fe-4003-8a25-0a1c6b3533ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:02.054017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-170330f1-99fe-4003-8a25-0a1c6b3533ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:02.060401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-170330f1-99fe-4003-8a25-0a1c6b3533ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:02.061570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-170330f1-99fe-4003-8a25-0a1c6b3533ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.218712 Jul 27 22:50:02.062125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 72/139] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:50:01 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:50:02.343608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b008096c-be6f-47c2-a34f-3f6592b1781c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:02.355616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b008096c-be6f-47c2-a34f-3f6592b1781c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.385455 Jul 27 22:50:02.356176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 68/140] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:01 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:02.551636 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-53ec54b0-78fd-4677-a937-8e19a3718e5f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:02.552480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2ec96f9a-0fc3-430f-a0f8-730b21b9be99 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:02.553129 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2ec96f9a-0fc3-430f-a0f8-730b21b9be99 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:02.553785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-53ec54b0-78fd-4677-a937-8e19a3718e5f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:02.567863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ec96f9a-0fc3-430f-a0f8-730b21b9be99 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:02.568311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ec96f9a-0fc3-430f-a0f8-730b21b9be99 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:02.571295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-53ec54b0-78fd-4677-a937-8e19a3718e5f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:02.571915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-53ec54b0-78fd-4677-a937-8e19a3718e5f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:02.573866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-53ec54b0-78fd-4677-a937-8e19a3718e5f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:02.576342 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ec96f9a-0fc3-430f-a0f8-730b21b9be99 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:02.576516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-53ec54b0-78fd-4677-a937-8e19a3718e5f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:02.579124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ec96f9a-0fc3-430f-a0f8-730b21b9be99 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:02.788209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:02.830188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2ec96f9a-0fc3-430f-a0f8-730b21b9be99 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:02.844041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2ec96f9a-0fc3-430f-a0f8-730b21b9be99 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.310978 Jul 27 22:50:02.844667 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 73/141] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:02 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:02.848509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-53ec54b0-78fd-4677-a937-8e19a3718e5f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:02.863539 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-53ec54b0-78fd-4677-a937-8e19a3718e5f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.325376 Jul 27 22:50:02.864460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 69/142] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:02 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:03.088045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2289545b-deca-472c-a76f-e34134ddf390 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:03.088829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2289545b-deca-472c-a76f-e34134ddf390 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:03.095420 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2289545b-deca-472c-a76f-e34134ddf390 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:03.095859 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2289545b-deca-472c-a76f-e34134ddf390 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:03.096628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2289545b-deca-472c-a76f-e34134ddf390 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:03.097145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2289545b-deca-472c-a76f-e34134ddf390 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:03.239950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2289545b-deca-472c-a76f-e34134ddf390 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:03.248531 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2289545b-deca-472c-a76f-e34134ddf390 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:03.250286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2289545b-deca-472c-a76f-e34134ddf390 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:03.251537 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2289545b-deca-472c-a76f-e34134ddf390 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.167122 Jul 27 22:50:03.252092 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 74/143] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:50:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:50:03.376414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9deab209-6a83-406b-9913-1b6af36fdf4f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:03.377050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9deab209-6a83-406b-9913-1b6af36fdf4f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:03.382924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9deab209-6a83-406b-9913-1b6af36fdf4f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:03.383364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9deab209-6a83-406b-9913-1b6af36fdf4f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:03.384291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9deab209-6a83-406b-9913-1b6af36fdf4f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:03.384747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9deab209-6a83-406b-9913-1b6af36fdf4f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:03.537566 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9deab209-6a83-406b-9913-1b6af36fdf4f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:03.544888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9deab209-6a83-406b-9913-1b6af36fdf4f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.172298 Jul 27 22:50:03.545443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 70/144] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:03 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:03.866145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d856e6c1-2f41-4730-9b00-0f081d202d88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:03.866749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d856e6c1-2f41-4730-9b00-0f081d202d88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:03.873339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d856e6c1-2f41-4730-9b00-0f081d202d88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:03.873776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d856e6c1-2f41-4730-9b00-0f081d202d88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:03.874525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d856e6c1-2f41-4730-9b00-0f081d202d88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:03.874951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d856e6c1-2f41-4730-9b00-0f081d202d88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:03.884769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c7e962c3-bbf6-4446-a586-afffbb9df3de tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:03.885373 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c7e962c3-bbf6-4446-a586-afffbb9df3de tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:03.891313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7e962c3-bbf6-4446-a586-afffbb9df3de tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:03.891746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7e962c3-bbf6-4446-a586-afffbb9df3de tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:03.892492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7e962c3-bbf6-4446-a586-afffbb9df3de tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:03.892942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7e962c3-bbf6-4446-a586-afffbb9df3de tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:04.071203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d856e6c1-2f41-4730-9b00-0f081d202d88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:04.074234 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c7e962c3-bbf6-4446-a586-afffbb9df3de tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:04.078718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d856e6c1-2f41-4730-9b00-0f081d202d88 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.216300 Jul 27 22:50:04.079281 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 75/145] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:03 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:04.083339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c7e962c3-bbf6-4446-a586-afffbb9df3de tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.202365 Jul 27 22:50:04.083888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 71/146] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:03 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:04.274240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2f0201f2-f4e6-4713-a2dc-a1240b39babc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:04.274838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2f0201f2-f4e6-4713-a2dc-a1240b39babc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:04.281452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f0201f2-f4e6-4713-a2dc-a1240b39babc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:04.281884 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f0201f2-f4e6-4713-a2dc-a1240b39babc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:04.282620 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f0201f2-f4e6-4713-a2dc-a1240b39babc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:04.283037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f0201f2-f4e6-4713-a2dc-a1240b39babc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:04.416282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2f0201f2-f4e6-4713-a2dc-a1240b39babc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:04.424801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2f0201f2-f4e6-4713-a2dc-a1240b39babc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:04.426301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2f0201f2-f4e6-4713-a2dc-a1240b39babc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:04.427386 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2f0201f2-f4e6-4713-a2dc-a1240b39babc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.157009 Jul 27 22:50:04.427945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 76/147] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:50:04 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:50:04.564517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-19bc16c1-ed61-46a2-b42a-76017d833bc8 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:04.565145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-19bc16c1-ed61-46a2-b42a-76017d833bc8 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:04.571465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19bc16c1-ed61-46a2-b42a-76017d833bc8 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:04.571973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19bc16c1-ed61-46a2-b42a-76017d833bc8 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:04.572821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19bc16c1-ed61-46a2-b42a-76017d833bc8 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:04.573247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19bc16c1-ed61-46a2-b42a-76017d833bc8 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:04.702565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-19bc16c1-ed61-46a2-b42a-76017d833bc8 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:04.709860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-19bc16c1-ed61-46a2-b42a-76017d833bc8 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.149355 Jul 27 22:50:04.710417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 72/148] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:04 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:05.099790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-eb1df87c-9130-4564-a9d0-bb9732bda464 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:05.100400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-eb1df87c-9130-4564-a9d0-bb9732bda464 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:05.103101 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0bc6456e-ab93-4a23-84f4-d7369dd0397c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:05.103714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0bc6456e-ab93-4a23-84f4-d7369dd0397c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:05.107097 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb1df87c-9130-4564-a9d0-bb9732bda464 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:05.107542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb1df87c-9130-4564-a9d0-bb9732bda464 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:05.108300 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb1df87c-9130-4564-a9d0-bb9732bda464 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:05.108758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb1df87c-9130-4564-a9d0-bb9732bda464 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:05.110140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0bc6456e-ab93-4a23-84f4-d7369dd0397c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:05.110585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0bc6456e-ab93-4a23-84f4-d7369dd0397c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:05.111334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0bc6456e-ab93-4a23-84f4-d7369dd0397c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:05.111762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0bc6456e-ab93-4a23-84f4-d7369dd0397c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:05.298801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eb1df87c-9130-4564-a9d0-bb9732bda464 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:05.302803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0bc6456e-ab93-4a23-84f4-d7369dd0397c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:05.306134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-eb1df87c-9130-4564-a9d0-bb9732bda464 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.210431 Jul 27 22:50:05.306700 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 77/149] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:05 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:05.310357 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0bc6456e-ab93-4a23-84f4-d7369dd0397c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.210975 Jul 27 22:50:05.310994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 73/150] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:05 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:05.449245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fa005493-21e1-48aa-b459-26fa0f4fdac6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:05.450362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fa005493-21e1-48aa-b459-26fa0f4fdac6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:05.460306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa005493-21e1-48aa-b459-26fa0f4fdac6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:05.460774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa005493-21e1-48aa-b459-26fa0f4fdac6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:05.461574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa005493-21e1-48aa-b459-26fa0f4fdac6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:05.461985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa005493-21e1-48aa-b459-26fa0f4fdac6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:05.703903 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fa005493-21e1-48aa-b459-26fa0f4fdac6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:05.722936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fa005493-21e1-48aa-b459-26fa0f4fdac6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:05.727858 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fa005493-21e1-48aa-b459-26fa0f4fdac6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:05.730284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fa005493-21e1-48aa-b459-26fa0f4fdac6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.284871 Jul 27 22:50:05.732854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-de372664-1a1c-4171-acae-f791a1b5fbe6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:05.733752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-de372664-1a1c-4171-acae-f791a1b5fbe6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:05.742345 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 78/151] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:50:05 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:50:05.764402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de372664-1a1c-4171-acae-f791a1b5fbe6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:05.765002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de372664-1a1c-4171-acae-f791a1b5fbe6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:05.767927 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de372664-1a1c-4171-acae-f791a1b5fbe6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:05.768419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de372664-1a1c-4171-acae-f791a1b5fbe6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:06.026478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-de372664-1a1c-4171-acae-f791a1b5fbe6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:06.038816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-de372664-1a1c-4171-acae-f791a1b5fbe6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.310939 Jul 27 22:50:06.040285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 74/152] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:05 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:06.327344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-49aaabf7-0dd5-4569-b246-4999028c3f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:06.327959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-49aaabf7-0dd5-4569-b246-4999028c3f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:06.333063 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-221872bb-6ce6-4278-ac7c-87ce85be21e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:06.333884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-221872bb-6ce6-4278-ac7c-87ce85be21e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:06.344854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:06.346908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-49aaabf7-0dd5-4569-b246-4999028c3f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:06.348989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-221872bb-6ce6-4278-ac7c-87ce85be21e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:06.349638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-49aaabf7-0dd5-4569-b246-4999028c3f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:06.350292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-221872bb-6ce6-4278-ac7c-87ce85be21e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:06.351393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-49aaabf7-0dd5-4569-b246-4999028c3f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:06.352999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-49aaabf7-0dd5-4569-b246-4999028c3f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:06.353253 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-221872bb-6ce6-4278-ac7c-87ce85be21e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:06.353876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-221872bb-6ce6-4278-ac7c-87ce85be21e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:06.648380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-221872bb-6ce6-4278-ac7c-87ce85be21e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:06.667069 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-221872bb-6ce6-4278-ac7c-87ce85be21e4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.337645 Jul 27 22:50:06.667728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 75/153] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:06 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:06.683275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-49aaabf7-0dd5-4569-b246-4999028c3f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:06.702195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-49aaabf7-0dd5-4569-b246-4999028c3f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.379132 Jul 27 22:50:06.713092 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 79/154] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:06 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:06.759194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-93eb2bac-765b-4989-813b-2d94575402dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:06.759792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-93eb2bac-765b-4989-813b-2d94575402dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:06.766302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-93eb2bac-765b-4989-813b-2d94575402dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:06.766874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-93eb2bac-765b-4989-813b-2d94575402dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:06.767474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-93eb2bac-765b-4989-813b-2d94575402dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:06.767905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-93eb2bac-765b-4989-813b-2d94575402dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:06.924463 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-93eb2bac-765b-4989-813b-2d94575402dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:06.933770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-93eb2bac-765b-4989-813b-2d94575402dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:06.935372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-93eb2bac-765b-4989-813b-2d94575402dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:06.937542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-93eb2bac-765b-4989-813b-2d94575402dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.181420 Jul 27 22:50:06.938105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 76/155] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:50:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:50:07.060191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-56122d12-ba2f-420d-99ce-6b0acb2b07d2 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:07.060993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-56122d12-ba2f-420d-99ce-6b0acb2b07d2 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:07.067751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-56122d12-ba2f-420d-99ce-6b0acb2b07d2 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:07.068205 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-56122d12-ba2f-420d-99ce-6b0acb2b07d2 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:07.069069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-56122d12-ba2f-420d-99ce-6b0acb2b07d2 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:07.069500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-56122d12-ba2f-420d-99ce-6b0acb2b07d2 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:07.090092 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:07.206194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-56122d12-ba2f-420d-99ce-6b0acb2b07d2 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:07.213550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-56122d12-ba2f-420d-99ce-6b0acb2b07d2 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.157506 Jul 27 22:50:07.214107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 80/156] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:07 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:07.691640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f1b8b353-3799-4822-a523-4e2dcf8af3d1 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:07.692344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f1b8b353-3799-4822-a523-4e2dcf8af3d1 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:07.699668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f1b8b353-3799-4822-a523-4e2dcf8af3d1 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:07.701016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f1b8b353-3799-4822-a523-4e2dcf8af3d1 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:07.702689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f1b8b353-3799-4822-a523-4e2dcf8af3d1 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:07.703317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f1b8b353-3799-4822-a523-4e2dcf8af3d1 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:07.727871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1ddd6864-f78a-46c9-8889-f674d152b9b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:07.729952 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1ddd6864-f78a-46c9-8889-f674d152b9b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:07.737864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ddd6864-f78a-46c9-8889-f674d152b9b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:07.741248 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ddd6864-f78a-46c9-8889-f674d152b9b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:07.742335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ddd6864-f78a-46c9-8889-f674d152b9b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:07.742985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ddd6864-f78a-46c9-8889-f674d152b9b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:08.004580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f1b8b353-3799-4822-a523-4e2dcf8af3d1 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:08.012583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1ddd6864-f78a-46c9-8889-f674d152b9b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:08.018249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f1b8b353-3799-4822-a523-4e2dcf8af3d1 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.333276 Jul 27 22:50:08.019615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 77/157] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:07 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:08.021020 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1ddd6864-f78a-46c9-8889-f674d152b9b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.298866 Jul 27 22:50:08.021577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 81/158] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:07 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:08.026819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b995f5ca-a128-4ede-8c56-09520e5a4e6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:08.027164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-4b8c559d-7a18-4d2d-a9f9-b57ddb840704 req-c6684f9e-c139-4ae4-892d-158e3298ade6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c90c3b-021d-449c-8d25-b38e625ffc54", "name": "network-vif-plugged", "status": "completed", "tag": "00778e2c-f71b-4986-8a16-14796fb6efad"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:08.027835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b995f5ca-a128-4ede-8c56-09520e5a4e6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:08.037355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b995f5ca-a128-4ede-8c56-09520e5a4e6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:08.038122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b995f5ca-a128-4ede-8c56-09520e5a4e6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:08.038754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-4b8c559d-7a18-4d2d-a9f9-b57ddb840704 req-c6684f9e-c139-4ae4-892d-158e3298ade6 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:08.039988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b995f5ca-a128-4ede-8c56-09520e5a4e6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:08.040875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b995f5ca-a128-4ede-8c56-09520e5a4e6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:08.041847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-4b8c559d-7a18-4d2d-a9f9-b57ddb840704 req-c6684f9e-c139-4ae4-892d-158e3298ade6 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:08.059052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-4b8c559d-7a18-4d2d-a9f9-b57ddb840704 req-c6684f9e-c139-4ae4-892d-158e3298ade6 service nova] Creating event network-vif-plugged:00778e2c-f71b-4986-8a16-14796fb6efad for instance d3c90c3b-021d-449c-8d25-b38e625ffc54 on hv-cinder-85124 Jul 27 22:50:08.065869 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-4b8c559d-7a18-4d2d-a9f9-b57ddb840704 req-c6684f9e-c139-4ae4-892d-158e3298ade6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041982 Jul 27 22:50:08.067234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 82/159] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:08.099797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:08.232828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b995f5ca-a128-4ede-8c56-09520e5a4e6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:08.238199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-080404f9-f2f8-4600-bb2d-6f360d25d4f1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:08.240005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-080404f9-f2f8-4600-bb2d-6f360d25d4f1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:08.241409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b995f5ca-a128-4ede-8c56-09520e5a4e6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:08.243117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b995f5ca-a128-4ede-8c56-09520e5a4e6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:08.244468 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b995f5ca-a128-4ede-8c56-09520e5a4e6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.223566 Jul 27 22:50:08.245279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 78/160] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:50:08 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:50:08.255490 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-080404f9-f2f8-4600-bb2d-6f360d25d4f1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:08.256101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-080404f9-f2f8-4600-bb2d-6f360d25d4f1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:08.257106 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-080404f9-f2f8-4600-bb2d-6f360d25d4f1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:08.258076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-080404f9-f2f8-4600-bb2d-6f360d25d4f1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:08.458640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-080404f9-f2f8-4600-bb2d-6f360d25d4f1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:08.469785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-080404f9-f2f8-4600-bb2d-6f360d25d4f1 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.237392 Jul 27 22:50:08.470722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 83/161] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:08 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:09.039387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-10d3ed48-62c7-4e8f-b313-b3e056daba97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:09.040586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-10d3ed48-62c7-4e8f-b313-b3e056daba97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:09.046780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10d3ed48-62c7-4e8f-b313-b3e056daba97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:09.047390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10d3ed48-62c7-4e8f-b313-b3e056daba97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:09.048673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10d3ed48-62c7-4e8f-b313-b3e056daba97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:09.049243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10d3ed48-62c7-4e8f-b313-b3e056daba97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:09.058989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a20be644-c6b2-481c-ad94-365b49f29b56 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:09.059637 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a20be644-c6b2-481c-ad94-365b49f29b56 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:09.091704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:09.093295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a20be644-c6b2-481c-ad94-365b49f29b56 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:09.093741 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a20be644-c6b2-481c-ad94-365b49f29b56 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:09.094535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a20be644-c6b2-481c-ad94-365b49f29b56 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:09.094962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a20be644-c6b2-481c-ad94-365b49f29b56 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:09.357093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-10d3ed48-62c7-4e8f-b313-b3e056daba97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:09.366774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-10d3ed48-62c7-4e8f-b313-b3e056daba97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.331057 Jul 27 22:50:09.367539 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 79/162] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:09 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:09.369678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a20be644-c6b2-481c-ad94-365b49f29b56 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:09.372007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a2b66027-d175-4990-a0ae-026df310c4a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:09.372832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a2b66027-d175-4990-a0ae-026df310c4a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:09.379423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2b66027-d175-4990-a0ae-026df310c4a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:09.380057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2b66027-d175-4990-a0ae-026df310c4a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:09.386989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2b66027-d175-4990-a0ae-026df310c4a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:09.387842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2b66027-d175-4990-a0ae-026df310c4a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:09.391615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a20be644-c6b2-481c-ad94-365b49f29b56 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1322 microversion: 2.1 time: 0.335675 Jul 27 22:50:09.404577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 84/163] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:09 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:09.493881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-513ef4f7-5614-464d-a0aa-96c741d96cb6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:09.494602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-513ef4f7-5614-464d-a0aa-96c741d96cb6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:09.509822 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-513ef4f7-5614-464d-a0aa-96c741d96cb6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:09.510702 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-513ef4f7-5614-464d-a0aa-96c741d96cb6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:09.513762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-513ef4f7-5614-464d-a0aa-96c741d96cb6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:09.514525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-513ef4f7-5614-464d-a0aa-96c741d96cb6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:09.670398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a2b66027-d175-4990-a0ae-026df310c4a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:09.686181 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a2b66027-d175-4990-a0ae-026df310c4a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:09.688307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a2b66027-d175-4990-a0ae-026df310c4a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:09.701422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a2b66027-d175-4990-a0ae-026df310c4a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.332815 Jul 27 22:50:09.703174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 80/164] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:50:09 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:50:09.796413 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-513ef4f7-5614-464d-a0aa-96c741d96cb6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:09.820211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-513ef4f7-5614-464d-a0aa-96c741d96cb6 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.330971 Jul 27 22:50:09.822856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 85/165] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:09 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:10.097022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-892eb4b8-7568-4944-8274-0c7283dbe361 req-8ad98340-4ae9-4b2a-9a10-676746d9e09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e457f5fc-ae83-4b88-87be-ba1007c5865e", "name": "network-vif-plugged", "status": "completed", "tag": "977e384c-b17c-446d-945e-7c6a9e7c3e88"}, {"server_uuid": "f61a77c9-764c-4eca-a654-dabb4c208454", "name": "network-vif-plugged", "status": "completed", "tag": "7bf42a6f-daff-4fc8-9bfb-ebb04957bcc1"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:10.123479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-892eb4b8-7568-4944-8274-0c7283dbe361 req-8ad98340-4ae9-4b2a-9a10-676746d9e09d service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:10.124443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-892eb4b8-7568-4944-8274-0c7283dbe361 req-8ad98340-4ae9-4b2a-9a10-676746d9e09d service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:10.177349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-892eb4b8-7568-4944-8274-0c7283dbe361 req-8ad98340-4ae9-4b2a-9a10-676746d9e09d service nova] Creating event network-vif-plugged:977e384c-b17c-446d-945e-7c6a9e7c3e88 for instance e457f5fc-ae83-4b88-87be-ba1007c5865e on hv-cinder-85124 Jul 27 22:50:10.178301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-892eb4b8-7568-4944-8274-0c7283dbe361 req-8ad98340-4ae9-4b2a-9a10-676746d9e09d service nova] Creating event network-vif-plugged:7bf42a6f-daff-4fc8-9bfb-ebb04957bcc1 for instance f61a77c9-764c-4eca-a654-dabb4c208454 on hv-cinder-85124 Jul 27 22:50:10.191845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-892eb4b8-7568-4944-8274-0c7283dbe361 req-8ad98340-4ae9-4b2a-9a10-676746d9e09d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100622 Jul 27 22:50:10.194213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 81/166] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:10.387334 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-22e4efcd-4cad-4904-ad96-62c012dcf085 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:10.388412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-22e4efcd-4cad-4904-ad96-62c012dcf085 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:10.414817 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-22e4efcd-4cad-4904-ad96-62c012dcf085 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:10.415336 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-22e4efcd-4cad-4904-ad96-62c012dcf085 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:10.416585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-22e4efcd-4cad-4904-ad96-62c012dcf085 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:10.416585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-22e4efcd-4cad-4904-ad96-62c012dcf085 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:10.433135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-876c6e80-967c-4d03-a551-d97f73adea15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:10.436952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-876c6e80-967c-4d03-a551-d97f73adea15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:10.449066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-876c6e80-967c-4d03-a551-d97f73adea15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:10.451307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-876c6e80-967c-4d03-a551-d97f73adea15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:10.452792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-876c6e80-967c-4d03-a551-d97f73adea15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:10.456210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-876c6e80-967c-4d03-a551-d97f73adea15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:10.761493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-876c6e80-967c-4d03-a551-d97f73adea15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:10.772237 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-876c6e80-967c-4d03-a551-d97f73adea15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1516 microversion: 2.1 time: 0.355771 Jul 27 22:50:10.794604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 82/167] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:10 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1516 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:10.801550 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9db5a8b6-514b-4ffa-be3b-003c7cae6514 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:10.802406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9db5a8b6-514b-4ffa-be3b-003c7cae6514 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:10.812164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9db5a8b6-514b-4ffa-be3b-003c7cae6514 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:10.813198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9db5a8b6-514b-4ffa-be3b-003c7cae6514 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:10.814596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9db5a8b6-514b-4ffa-be3b-003c7cae6514 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:10.815258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9db5a8b6-514b-4ffa-be3b-003c7cae6514 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:11.019188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-22e4efcd-4cad-4904-ad96-62c012dcf085 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:11.027470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-22e4efcd-4cad-4904-ad96-62c012dcf085 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.644053 Jul 27 22:50:11.046885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 86/168] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:10 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:11.052286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5b835db5-05f4-4c61-bff6-f43798854f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:11.059121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5b835db5-05f4-4c61-bff6-f43798854f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:11.066479 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b835db5-05f4-4c61-bff6-f43798854f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:11.067205 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b835db5-05f4-4c61-bff6-f43798854f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:11.068426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b835db5-05f4-4c61-bff6-f43798854f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:11.069080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b835db5-05f4-4c61-bff6-f43798854f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:11.107796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9db5a8b6-514b-4ffa-be3b-003c7cae6514 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:11.115679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9db5a8b6-514b-4ffa-be3b-003c7cae6514 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:11.117214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9db5a8b6-514b-4ffa-be3b-003c7cae6514 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:11.118320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9db5a8b6-514b-4ffa-be3b-003c7cae6514 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.321856 Jul 27 22:50:11.121807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 83/169] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:50:10 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:50:11.126504 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5364b00a-c743-4ff4-95d3-6bb2bb74ae37 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:11.127289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5364b00a-c743-4ff4-95d3-6bb2bb74ae37 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:11.156881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.objects.instance [None req-5b835db5-05f4-4c61-bff6-f43798854f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lazy-loading 'flavor' on Instance uuid d3c90c3b-021d-449c-8d25-b38e625ffc54 {{(pid=129294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:50:11.157037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5364b00a-c743-4ff4-95d3-6bb2bb74ae37 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:11.157443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5364b00a-c743-4ff4-95d3-6bb2bb74ae37 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:11.158094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5364b00a-c743-4ff4-95d3-6bb2bb74ae37 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:11.158526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5364b00a-c743-4ff4-95d3-6bb2bb74ae37 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:11.324666 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5b835db5-05f4-4c61-bff6-f43798854f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "POST /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54/action" status: 200 len: 32 microversion: 2.1 time: 0.275170 Jul 27 22:50:11.328344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 87/170] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 22:50:11 2022] POST /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54/action => generated 32 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 22:50:11.341904 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9afc98f5-135a-465c-aaf9-dbf4030a139b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:11.346060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9afc98f5-135a-465c-aaf9-dbf4030a139b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:11.357942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9afc98f5-135a-465c-aaf9-dbf4030a139b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:11.358649 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9afc98f5-135a-465c-aaf9-dbf4030a139b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:11.359858 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9afc98f5-135a-465c-aaf9-dbf4030a139b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:11.361206 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9afc98f5-135a-465c-aaf9-dbf4030a139b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:11.454591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5364b00a-c743-4ff4-95d3-6bb2bb74ae37 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:11.465471 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5364b00a-c743-4ff4-95d3-6bb2bb74ae37 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.342208 Jul 27 22:50:11.466626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 84/171] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:11 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:11.572109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9afc98f5-135a-465c-aaf9-dbf4030a139b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:11.581486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9afc98f5-135a-465c-aaf9-dbf4030a139b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.246320 Jul 27 22:50:11.582032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 88/172] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:11 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:12.049458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ddee2951-d9ee-4fa2-b4c1-791d125d55b6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:12.050963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ddee2951-d9ee-4fa2-b4c1-791d125d55b6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:12.060508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ddee2951-d9ee-4fa2-b4c1-791d125d55b6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:12.070340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ddee2951-d9ee-4fa2-b4c1-791d125d55b6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:12.071292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ddee2951-d9ee-4fa2-b4c1-791d125d55b6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:12.071959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ddee2951-d9ee-4fa2-b4c1-791d125d55b6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:12.152204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-775f9721-f22d-4d2a-bbfc-ff8b0db3c85a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:12.152204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-775f9721-f22d-4d2a-bbfc-ff8b0db3c85a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:12.156112 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-775f9721-f22d-4d2a-bbfc-ff8b0db3c85a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:12.156539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-775f9721-f22d-4d2a-bbfc-ff8b0db3c85a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:12.157524 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-775f9721-f22d-4d2a-bbfc-ff8b0db3c85a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:12.157935 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-775f9721-f22d-4d2a-bbfc-ff8b0db3c85a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:12.277604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ddee2951-d9ee-4fa2-b4c1-791d125d55b6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:12.287037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ddee2951-d9ee-4fa2-b4c1-791d125d55b6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1364 microversion: 2.1 time: 0.243591 Jul 27 22:50:12.300085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 85/173] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:12 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:12.304813 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-3ce72144-5655-475f-9df4-d77f1e7e5e45 req-31830b13-aa05-4191-bc99-fdf3bc2b60ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399d83c4-59b5-40ab-8d79-90974eba0ba8", "name": "network-vif-plugged", "status": "completed", "tag": "2a3662c6-57e8-463f-ac7e-d0aa5bfe5bc9"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:12.339382 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-3ce72144-5655-475f-9df4-d77f1e7e5e45 req-31830b13-aa05-4191-bc99-fdf3bc2b60ea service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:12.341622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-3ce72144-5655-475f-9df4-d77f1e7e5e45 req-31830b13-aa05-4191-bc99-fdf3bc2b60ea service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:12.368657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-3ce72144-5655-475f-9df4-d77f1e7e5e45 req-31830b13-aa05-4191-bc99-fdf3bc2b60ea service nova] Creating event network-vif-plugged:2a3662c6-57e8-463f-ac7e-d0aa5bfe5bc9 for instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 on hv-cinder-85124 Jul 27 22:50:12.375907 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-3ce72144-5655-475f-9df4-d77f1e7e5e45 req-31830b13-aa05-4191-bc99-fdf3bc2b60ea service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074309 Jul 27 22:50:12.377494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 86/174] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:12.411909 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-775f9721-f22d-4d2a-bbfc-ff8b0db3c85a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:12.422335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-775f9721-f22d-4d2a-bbfc-ff8b0db3c85a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:12.424837 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-775f9721-f22d-4d2a-bbfc-ff8b0db3c85a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:12.427179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-775f9721-f22d-4d2a-bbfc-ff8b0db3c85a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1407 microversion: 2.20 time: 0.283655 Jul 27 22:50:12.428022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 89/175] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:50:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:50:12.488917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ed5876e0-394d-41bc-8e8e-25fc2d76f16b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:12.489616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ed5876e0-394d-41bc-8e8e-25fc2d76f16b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:12.495881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed5876e0-394d-41bc-8e8e-25fc2d76f16b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:12.496319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed5876e0-394d-41bc-8e8e-25fc2d76f16b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:12.497268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed5876e0-394d-41bc-8e8e-25fc2d76f16b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:12.497697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed5876e0-394d-41bc-8e8e-25fc2d76f16b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:12.613547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-db32c769-467d-4795-a8a0-5e20f36a63b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:12.617361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-db32c769-467d-4795-a8a0-5e20f36a63b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:12.630507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db32c769-467d-4795-a8a0-5e20f36a63b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:12.632845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db32c769-467d-4795-a8a0-5e20f36a63b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:12.633836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db32c769-467d-4795-a8a0-5e20f36a63b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:12.640958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db32c769-467d-4795-a8a0-5e20f36a63b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:12.734109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ed5876e0-394d-41bc-8e8e-25fc2d76f16b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:12.745960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ed5876e0-394d-41bc-8e8e-25fc2d76f16b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.261332 Jul 27 22:50:12.748710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 87/176] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:12 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:12.849609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-db32c769-467d-4795-a8a0-5e20f36a63b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:12.866106 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-db32c769-467d-4795-a8a0-5e20f36a63b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.258840 Jul 27 22:50:12.867451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 90/177] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:12 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:13.312427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4ac85483-7e16-405f-9655-78d179c7ba8d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:13.314051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4ac85483-7e16-405f-9655-78d179c7ba8d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:13.323524 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ac85483-7e16-405f-9655-78d179c7ba8d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:13.324711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ac85483-7e16-405f-9655-78d179c7ba8d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:13.326507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ac85483-7e16-405f-9655-78d179c7ba8d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:13.327445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ac85483-7e16-405f-9655-78d179c7ba8d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:13.450932 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-aeca61d9-81e6-40f4-b6eb-bb262eeb6424 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:13.451374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-aeca61d9-81e6-40f4-b6eb-bb262eeb6424 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:13.457792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aeca61d9-81e6-40f4-b6eb-bb262eeb6424 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:13.458232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aeca61d9-81e6-40f4-b6eb-bb262eeb6424 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:13.459460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aeca61d9-81e6-40f4-b6eb-bb262eeb6424 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:13.460117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aeca61d9-81e6-40f4-b6eb-bb262eeb6424 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:13.595049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4ac85483-7e16-405f-9655-78d179c7ba8d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:13.614804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4ac85483-7e16-405f-9655-78d179c7ba8d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1549 microversion: 2.1 time: 0.309436 Jul 27 22:50:13.617414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 88/178] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:13 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1549 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:13.645579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-29b2ba85-34b0-4858-849c-2596e1fbc22e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:13.646093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-29b2ba85-34b0-4858-849c-2596e1fbc22e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:13.655437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29b2ba85-34b0-4858-849c-2596e1fbc22e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:13.657731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29b2ba85-34b0-4858-849c-2596e1fbc22e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:13.658761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29b2ba85-34b0-4858-849c-2596e1fbc22e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:13.661006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29b2ba85-34b0-4858-849c-2596e1fbc22e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:13.724986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-aeca61d9-81e6-40f4-b6eb-bb262eeb6424 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:13.734860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-aeca61d9-81e6-40f4-b6eb-bb262eeb6424 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:13.736462 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-aeca61d9-81e6-40f4-b6eb-bb262eeb6424 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:13.737844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-aeca61d9-81e6-40f4-b6eb-bb262eeb6424 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1598 microversion: 2.20 time: 0.292096 Jul 27 22:50:13.738389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 91/179] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:50:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1598 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:50:13.788647 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6a4f4dda-c97a-4acf-b7e1-fd2235881295 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:13.798414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6a4f4dda-c97a-4acf-b7e1-fd2235881295 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:13.812434 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a4f4dda-c97a-4acf-b7e1-fd2235881295 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:13.813213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a4f4dda-c97a-4acf-b7e1-fd2235881295 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:13.814988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a4f4dda-c97a-4acf-b7e1-fd2235881295 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:13.815925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a4f4dda-c97a-4acf-b7e1-fd2235881295 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:13.863583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-29b2ba85-34b0-4858-849c-2596e1fbc22e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.222313 Jul 27 22:50:13.864457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 89/180] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 22:50:13 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:50:13.869265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b888425b-2931-4d86-a2d4-b53db4294e08 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:13.869859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b888425b-2931-4d86-a2d4-b53db4294e08 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:13.878930 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b888425b-2931-4d86-a2d4-b53db4294e08 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:13.879651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b888425b-2931-4d86-a2d4-b53db4294e08 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:13.880691 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b888425b-2931-4d86-a2d4-b53db4294e08 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:13.881327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b888425b-2931-4d86-a2d4-b53db4294e08 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:14.125013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6a4f4dda-c97a-4acf-b7e1-fd2235881295 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.362825 Jul 27 22:50:14.126212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 92/181] 10.222.0.47 () {60 vars in 1316 bytes} [Wed Jul 27 22:50:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-interface => generated 284 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:50:14.131693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1e53af8f-adcb-4dff-af18-1af9528a6299 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:14.140120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1e53af8f-adcb-4dff-af18-1af9528a6299 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:14.154723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1e53af8f-adcb-4dff-af18-1af9528a6299 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:14.160260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1e53af8f-adcb-4dff-af18-1af9528a6299 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:14.161688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1e53af8f-adcb-4dff-af18-1af9528a6299 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:14.166638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1e53af8f-adcb-4dff-af18-1af9528a6299 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:14.796694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b888425b-2931-4d86-a2d4-b53db4294e08 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:14.814098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b888425b-2931-4d86-a2d4-b53db4294e08 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1314 microversion: 2.1 time: 0.948360 Jul 27 22:50:14.817523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 90/182] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:13 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1314 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:14.919129 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1e53af8f-adcb-4dff-af18-1af9528a6299 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:14.932162 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1e53af8f-adcb-4dff-af18-1af9528a6299 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.801694 Jul 27 22:50:14.945159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 93/183] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:14 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:15.842319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-61f27889-210c-490f-83c1-646f56b01307 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:15.843820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-61f27889-210c-490f-83c1-646f56b01307 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:15.851346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61f27889-210c-490f-83c1-646f56b01307 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:15.852155 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61f27889-210c-490f-83c1-646f56b01307 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:15.853536 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61f27889-210c-490f-83c1-646f56b01307 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:15.854174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61f27889-210c-490f-83c1-646f56b01307 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:15.958749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-52639e7c-4c7c-4b72-ba6c-4c623f61ff51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:15.959483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-52639e7c-4c7c-4b72-ba6c-4c623f61ff51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:15.970567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52639e7c-4c7c-4b72-ba6c-4c623f61ff51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:15.972330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52639e7c-4c7c-4b72-ba6c-4c623f61ff51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:15.974587 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52639e7c-4c7c-4b72-ba6c-4c623f61ff51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:15.975103 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52639e7c-4c7c-4b72-ba6c-4c623f61ff51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:16.335658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-61f27889-210c-490f-83c1-646f56b01307 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:16.344604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-61f27889-210c-490f-83c1-646f56b01307 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1502 microversion: 2.1 time: 0.506445 Jul 27 22:50:16.345465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 91/184] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:15 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1502 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:16.350580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-59fa5d7a-0735-4a6f-8c39-674cf0641506 req-0c1649c4-9a07-4641-9567-93269b7d2492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e457f5fc-ae83-4b88-87be-ba1007c5865e", "tag": "977e384c-b17c-446d-945e-7c6a9e7c3e88"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:16.366622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-59fa5d7a-0735-4a6f-8c39-674cf0641506 req-0c1649c4-9a07-4641-9567-93269b7d2492 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:16.380478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-59fa5d7a-0735-4a6f-8c39-674cf0641506 req-0c1649c4-9a07-4641-9567-93269b7d2492 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:16.413946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-59fa5d7a-0735-4a6f-8c39-674cf0641506 req-0c1649c4-9a07-4641-9567-93269b7d2492 service nova] Creating event network-changed:977e384c-b17c-446d-945e-7c6a9e7c3e88 for instance e457f5fc-ae83-4b88-87be-ba1007c5865e on hv-cinder-85124 Jul 27 22:50:16.426192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-52639e7c-4c7c-4b72-ba6c-4c623f61ff51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:16.428210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-59fa5d7a-0735-4a6f-8c39-674cf0641506 req-0c1649c4-9a07-4641-9567-93269b7d2492 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081076 Jul 27 22:50:16.432366 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 92/185] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:16.465360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-52639e7c-4c7c-4b72-ba6c-4c623f61ff51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.511149 Jul 27 22:50:16.471408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 94/186] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:15 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:17.496318 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-10af1768-3a9e-4e6b-8786-74c38b5320a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:17.498198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-10af1768-3a9e-4e6b-8786-74c38b5320a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:17.522722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10af1768-3a9e-4e6b-8786-74c38b5320a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:17.523410 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10af1768-3a9e-4e6b-8786-74c38b5320a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:17.527448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10af1768-3a9e-4e6b-8786-74c38b5320a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:17.533271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10af1768-3a9e-4e6b-8786-74c38b5320a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:17.783365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-10af1768-3a9e-4e6b-8786-74c38b5320a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:17.792562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-10af1768-3a9e-4e6b-8786-74c38b5320a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.299879 Jul 27 22:50:17.793154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 95/187] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:17 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:17.813976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-09732488-cf13-42e7-9e03-8c28e1878616 req-cd8a779e-eff9-4ec7-8582-1d7dd0111164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61a77c9-764c-4eca-a654-dabb4c208454", "tag": "7bf42a6f-daff-4fc8-9bfb-ebb04957bcc1"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:17.827710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-09732488-cf13-42e7-9e03-8c28e1878616 req-cd8a779e-eff9-4ec7-8582-1d7dd0111164 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:17.828155 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-09732488-cf13-42e7-9e03-8c28e1878616 req-cd8a779e-eff9-4ec7-8582-1d7dd0111164 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:17.851125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-09732488-cf13-42e7-9e03-8c28e1878616 req-cd8a779e-eff9-4ec7-8582-1d7dd0111164 service nova] Creating event network-changed:7bf42a6f-daff-4fc8-9bfb-ebb04957bcc1 for instance f61a77c9-764c-4eca-a654-dabb4c208454 on hv-cinder-85124 Jul 27 22:50:17.870374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-09732488-cf13-42e7-9e03-8c28e1878616 req-cd8a779e-eff9-4ec7-8582-1d7dd0111164 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.662261 Jul 27 22:50:17.889864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 93/188] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:18.062308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-69fc2835-1d24-41e2-b283-4ba091849809 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "347231ee-59a5-47e8-a0bc-b153fd43fe85"}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:18.067383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-69fc2835-1d24-41e2-b283-4ba091849809 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:18.081453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69fc2835-1d24-41e2-b283-4ba091849809 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:18.082516 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69fc2835-1d24-41e2-b283-4ba091849809 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:18.083761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69fc2835-1d24-41e2-b283-4ba091849809 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:18.085171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69fc2835-1d24-41e2-b283-4ba091849809 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:18.096876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:18.568311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-69fc2835-1d24-41e2-b283-4ba091849809 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "POST /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513285 Jul 27 22:50:18.570859 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 96/189] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 22:50:18 2022] POST /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:18.815517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6b88e0a3-b17e-4505-a837-509d217ae08d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:18.816298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6b88e0a3-b17e-4505-a837-509d217ae08d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:18.824392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b88e0a3-b17e-4505-a837-509d217ae08d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:18.824875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b88e0a3-b17e-4505-a837-509d217ae08d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:18.826222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b88e0a3-b17e-4505-a837-509d217ae08d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:18.826655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b88e0a3-b17e-4505-a837-509d217ae08d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:19.091222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6b88e0a3-b17e-4505-a837-509d217ae08d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:19.101722 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6b88e0a3-b17e-4505-a837-509d217ae08d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.289717 Jul 27 22:50:19.102702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 94/190] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:18 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:20.124190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1baa5c2f-cfee-4a8c-a461-1fa59e2f199b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:20.124910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1baa5c2f-cfee-4a8c-a461-1fa59e2f199b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:20.131584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1baa5c2f-cfee-4a8c-a461-1fa59e2f199b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:20.140901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1baa5c2f-cfee-4a8c-a461-1fa59e2f199b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:20.142035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1baa5c2f-cfee-4a8c-a461-1fa59e2f199b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:20.142475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1baa5c2f-cfee-4a8c-a461-1fa59e2f199b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:20.311805 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1baa5c2f-cfee-4a8c-a461-1fa59e2f199b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:20.322563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1baa5c2f-cfee-4a8c-a461-1fa59e2f199b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.202709 Jul 27 22:50:20.323662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 97/191] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:20 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:21.344123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-53249199-8efa-434a-8b09-fb3c55459427 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:21.346129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-53249199-8efa-434a-8b09-fb3c55459427 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:21.352896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-53249199-8efa-434a-8b09-fb3c55459427 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:21.353420 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-53249199-8efa-434a-8b09-fb3c55459427 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:21.354256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-53249199-8efa-434a-8b09-fb3c55459427 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:21.354844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-53249199-8efa-434a-8b09-fb3c55459427 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:21.516509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-53249199-8efa-434a-8b09-fb3c55459427 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:21.524785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-53249199-8efa-434a-8b09-fb3c55459427 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.185293 Jul 27 22:50:21.525452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 95/192] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:21 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:22.547720 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cb4dfb86-e2a7-4fd3-a843-e81a5773919a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:22.549473 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cb4dfb86-e2a7-4fd3-a843-e81a5773919a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:22.556807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb4dfb86-e2a7-4fd3-a843-e81a5773919a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:22.557245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb4dfb86-e2a7-4fd3-a843-e81a5773919a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:22.558163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb4dfb86-e2a7-4fd3-a843-e81a5773919a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:22.558735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb4dfb86-e2a7-4fd3-a843-e81a5773919a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:22.724169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cb4dfb86-e2a7-4fd3-a843-e81a5773919a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:22.746265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cb4dfb86-e2a7-4fd3-a843-e81a5773919a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.203868 Jul 27 22:50:22.746877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 98/193] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:22 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:23.767181 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-404cb5fc-89b5-4793-b525-a91b643ad3bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:23.767793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-404cb5fc-89b5-4793-b525-a91b643ad3bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:23.774003 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-404cb5fc-89b5-4793-b525-a91b643ad3bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:23.774449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-404cb5fc-89b5-4793-b525-a91b643ad3bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:23.775208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-404cb5fc-89b5-4793-b525-a91b643ad3bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:23.775640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-404cb5fc-89b5-4793-b525-a91b643ad3bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:23.898676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-404cb5fc-89b5-4793-b525-a91b643ad3bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:23.906743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-404cb5fc-89b5-4793-b525-a91b643ad3bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.143969 Jul 27 22:50:23.907311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 96/194] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:23 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:24.927183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bed30880-310c-4cd9-9536-72e233393a00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:24.927716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bed30880-310c-4cd9-9536-72e233393a00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:24.934205 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bed30880-310c-4cd9-9536-72e233393a00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:24.934646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bed30880-310c-4cd9-9536-72e233393a00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:24.935397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bed30880-310c-4cd9-9536-72e233393a00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:24.935824 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bed30880-310c-4cd9-9536-72e233393a00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:25.064109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bed30880-310c-4cd9-9536-72e233393a00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:25.071354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bed30880-310c-4cd9-9536-72e233393a00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.148057 Jul 27 22:50:25.071908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 99/195] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:24 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:26.091993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7061cd57-5039-4122-b46a-0c6badc29fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:26.092618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7061cd57-5039-4122-b46a-0c6badc29fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:26.098842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7061cd57-5039-4122-b46a-0c6badc29fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:26.099277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7061cd57-5039-4122-b46a-0c6badc29fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:26.100017 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7061cd57-5039-4122-b46a-0c6badc29fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:26.100438 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7061cd57-5039-4122-b46a-0c6badc29fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:26.224967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7061cd57-5039-4122-b46a-0c6badc29fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:26.232888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7061cd57-5039-4122-b46a-0c6badc29fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.144730 Jul 27 22:50:26.233457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 97/196] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:26 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:27.254147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ac31c859-eaec-4814-b109-6d7a4f4d4b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:27.254741 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ac31c859-eaec-4814-b109-6d7a4f4d4b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:27.261251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac31c859-eaec-4814-b109-6d7a4f4d4b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:27.261696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac31c859-eaec-4814-b109-6d7a4f4d4b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:27.262452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac31c859-eaec-4814-b109-6d7a4f4d4b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:27.263468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac31c859-eaec-4814-b109-6d7a4f4d4b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:27.391991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ac31c859-eaec-4814-b109-6d7a4f4d4b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:27.399997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ac31c859-eaec-4814-b109-6d7a4f4d4b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.149645 Jul 27 22:50:27.400586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 100/197] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:27 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:28.421447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c518fec0-6f71-4877-96c3-d83868e19699 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:28.422502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c518fec0-6f71-4877-96c3-d83868e19699 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:28.428905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c518fec0-6f71-4877-96c3-d83868e19699 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:28.429643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c518fec0-6f71-4877-96c3-d83868e19699 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:28.430478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c518fec0-6f71-4877-96c3-d83868e19699 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:28.430976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c518fec0-6f71-4877-96c3-d83868e19699 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:28.436159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:28.592768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c518fec0-6f71-4877-96c3-d83868e19699 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:28.599742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c518fec0-6f71-4877-96c3-d83868e19699 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.182768 Jul 27 22:50:28.613456 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 98/198] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:28 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:28.779152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9071dcd6-1575-4fd2-a8ab-cf036bfe8d66 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:28.779632 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9071dcd6-1575-4fd2-a8ab-cf036bfe8d66 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:28.786662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9071dcd6-1575-4fd2-a8ab-cf036bfe8d66 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:28.787378 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9071dcd6-1575-4fd2-a8ab-cf036bfe8d66 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:28.788475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9071dcd6-1575-4fd2-a8ab-cf036bfe8d66 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:28.789196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9071dcd6-1575-4fd2-a8ab-cf036bfe8d66 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:28.820337 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9071dcd6-1575-4fd2-a8ab-cf036bfe8d66 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Going to try to terminate instance {{(pid=129294) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 22:50:28.945876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9071dcd6-1575-4fd2-a8ab-cf036bfe8d66 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "DELETE /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 204 len: 0 microversion: 2.1 time: 0.170419 Jul 27 22:50:28.946987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 101/199] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 22:50:28 2022] DELETE /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 22:50:28.956230 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4da5295d-806b-4d40-9dd1-1f5812573bde tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:28.956868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4da5295d-806b-4d40-9dd1-1f5812573bde tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:28.963567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4da5295d-806b-4d40-9dd1-1f5812573bde tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:28.964012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4da5295d-806b-4d40-9dd1-1f5812573bde tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:28.964999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4da5295d-806b-4d40-9dd1-1f5812573bde tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:28.965661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4da5295d-806b-4d40-9dd1-1f5812573bde tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:29.140712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4da5295d-806b-4d40-9dd1-1f5812573bde tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:29.149952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4da5295d-806b-4d40-9dd1-1f5812573bde tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1554 microversion: 2.1 time: 0.197716 Jul 27 22:50:29.151246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 99/200] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:28 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:29.625212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-630df4b2-2171-4496-a3e5-408815a3ccee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:29.626532 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-630df4b2-2171-4496-a3e5-408815a3ccee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:29.635658 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-630df4b2-2171-4496-a3e5-408815a3ccee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:29.636124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-630df4b2-2171-4496-a3e5-408815a3ccee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:29.636946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-630df4b2-2171-4496-a3e5-408815a3ccee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:29.637375 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-630df4b2-2171-4496-a3e5-408815a3ccee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:29.778174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-630df4b2-2171-4496-a3e5-408815a3ccee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:29.786276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-630df4b2-2171-4496-a3e5-408815a3ccee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.168533 Jul 27 22:50:29.786860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 102/201] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:29 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:30.172673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d0889b91-1b4d-45e1-ae1c-47768365d55c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:30.173980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d0889b91-1b4d-45e1-ae1c-47768365d55c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:30.180061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d0889b91-1b4d-45e1-ae1c-47768365d55c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:30.180697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d0889b91-1b4d-45e1-ae1c-47768365d55c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:30.181610 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d0889b91-1b4d-45e1-ae1c-47768365d55c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:30.182236 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d0889b91-1b4d-45e1-ae1c-47768365d55c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:30.361620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d0889b91-1b4d-45e1-ae1c-47768365d55c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:30.370266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d0889b91-1b4d-45e1-ae1c-47768365d55c tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1554 microversion: 2.1 time: 0.202233 Jul 27 22:50:30.370836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 100/202] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:30 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:30.810443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8f0697c2-d6a2-4f55-92e3-a40192454807 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:30.811151 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8f0697c2-d6a2-4f55-92e3-a40192454807 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:30.818235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f0697c2-d6a2-4f55-92e3-a40192454807 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:30.818686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f0697c2-d6a2-4f55-92e3-a40192454807 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:30.819484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f0697c2-d6a2-4f55-92e3-a40192454807 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:30.819923 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f0697c2-d6a2-4f55-92e3-a40192454807 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:30.961076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8f0697c2-d6a2-4f55-92e3-a40192454807 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:30.970735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8f0697c2-d6a2-4f55-92e3-a40192454807 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.165831 Jul 27 22:50:30.971397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 103/203] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:30 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:31.391398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3e32efc6-ff75-47fd-a418-9b12389f602b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:31.392082 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3e32efc6-ff75-47fd-a418-9b12389f602b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:31.401609 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e32efc6-ff75-47fd-a418-9b12389f602b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:31.402117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e32efc6-ff75-47fd-a418-9b12389f602b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:31.403020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e32efc6-ff75-47fd-a418-9b12389f602b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:31.404360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e32efc6-ff75-47fd-a418-9b12389f602b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:31.559642 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3e32efc6-ff75-47fd-a418-9b12389f602b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:31.568901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3e32efc6-ff75-47fd-a418-9b12389f602b tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1554 microversion: 2.1 time: 0.181033 Jul 27 22:50:31.570016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 101/204] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:31 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:31.710142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-03e8e154-aad3-4049-a2b2-c57423a1081d req-d71ea83a-1640-4749-9558-a0b185fd7069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399d83c4-59b5-40ab-8d79-90974eba0ba8", "name": "network-vif-deleted", "tag": "2a3662c6-57e8-463f-ac7e-d0aa5bfe5bc9"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:31.726728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-03e8e154-aad3-4049-a2b2-c57423a1081d req-d71ea83a-1640-4749-9558-a0b185fd7069 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:31.727232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-03e8e154-aad3-4049-a2b2-c57423a1081d req-d71ea83a-1640-4749-9558-a0b185fd7069 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:31.741851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-03e8e154-aad3-4049-a2b2-c57423a1081d req-d71ea83a-1640-4749-9558-a0b185fd7069 service nova] Creating event network-vif-deleted:2a3662c6-57e8-463f-ac7e-d0aa5bfe5bc9 for instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 on hv-cinder-85124 Jul 27 22:50:31.749986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-03e8e154-aad3-4049-a2b2-c57423a1081d req-d71ea83a-1640-4749-9558-a0b185fd7069 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043377 Jul 27 22:50:31.751128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 104/205] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:31.991645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-24137bc9-d187-4908-a576-2ea8750819b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:31.993052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-24137bc9-d187-4908-a576-2ea8750819b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:32.000503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24137bc9-d187-4908-a576-2ea8750819b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:32.000954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24137bc9-d187-4908-a576-2ea8750819b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:32.001710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24137bc9-d187-4908-a576-2ea8750819b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:32.002134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24137bc9-d187-4908-a576-2ea8750819b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:32.165188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-24137bc9-d187-4908-a576-2ea8750819b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:32.174235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-24137bc9-d187-4908-a576-2ea8750819b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.186792 Jul 27 22:50:32.177271 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 102/206] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:31 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:32.593329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1191171b-24bc-47f8-b915-c1c5543df7fa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:32.594337 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1191171b-24bc-47f8-b915-c1c5543df7fa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:32.602350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1191171b-24bc-47f8-b915-c1c5543df7fa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:32.603038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1191171b-24bc-47f8-b915-c1c5543df7fa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:32.604036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1191171b-24bc-47f8-b915-c1c5543df7fa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:32.604472 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1191171b-24bc-47f8-b915-c1c5543df7fa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:32.675407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1191171b-24bc-47f8-b915-c1c5543df7fa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:32.684038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1191171b-24bc-47f8-b915-c1c5543df7fa tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1345 microversion: 2.1 time: 0.096240 Jul 27 22:50:32.685756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 105/207] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:32 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:33.195289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-daa02ee3-3119-43e1-97bb-9d628cc44eae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:33.195873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-daa02ee3-3119-43e1-97bb-9d628cc44eae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:33.201993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-daa02ee3-3119-43e1-97bb-9d628cc44eae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:33.202425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-daa02ee3-3119-43e1-97bb-9d628cc44eae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:33.203352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-daa02ee3-3119-43e1-97bb-9d628cc44eae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:33.203779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-daa02ee3-3119-43e1-97bb-9d628cc44eae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:33.370361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-daa02ee3-3119-43e1-97bb-9d628cc44eae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:33.379204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-daa02ee3-3119-43e1-97bb-9d628cc44eae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.187763 Jul 27 22:50:33.379772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 103/208] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:33 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:33.706062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c1417d5e-3f6b-448b-b63d-eca597e1350d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:33.706742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c1417d5e-3f6b-448b-b63d-eca597e1350d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:33.713261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c1417d5e-3f6b-448b-b63d-eca597e1350d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:33.713699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c1417d5e-3f6b-448b-b63d-eca597e1350d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:33.714445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c1417d5e-3f6b-448b-b63d-eca597e1350d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:33.714865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c1417d5e-3f6b-448b-b63d-eca597e1350d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:33.783430 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c1417d5e-3f6b-448b-b63d-eca597e1350d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:33.791270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c1417d5e-3f6b-448b-b63d-eca597e1350d tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1345 microversion: 2.1 time: 0.089073 Jul 27 22:50:33.792006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 106/209] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:33 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:34.400191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2cc08aa3-76a6-40e7-8607-6e0062d3ff14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:34.401035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2cc08aa3-76a6-40e7-8607-6e0062d3ff14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:34.407765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2cc08aa3-76a6-40e7-8607-6e0062d3ff14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:34.408349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2cc08aa3-76a6-40e7-8607-6e0062d3ff14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:34.409345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2cc08aa3-76a6-40e7-8607-6e0062d3ff14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:34.410280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2cc08aa3-76a6-40e7-8607-6e0062d3ff14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:34.643092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2cc08aa3-76a6-40e7-8607-6e0062d3ff14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:34.655374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2cc08aa3-76a6-40e7-8607-6e0062d3ff14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.258472 Jul 27 22:50:34.656268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 104/210] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:34 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:34.811487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e5950308-4079-455c-a825-f64d8ce2d74e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:34.812957 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e5950308-4079-455c-a825-f64d8ce2d74e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:34.820486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5950308-4079-455c-a825-f64d8ce2d74e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:34.821167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5950308-4079-455c-a825-f64d8ce2d74e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:34.822136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5950308-4079-455c-a825-f64d8ce2d74e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:34.822872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5950308-4079-455c-a825-f64d8ce2d74e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:34.856128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5950308-4079-455c-a825-f64d8ce2d74e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:34.857551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5950308-4079-455c-a825-f64d8ce2d74e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:34.858159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.objects.instance [None req-e5950308-4079-455c-a825-f64d8ce2d74e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lazy-loading 'fault' on Instance uuid 399d83c4-59b5-40ab-8d79-90974eba0ba8 {{(pid=129294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:50:34.921549 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e5950308-4079-455c-a825-f64d8ce2d74e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2f8af22ac3469cb3948d4c2d32d519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a5b2a855d34489af859c37cbc65553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:34.932983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e5950308-4079-455c-a825-f64d8ce2d74e tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 200 len: 1350 microversion: 2.1 time: 0.125409 Jul 27 22:50:34.935042 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 107/211] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:34 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 1350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:35.688879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4ed7152b-f438-4ddd-82e0-0a4f97232779 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:35.689811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4ed7152b-f438-4ddd-82e0-0a4f97232779 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:35.695945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ed7152b-f438-4ddd-82e0-0a4f97232779 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:35.696387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ed7152b-f438-4ddd-82e0-0a4f97232779 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:35.697184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ed7152b-f438-4ddd-82e0-0a4f97232779 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:35.697615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ed7152b-f438-4ddd-82e0-0a4f97232779 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:35.830885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4ed7152b-f438-4ddd-82e0-0a4f97232779 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:35.839146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4ed7152b-f438-4ddd-82e0-0a4f97232779 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.154461 Jul 27 22:50:35.839736 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 105/212] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:35 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:35.955735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-63d24ad9-e7c8-45a3-a6bf-e532407d2764 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:35.956262 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-63d24ad9-e7c8-45a3-a6bf-e532407d2764 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:35.963108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63d24ad9-e7c8-45a3-a6bf-e532407d2764 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:35.963546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63d24ad9-e7c8-45a3-a6bf-e532407d2764 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:35.964295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63d24ad9-e7c8-45a3-a6bf-e532407d2764 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:35.964776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63d24ad9-e7c8-45a3-a6bf-e532407d2764 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:35.980068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-63d24ad9-e7c8-45a3-a6bf-e532407d2764 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] HTTP exception thrown: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-63d24ad9-e7c8-45a3-a6bf-e532407d2764 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Request method failure captured: Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 HTTP/1.1 Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cDu9NawwG6x6c0xfQmzL3nibdVy36hBLHEWv-GBAuDXnMeD8PWwLJ0sDFtmPN9u8ZTYhNoiVTHTD0MCjE15n7sYy8U-8PpPOLw_b7tDzyUuzZX_wShef7u8eKgaxXcMJiu4Jgdfq5sARN8gq74-bcX_QGzXz5CD_MNj2N-DoY62Ybk Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 36a5b2a855d34489af859c37cbc65553 Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-DeleteServersTestJSON-2060523419 Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 22:50:35.985191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 22:50:35.986608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/36a5b2a855d34489af859c37cbc65553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_36a5b2a855d34489af859c37cbc65553", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/36a5b2a855d34489af859c37cbc65553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/36a5b2a855d34489af859c37cbc65553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:35.986608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-DeleteServersTestJSON-2060523419 Jul 27 22:50:35.986608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 36a5b2a855d34489af859c37cbc65553 Jul 27 22:50:35.986608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-DeleteServersTestJSON-2060523419 Jul 27 22:50:35.986608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-DeleteServersTestJSON-2060523419-project Jul 27 22:50:35.986608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 22:50:35.986608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 22:50:35.986608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 7c2f8af22ac3469cb3948d4c2d32d519 Jul 27 22:50:35.986608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-DeleteServersTestJSON-2060523419-project Jul 27 22:50:35.986608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 22:50:35.986608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:35.986608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '399d83c4-59b5-40ab-8d79-90974eba0ba8'} Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:35.987383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:35.988677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:35.989919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-63d24ad9-e7c8-45a3-a6bf-e532407d2764 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Returning 404 to user: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:35.989919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-63d24ad9-e7c8-45a3-a6bf-e532407d2764 tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 404 len: 111 microversion: 2.1 time: 0.034745 Jul 27 22:50:35.989919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 108/213] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:35 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 22:50:36.103974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e6d7bd91-3a32-4316-9e45-93447daea9eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:36.106233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e6d7bd91-3a32-4316-9e45-93447daea9eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:36.112573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e6d7bd91-3a32-4316-9e45-93447daea9eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:36.113009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e6d7bd91-3a32-4316-9e45-93447daea9eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:36.113830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e6d7bd91-3a32-4316-9e45-93447daea9eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:36.114296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e6d7bd91-3a32-4316-9e45-93447daea9eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:36.129301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-e6d7bd91-3a32-4316-9e45-93447daea9eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] HTTP exception thrown: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e6d7bd91-3a32-4316-9e45-93447daea9eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Request method failure captured: Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8/os-volume_attachments HTTP/1.1 Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cDu9NawwG6x6c0xfQmzL3nibdVy36hBLHEWv-GBAuDXnMeD8PWwLJ0sDFtmPN9u8ZTYhNoiVTHTD0MCjE15n7sYy8U-8PpPOLw_b7tDzyUuzZX_wShef7u8eKgaxXcMJiu4Jgdfq5sARN8gq74-bcX_QGzXz5CD_MNj2N-DoY62Ybk Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 36a5b2a855d34489af859c37cbc65553 Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-DeleteServersTestJSON-2060523419 Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 22:50:36.134411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 22:50:36.135580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/36a5b2a855d34489af859c37cbc65553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_36a5b2a855d34489af859c37cbc65553", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/36a5b2a855d34489af859c37cbc65553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/36a5b2a855d34489af859c37cbc65553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:36.135580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-DeleteServersTestJSON-2060523419 Jul 27 22:50:36.135580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 36a5b2a855d34489af859c37cbc65553 Jul 27 22:50:36.135580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-DeleteServersTestJSON-2060523419 Jul 27 22:50:36.135580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-DeleteServersTestJSON-2060523419-project Jul 27 22:50:36.135580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 22:50:36.135580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 22:50:36.135580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 7c2f8af22ac3469cb3948d4c2d32d519 Jul 27 22:50:36.135580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-DeleteServersTestJSON-2060523419-project Jul 27 22:50:36.135580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 22:50:36.135580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:36.135580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'server_id': '399d83c4-59b5-40ab-8d79-90974eba0ba8'} Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:36.136335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:36.137742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:36.140217 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e6d7bd91-3a32-4316-9e45-93447daea9eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Returning 404 to user: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:36.141677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e6d7bd91-3a32-4316-9e45-93447daea9eb tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042319 Jul 27 22:50:36.146082 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 106/214] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:50:36 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 22:50:36.755308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-831193351", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "networks": [{"uuid": "a925bc0c-dbf5-4a80-a685-8b5fad12016a"}]}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:36.809554 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.network.neutron [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] validate_networks() for [('a925bc0c-dbf5-4a80-a685-8b5fad12016a', None, None, None, None, None)] {{(pid=129294) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 22:50:36.861383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-95074384-a990-4157-955f-c3f6280e9a42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:36.862139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-95074384-a990-4157-955f-c3f6280e9a42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:36.864295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=63 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:36.871437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-95074384-a990-4157-955f-c3f6280e9a42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:36.872179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-95074384-a990-4157-955f-c3f6280e9a42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:36.873471 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-95074384-a990-4157-955f-c3f6280e9a42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:36.873945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-95074384-a990-4157-955f-c3f6280e9a42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:37.088773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-95074384-a990-4157-955f-c3f6280e9a42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:37.097196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-95074384-a990-4157-955f-c3f6280e9a42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.240633 Jul 27 22:50:37.097755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 107/215] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:36 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:37.255468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Flavor limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 22:50:37.255961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Image limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 22:50:37.256434 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Flavor pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 22:50:37.256914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Image pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 22:50:37.257353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 22:50:37.267084 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:37.267521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:37.268942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:37.269556 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:37.288926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Getting quotas for project e53f93856f7c473d8fe70557c4f973dd. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:50:37.292969 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Getting quotas for user 5916c224317640cf9c43596a1cbc585e and project e53f93856f7c473d8fe70557c4f973dd. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:50:37.304175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Going to run 1 instances... {{(pid=129294) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 22:50:37.306441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129294) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 22:50:37.351274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7ad2c4c5-6622-42ae-948d-f9bb080cfc38 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599798 Jul 27 22:50:37.351945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 109/216] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 22:50:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 22:50:37.362567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3950f2e0-2398-4710-bdc4-826164026c97 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:37.363174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3950f2e0-2398-4710-bdc4-826164026c97 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:37.390375 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a49574a7-9eee-4488-b556-07f64f89d12f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:37.390862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a49574a7-9eee-4488-b556-07f64f89d12f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:37.399063 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a49574a7-9eee-4488-b556-07f64f89d12f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:37.399517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a49574a7-9eee-4488-b556-07f64f89d12f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:37.400286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a49574a7-9eee-4488-b556-07f64f89d12f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:37.400747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a49574a7-9eee-4488-b556-07f64f89d12f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:37.421535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-a49574a7-9eee-4488-b556-07f64f89d12f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] HTTP exception thrown: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a49574a7-9eee-4488-b556-07f64f89d12f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Request method failure captured: Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: DELETE /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 HTTP/1.1 Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cDu9NawwG6x6c0xfQmzL3nibdVy36hBLHEWv-GBAuDXnMeD8PWwLJ0sDFtmPN9u8ZTYhNoiVTHTD0MCjE15n7sYy8U-8PpPOLw_b7tDzyUuzZX_wShef7u8eKgaxXcMJiu4Jgdfq5sARN8gq74-bcX_QGzXz5CD_MNj2N-DoY62Ybk Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 36a5b2a855d34489af859c37cbc65553 Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-DeleteServersTestJSON-2060523419 Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 22:50:37.423446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 22:50:37.424803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/36a5b2a855d34489af859c37cbc65553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_36a5b2a855d34489af859c37cbc65553", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/36a5b2a855d34489af859c37cbc65553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/36a5b2a855d34489af859c37cbc65553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:37.424803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-DeleteServersTestJSON-2060523419 Jul 27 22:50:37.424803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 36a5b2a855d34489af859c37cbc65553 Jul 27 22:50:37.424803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-DeleteServersTestJSON-2060523419 Jul 27 22:50:37.424803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-DeleteServersTestJSON-2060523419-project Jul 27 22:50:37.424803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 22:50:37.424803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 22:50:37.424803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 7c2f8af22ac3469cb3948d4c2d32d519 Jul 27 22:50:37.424803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-DeleteServersTestJSON-2060523419-project Jul 27 22:50:37.424803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 22:50:37.424803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:37.424803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '399d83c4-59b5-40ab-8d79-90974eba0ba8'} Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:37.425601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:37.426953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:37.428849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3950f2e0-2398-4710-bdc4-826164026c97 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:37.429762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a49574a7-9eee-4488-b556-07f64f89d12f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Returning 404 to user: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:37.430813 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a49574a7-9eee-4488-b556-07f64f89d12f tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "DELETE /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 404 len: 111 microversion: 2.1 time: 0.045062 Jul 27 22:50:37.435046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 110/217] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 22:50:37 2022] DELETE /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 22:50:37.435729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3950f2e0-2398-4710-bdc4-826164026c97 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1213 microversion: 2.1 time: 0.076917 Jul 27 22:50:37.437445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 108/218] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:37 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:37.454950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5f42d921-91c6-4360-ba63-8401de0c301a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:37.457197 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5f42d921-91c6-4360-ba63-8401de0c301a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] [instance: 399d83c4-59b5-40ab-8d79-90974eba0ba8] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:37.463551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f42d921-91c6-4360-ba63-8401de0c301a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:37.463993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f42d921-91c6-4360-ba63-8401de0c301a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:37.464794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f42d921-91c6-4360-ba63-8401de0c301a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:37.465471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f42d921-91c6-4360-ba63-8401de0c301a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:37.481588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-5f42d921-91c6-4360-ba63-8401de0c301a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] HTTP exception thrown: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5f42d921-91c6-4360-ba63-8401de0c301a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Request method failure captured: Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 HTTP/1.1 Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cDu9NawwG6x6c0xfQmzL3nibdVy36hBLHEWv-GBAuDXnMeD8PWwLJ0sDFtmPN9u8ZTYhNoiVTHTD0MCjE15n7sYy8U-8PpPOLw_b7tDzyUuzZX_wShef7u8eKgaxXcMJiu4Jgdfq5sARN8gq74-bcX_QGzXz5CD_MNj2N-DoY62Ybk Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 36a5b2a855d34489af859c37cbc65553 Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-DeleteServersTestJSON-2060523419 Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 22:50:37.483241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 22:50:37.484662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/36a5b2a855d34489af859c37cbc65553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_36a5b2a855d34489af859c37cbc65553", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/36a5b2a855d34489af859c37cbc65553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/36a5b2a855d34489af859c37cbc65553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:37.484662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-DeleteServersTestJSON-2060523419 Jul 27 22:50:37.484662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 36a5b2a855d34489af859c37cbc65553 Jul 27 22:50:37.484662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-DeleteServersTestJSON-2060523419 Jul 27 22:50:37.484662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-DeleteServersTestJSON-2060523419-project Jul 27 22:50:37.484662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 22:50:37.484662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 22:50:37.484662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 7c2f8af22ac3469cb3948d4c2d32d519 Jul 27 22:50:37.484662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-DeleteServersTestJSON-2060523419-project Jul 27 22:50:37.484662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 22:50:37.484662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:37.484662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '399d83c4-59b5-40ab-8d79-90974eba0ba8'} Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:37.485504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. Jul 27 22:50:37.486676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:37.489239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5f42d921-91c6-4360-ba63-8401de0c301a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] Returning 404 to user: Instance 399d83c4-59b5-40ab-8d79-90974eba0ba8 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:37.490884 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5f42d921-91c6-4360-ba63-8401de0c301a tempest-DeleteServersTestJSON-2060523419 tempest-DeleteServersTestJSON-2060523419-project] 10.222.0.47 "GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8" status: 404 len: 111 microversion: 2.1 time: 0.051045 Jul 27 22:50:37.491594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 111/219] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:37 2022] GET /compute/v2.1/servers/399d83c4-59b5-40ab-8d79-90974eba0ba8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 22:50:38.118671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-308bb295-d239-4a19-b029-70f9e8de90ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:38.119278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-308bb295-d239-4a19-b029-70f9e8de90ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:38.125228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-308bb295-d239-4a19-b029-70f9e8de90ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:38.125850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-308bb295-d239-4a19-b029-70f9e8de90ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:38.126787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-308bb295-d239-4a19-b029-70f9e8de90ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:38.127208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-308bb295-d239-4a19-b029-70f9e8de90ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:38.289052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-308bb295-d239-4a19-b029-70f9e8de90ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:38.299212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-308bb295-d239-4a19-b029-70f9e8de90ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.184210 Jul 27 22:50:38.300293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 109/220] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:38 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:38.457573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-65ec6c5e-d2b6-4dc1-9948-2da466ab7883 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:38.458175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-65ec6c5e-d2b6-4dc1-9948-2da466ab7883 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:38.465085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65ec6c5e-d2b6-4dc1-9948-2da466ab7883 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:38.469755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65ec6c5e-d2b6-4dc1-9948-2da466ab7883 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:38.470742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65ec6c5e-d2b6-4dc1-9948-2da466ab7883 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:38.471718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65ec6c5e-d2b6-4dc1-9948-2da466ab7883 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:38.563474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-65ec6c5e-d2b6-4dc1-9948-2da466ab7883 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:38.569076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:38.577251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-65ec6c5e-d2b6-4dc1-9948-2da466ab7883 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1273 microversion: 2.1 time: 0.123384 Jul 27 22:50:38.578032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 112/221] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:38 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:39.321763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d7e06c13-20d2-4189-8373-7e57ca1e994b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:39.323219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d7e06c13-20d2-4189-8373-7e57ca1e994b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:39.329799 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d7e06c13-20d2-4189-8373-7e57ca1e994b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:39.330627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d7e06c13-20d2-4189-8373-7e57ca1e994b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:39.331405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d7e06c13-20d2-4189-8373-7e57ca1e994b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:39.331838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d7e06c13-20d2-4189-8373-7e57ca1e994b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:39.530704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d7e06c13-20d2-4189-8373-7e57ca1e994b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:39.538852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d7e06c13-20d2-4189-8373-7e57ca1e994b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.222366 Jul 27 22:50:39.539425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 110/222] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:39 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:39.606256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cdb0f5c3-7af9-4544-9db3-17ddde602f07 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:39.608771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cdb0f5c3-7af9-4544-9db3-17ddde602f07 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:39.616746 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:39.624918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cdb0f5c3-7af9-4544-9db3-17ddde602f07 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:39.625921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cdb0f5c3-7af9-4544-9db3-17ddde602f07 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:39.627687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cdb0f5c3-7af9-4544-9db3-17ddde602f07 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:39.628209 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cdb0f5c3-7af9-4544-9db3-17ddde602f07 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:39.735207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cdb0f5c3-7af9-4544-9db3-17ddde602f07 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:39.748152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cdb0f5c3-7af9-4544-9db3-17ddde602f07 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1271 microversion: 2.1 time: 0.149399 Jul 27 22:50:39.749802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 113/223] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:39 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:40.561515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1f22e8d5-853c-4e6f-b8ec-71817188fc4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:40.562293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1f22e8d5-853c-4e6f-b8ec-71817188fc4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:40.571435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f22e8d5-853c-4e6f-b8ec-71817188fc4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:40.572485 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f22e8d5-853c-4e6f-b8ec-71817188fc4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:40.573814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f22e8d5-853c-4e6f-b8ec-71817188fc4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:40.574429 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f22e8d5-853c-4e6f-b8ec-71817188fc4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:40.770831 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-657958d9-a895-49ef-9e36-c4b7a7a5ec44 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:40.771442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-657958d9-a895-49ef-9e36-c4b7a7a5ec44 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:40.782567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-657958d9-a895-49ef-9e36-c4b7a7a5ec44 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:40.786079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-657958d9-a895-49ef-9e36-c4b7a7a5ec44 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:40.789305 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-657958d9-a895-49ef-9e36-c4b7a7a5ec44 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:40.790033 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-657958d9-a895-49ef-9e36-c4b7a7a5ec44 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:40.904562 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1f22e8d5-853c-4e6f-b8ec-71817188fc4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:40.921782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1f22e8d5-853c-4e6f-b8ec-71817188fc4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.363008 Jul 27 22:50:40.923501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 111/224] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:40 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:41.179267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-657958d9-a895-49ef-9e36-c4b7a7a5ec44 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:41.189755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-657958d9-a895-49ef-9e36-c4b7a7a5ec44 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1313 microversion: 2.1 time: 0.423002 Jul 27 22:50:41.190534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 114/225] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:40 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:41.726374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-33db73b3-d2f0-44ff-828b-c23804fddfb9 req-d9f07a3c-47ac-4f96-9469-babb1498ae12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abfdfde9-805c-4c3c-8e99-a3aab1d2a588", "tag": "4a71fb66-8879-4cf7-a8b3-af932c2e445a"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:41.746180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-33db73b3-d2f0-44ff-828b-c23804fddfb9 req-d9f07a3c-47ac-4f96-9469-babb1498ae12 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:41.747741 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-33db73b3-d2f0-44ff-828b-c23804fddfb9 req-d9f07a3c-47ac-4f96-9469-babb1498ae12 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:41.777703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-33db73b3-d2f0-44ff-828b-c23804fddfb9 req-d9f07a3c-47ac-4f96-9469-babb1498ae12 service nova] Creating event network-changed:4a71fb66-8879-4cf7-a8b3-af932c2e445a for instance abfdfde9-805c-4c3c-8e99-a3aab1d2a588 on hv-cinder-85124 Jul 27 22:50:41.787074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-33db73b3-d2f0-44ff-828b-c23804fddfb9 req-d9f07a3c-47ac-4f96-9469-babb1498ae12 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064610 Jul 27 22:50:41.788206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 112/226] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:50:41.953102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-82f46585-aa59-437c-bc16-786209ba0f38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:41.953682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-82f46585-aa59-437c-bc16-786209ba0f38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:41.968402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82f46585-aa59-437c-bc16-786209ba0f38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:41.968796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82f46585-aa59-437c-bc16-786209ba0f38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:41.969576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82f46585-aa59-437c-bc16-786209ba0f38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:41.973263 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82f46585-aa59-437c-bc16-786209ba0f38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:42.207452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-82f46585-aa59-437c-bc16-786209ba0f38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:42.216484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4c054cde-ab5b-4e29-91fd-31198a840a24 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:42.217318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4c054cde-ab5b-4e29-91fd-31198a840a24 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:42.224609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-82f46585-aa59-437c-bc16-786209ba0f38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.285695 Jul 27 22:50:42.230057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c054cde-ab5b-4e29-91fd-31198a840a24 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:42.231114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 115/227] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:41 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:42.232404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c054cde-ab5b-4e29-91fd-31198a840a24 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:42.233355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c054cde-ab5b-4e29-91fd-31198a840a24 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:42.233925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c054cde-ab5b-4e29-91fd-31198a840a24 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:42.406879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4c054cde-ab5b-4e29-91fd-31198a840a24 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:42.417587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4c054cde-ab5b-4e29-91fd-31198a840a24 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1313 microversion: 2.1 time: 0.205444 Jul 27 22:50:42.418178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 113/228] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:42 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:43.251798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ade41348-4cc3-431c-bd3f-5c6607d13b24 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:43.252582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ade41348-4cc3-431c-bd3f-5c6607d13b24 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:43.263692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ade41348-4cc3-431c-bd3f-5c6607d13b24 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:43.264138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ade41348-4cc3-431c-bd3f-5c6607d13b24 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:43.265061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ade41348-4cc3-431c-bd3f-5c6607d13b24 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:43.265563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ade41348-4cc3-431c-bd3f-5c6607d13b24 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:43.444642 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6abe9006-b683-4c20-a463-383b0453f94a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:43.445472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6abe9006-b683-4c20-a463-383b0453f94a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:43.454715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6abe9006-b683-4c20-a463-383b0453f94a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:43.455164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6abe9006-b683-4c20-a463-383b0453f94a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:43.455931 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6abe9006-b683-4c20-a463-383b0453f94a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:43.456358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6abe9006-b683-4c20-a463-383b0453f94a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:43.577267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ade41348-4cc3-431c-bd3f-5c6607d13b24 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:43.584934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ade41348-4cc3-431c-bd3f-5c6607d13b24 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.337039 Jul 27 22:50:43.585498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 116/229] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:43 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:43.894219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6abe9006-b683-4c20-a463-383b0453f94a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:43.903224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6abe9006-b683-4c20-a463-383b0453f94a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1313 microversion: 2.1 time: 0.462692 Jul 27 22:50:43.909551 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 114/230] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:43 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:44.607388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b863ec44-0778-48ab-a9a2-5f34c0d3767b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:44.607901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b863ec44-0778-48ab-a9a2-5f34c0d3767b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:44.614297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b863ec44-0778-48ab-a9a2-5f34c0d3767b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:44.614749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b863ec44-0778-48ab-a9a2-5f34c0d3767b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:44.615508 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b863ec44-0778-48ab-a9a2-5f34c0d3767b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:44.615944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b863ec44-0778-48ab-a9a2-5f34c0d3767b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:44.753751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b863ec44-0778-48ab-a9a2-5f34c0d3767b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:44.761702 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b863ec44-0778-48ab-a9a2-5f34c0d3767b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.158798 Jul 27 22:50:44.762261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 117/231] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:44 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:44.926232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cc6b8ab3-8f87-4008-9fc1-dd7bf62cdfd1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:44.926835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cc6b8ab3-8f87-4008-9fc1-dd7bf62cdfd1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:44.933789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cc6b8ab3-8f87-4008-9fc1-dd7bf62cdfd1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:44.934224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cc6b8ab3-8f87-4008-9fc1-dd7bf62cdfd1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:44.934991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cc6b8ab3-8f87-4008-9fc1-dd7bf62cdfd1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:44.935415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cc6b8ab3-8f87-4008-9fc1-dd7bf62cdfd1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:45.084039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cc6b8ab3-8f87-4008-9fc1-dd7bf62cdfd1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:45.093784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cc6b8ab3-8f87-4008-9fc1-dd7bf62cdfd1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1313 microversion: 2.1 time: 0.171113 Jul 27 22:50:45.094276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 115/232] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:44 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:45.433101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5db5f477-09f3-4c77-9226-24edacb8fc19 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Action: 'create', calling method: .version_select at 0x7f696a236ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1000757344"}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:45.716956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5db5f477-09f3-4c77-9226-24edacb8fc19 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.396713 Jul 27 22:50:45.717574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 118/233] 10.222.0.47 () {60 vars in 1155 bytes} [Wed Jul 27 22:50:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 398 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 27 22:50:45.729873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d60944b6-2fb2-4ab5-852e-113cacd504e9 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a39da60>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:45.778671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d60944b6-2fb2-4ab5-852e-113cacd504e9 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93" status: 200 len: 345 microversion: 2.1 time: 0.051985 Jul 27 22:50:45.779453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 116/234] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 22:50:45 2022] GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:45.783649 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5b5f42da-396e-437d-86dc-f43ca9a7209d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:45.784258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5b5f42da-396e-437d-86dc-f43ca9a7209d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:45.791060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b5f42da-396e-437d-86dc-f43ca9a7209d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:45.791506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b5f42da-396e-437d-86dc-f43ca9a7209d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:45.792255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b5f42da-396e-437d-86dc-f43ca9a7209d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:45.792722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b5f42da-396e-437d-86dc-f43ca9a7209d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:45.917164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5b5f42da-396e-437d-86dc-f43ca9a7209d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:45.925224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5b5f42da-396e-437d-86dc-f43ca9a7209d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.145413 Jul 27 22:50:45.925784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 119/235] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:45 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:46.114618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-afeff616-093c-4338-aaf4-70c6f5d171df tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:46.115226 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-afeff616-093c-4338-aaf4-70c6f5d171df tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:46.121251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afeff616-093c-4338-aaf4-70c6f5d171df tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:46.121690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afeff616-093c-4338-aaf4-70c6f5d171df tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:46.122441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afeff616-093c-4338-aaf4-70c6f5d171df tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:46.122868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afeff616-093c-4338-aaf4-70c6f5d171df tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:46.251748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-afeff616-093c-4338-aaf4-70c6f5d171df tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:46.259164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-afeff616-093c-4338-aaf4-70c6f5d171df tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1313 microversion: 2.1 time: 0.148339 Jul 27 22:50:46.259714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 117/236] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:46 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:46.792970 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4196aa35-922c-486a-b657-4ebcfa62a83e tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a236310>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:46.839710 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4196aa35-922c-486a-b657-4ebcfa62a83e tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93" status: 200 len: 345 microversion: 2.1 time: 0.050961 Jul 27 22:50:46.840275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 120/237] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 22:50:46 2022] GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:46.946460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d74feb93-608a-4471-a56b-ea6c2ee479c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:46.947112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d74feb93-608a-4471-a56b-ea6c2ee479c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:46.954201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d74feb93-608a-4471-a56b-ea6c2ee479c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:46.954675 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d74feb93-608a-4471-a56b-ea6c2ee479c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:46.955444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d74feb93-608a-4471-a56b-ea6c2ee479c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:46.955873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d74feb93-608a-4471-a56b-ea6c2ee479c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:46.960376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:47.103208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d74feb93-608a-4471-a56b-ea6c2ee479c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:47.111420 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d74feb93-608a-4471-a56b-ea6c2ee479c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.169201 Jul 27 22:50:47.112464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 118/238] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:46 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:47.280176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-de6719ef-e1ab-41bd-bfd4-36264bd78b73 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:47.280922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-de6719ef-e1ab-41bd-bfd4-36264bd78b73 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:47.282765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=2 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:47.288246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de6719ef-e1ab-41bd-bfd4-36264bd78b73 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:47.288714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de6719ef-e1ab-41bd-bfd4-36264bd78b73 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:47.289500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de6719ef-e1ab-41bd-bfd4-36264bd78b73 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:47.289929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de6719ef-e1ab-41bd-bfd4-36264bd78b73 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:47.306740 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=6 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:47.567619 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-de6719ef-e1ab-41bd-bfd4-36264bd78b73 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:47.575029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-de6719ef-e1ab-41bd-bfd4-36264bd78b73 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1313 microversion: 2.1 time: 0.298737 Jul 27 22:50:47.575585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 121/239] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:47 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:47.853700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bf7a0570-4115-495d-acfe-05eeadf6a6cb tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a39dc10>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:47.859642 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:47.901956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bf7a0570-4115-495d-acfe-05eeadf6a6cb tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93" status: 200 len: 345 microversion: 2.1 time: 0.051723 Jul 27 22:50:47.902748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 119/240] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 22:50:47 2022] GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:48.133199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7ab55fc4-ca4b-479f-ae06-8951541c37d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:48.133806 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7ab55fc4-ca4b-479f-ae06-8951541c37d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:48.140876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ab55fc4-ca4b-479f-ae06-8951541c37d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:48.141326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ab55fc4-ca4b-479f-ae06-8951541c37d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:48.142088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ab55fc4-ca4b-479f-ae06-8951541c37d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:48.142518 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ab55fc4-ca4b-479f-ae06-8951541c37d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:48.290054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7ab55fc4-ca4b-479f-ae06-8951541c37d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:48.299425 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7ab55fc4-ca4b-479f-ae06-8951541c37d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.169855 Jul 27 22:50:48.300619 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 122/241] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:48 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:48.596175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ae7b99a2-f2bd-45c4-9410-2a2e0437f79f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:48.597023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ae7b99a2-f2bd-45c4-9410-2a2e0437f79f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:48.610073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae7b99a2-f2bd-45c4-9410-2a2e0437f79f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:48.610516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae7b99a2-f2bd-45c4-9410-2a2e0437f79f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:48.611275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae7b99a2-f2bd-45c4-9410-2a2e0437f79f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:48.611750 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae7b99a2-f2bd-45c4-9410-2a2e0437f79f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:48.756225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ae7b99a2-f2bd-45c4-9410-2a2e0437f79f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:48.763690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ae7b99a2-f2bd-45c4-9410-2a2e0437f79f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1313 microversion: 2.1 time: 0.171333 Jul 27 22:50:48.764251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 120/242] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:48 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:48.917456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5bb590d3-b62f-493c-90b0-6242607a4529 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a3d4e50>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:48.963076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5bb590d3-b62f-493c-90b0-6242607a4529 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93" status: 200 len: 345 microversion: 2.1 time: 0.049412 Jul 27 22:50:48.963624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 123/243] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 22:50:48 2022] GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:49.320679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7a63845e-ad2b-4330-be13-1a9da6266b17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:49.321294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7a63845e-ad2b-4330-be13-1a9da6266b17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:49.327793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a63845e-ad2b-4330-be13-1a9da6266b17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:49.328232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a63845e-ad2b-4330-be13-1a9da6266b17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:49.329077 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a63845e-ad2b-4330-be13-1a9da6266b17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:49.329512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a63845e-ad2b-4330-be13-1a9da6266b17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:49.458464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7a63845e-ad2b-4330-be13-1a9da6266b17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:49.465847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7a63845e-ad2b-4330-be13-1a9da6266b17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.149049 Jul 27 22:50:49.467297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 121/244] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:49 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:49.784721 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e99572eb-cbb3-4f24-b822-e93674850ca2 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:49.785339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e99572eb-cbb3-4f24-b822-e93674850ca2 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:49.791478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e99572eb-cbb3-4f24-b822-e93674850ca2 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:49.791837 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e99572eb-cbb3-4f24-b822-e93674850ca2 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:49.792617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e99572eb-cbb3-4f24-b822-e93674850ca2 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:49.793055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e99572eb-cbb3-4f24-b822-e93674850ca2 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:49.919760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e99572eb-cbb3-4f24-b822-e93674850ca2 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:49.927090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e99572eb-cbb3-4f24-b822-e93674850ca2 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1313 microversion: 2.1 time: 0.146657 Jul 27 22:50:49.927644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 124/245] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:49 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:49.977489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e6394d7a-11e7-46b7-80e4-1075cae0c1f0 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a39d9d0>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:50.021929 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e6394d7a-11e7-46b7-80e4-1075cae0c1f0 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93" status: 200 len: 345 microversion: 2.1 time: 0.048450 Jul 27 22:50:50.022482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 122/246] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 22:50:49 2022] GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:50.487235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4eaf3583-bd6a-4bca-afd5-cc4bb5d2215d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:50.487835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4eaf3583-bd6a-4bca-afd5-cc4bb5d2215d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:50.493759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4eaf3583-bd6a-4bca-afd5-cc4bb5d2215d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:50.494201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4eaf3583-bd6a-4bca-afd5-cc4bb5d2215d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:50.494974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4eaf3583-bd6a-4bca-afd5-cc4bb5d2215d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:50.495400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4eaf3583-bd6a-4bca-afd5-cc4bb5d2215d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:50.642825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4eaf3583-bd6a-4bca-afd5-cc4bb5d2215d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:50.656726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4eaf3583-bd6a-4bca-afd5-cc4bb5d2215d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.173212 Jul 27 22:50:50.658142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 125/247] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:50 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:50.949060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b41bcbfe-ce41-4cdc-9b45-781960a23d4c tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:50.949581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b41bcbfe-ce41-4cdc-9b45-781960a23d4c tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:50.956013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b41bcbfe-ce41-4cdc-9b45-781960a23d4c tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:50.956457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b41bcbfe-ce41-4cdc-9b45-781960a23d4c tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:50.957246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b41bcbfe-ce41-4cdc-9b45-781960a23d4c tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:50.957679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b41bcbfe-ce41-4cdc-9b45-781960a23d4c tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:51.035883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-116072e6-b04a-4e4a-947c-0908261199ce tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a3f4940>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:51.087464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-116072e6-b04a-4e4a-947c-0908261199ce tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93" status: 200 len: 346 microversion: 2.1 time: 0.054935 Jul 27 22:50:51.088306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 126/248] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 22:50:51 2022] GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:50:51.095954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b41bcbfe-ce41-4cdc-9b45-781960a23d4c tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:51.106445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ebf736fc-e20d-4e3f-8a97-4948a6d0bce8 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Action: 'create', calling method: .version_select at 0x7f696a2ad0d0>, body: {"snapshot": {"volume_id": "0d247d79-7302-47c8-ace1-017c448ddd93", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1085307002"}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:51.111352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b41bcbfe-ce41-4cdc-9b45-781960a23d4c tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1313 microversion: 2.1 time: 0.166708 Jul 27 22:50:51.112260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 123/249] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:50 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:51.271251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ebf736fc-e20d-4e3f-8a97-4948a6d0bce8 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.170666 Jul 27 22:50:51.272015 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 127/250] 10.222.0.47 () {60 vars in 1162 bytes} [Wed Jul 27 22:50:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:50:51.284364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ebdcfde5-dd67-406a-8d83-0053e1e0efa5 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a39dc10>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:51.318938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ebdcfde5-dd67-406a-8d83-0053e1e0efa5 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721" status: 200 len: 287 microversion: 2.1 time: 0.038828 Jul 27 22:50:51.319717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 124/251] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 22:50:51 2022] GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:51.331055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7f49064a-f5f2-416f-bec7-28383ec90c37 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a3d4af0>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:51.364079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7f49064a-f5f2-416f-bec7-28383ec90c37 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036866 Jul 27 22:50:51.364654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 128/252] 10.222.0.47 () {58 vars in 1140 bytes} [Wed Jul 27 22:50:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:51.375397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5fa084e2-9672-43a3-a3f7-f6e79b272b45 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a33de50>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:51.410828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5fa084e2-9672-43a3-a3f7-f6e79b272b45 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721" status: 200 len: 287 microversion: 2.1 time: 0.038855 Jul 27 22:50:51.411497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 125/253] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 22:50:51 2022] GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:51.678312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-815c5a71-c34c-4c5e-a425-ac8b68c05ee4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:51.678912 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-815c5a71-c34c-4c5e-a425-ac8b68c05ee4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:51.685657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-815c5a71-c34c-4c5e-a425-ac8b68c05ee4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:51.686106 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-815c5a71-c34c-4c5e-a425-ac8b68c05ee4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:51.686887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-815c5a71-c34c-4c5e-a425-ac8b68c05ee4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:51.687322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-815c5a71-c34c-4c5e-a425-ac8b68c05ee4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:51.819797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-815c5a71-c34c-4c5e-a425-ac8b68c05ee4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:51.827826 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-815c5a71-c34c-4c5e-a425-ac8b68c05ee4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.153477 Jul 27 22:50:51.828363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 129/254] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:51 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:52.132796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-aabba93e-ddeb-4994-9d3a-e17fc9e8c4eb tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:52.133413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-aabba93e-ddeb-4994-9d3a-e17fc9e8c4eb tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:52.139937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aabba93e-ddeb-4994-9d3a-e17fc9e8c4eb tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:52.140389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aabba93e-ddeb-4994-9d3a-e17fc9e8c4eb tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:52.141228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aabba93e-ddeb-4994-9d3a-e17fc9e8c4eb tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:52.141642 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aabba93e-ddeb-4994-9d3a-e17fc9e8c4eb tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:52.273193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-aabba93e-ddeb-4994-9d3a-e17fc9e8c4eb tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:52.280530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-aabba93e-ddeb-4994-9d3a-e17fc9e8c4eb tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1313 microversion: 2.1 time: 0.151644 Jul 27 22:50:52.281135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 126/255] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:52 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:52.424495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6058a771-44f0-4d36-9f44-98c7c875655f tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a3b1550>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:52.458941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6058a771-44f0-4d36-9f44-98c7c875655f tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721" status: 200 len: 287 microversion: 2.1 time: 0.038216 Jul 27 22:50:52.459503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 130/256] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 22:50:52 2022] GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:52.848389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-aa6031ab-c7e9-4c30-af18-8665e6a7df95 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:52.849281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-aa6031ab-c7e9-4c30-af18-8665e6a7df95 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:52.855408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa6031ab-c7e9-4c30-af18-8665e6a7df95 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:52.855862 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa6031ab-c7e9-4c30-af18-8665e6a7df95 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:52.856654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa6031ab-c7e9-4c30-af18-8665e6a7df95 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:52.857639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa6031ab-c7e9-4c30-af18-8665e6a7df95 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:52.999074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-aa6031ab-c7e9-4c30-af18-8665e6a7df95 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:53.006205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-aa6031ab-c7e9-4c30-af18-8665e6a7df95 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.161597 Jul 27 22:50:53.006770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 127/257] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:52 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:53.302166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4b34dbba-e25f-48ec-884f-a3179a2c7f3d tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:53.302778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4b34dbba-e25f-48ec-884f-a3179a2c7f3d tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:53.310573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b34dbba-e25f-48ec-884f-a3179a2c7f3d tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:53.311022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b34dbba-e25f-48ec-884f-a3179a2c7f3d tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:53.312179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b34dbba-e25f-48ec-884f-a3179a2c7f3d tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:53.312651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b34dbba-e25f-48ec-884f-a3179a2c7f3d tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:53.423135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-3cfe45b6-83f0-44c5-9a89-a1e491b59f50 req-87b669e4-6147-4ec6-8338-4ddfbceb5d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abfdfde9-805c-4c3c-8e99-a3aab1d2a588", "name": "network-vif-plugged", "status": "completed", "tag": "4a71fb66-8879-4cf7-a8b3-af932c2e445a"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:53.436405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-3cfe45b6-83f0-44c5-9a89-a1e491b59f50 req-87b669e4-6147-4ec6-8338-4ddfbceb5d3c service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:53.437405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-3cfe45b6-83f0-44c5-9a89-a1e491b59f50 req-87b669e4-6147-4ec6-8338-4ddfbceb5d3c service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:53.453421 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-3cfe45b6-83f0-44c5-9a89-a1e491b59f50 req-87b669e4-6147-4ec6-8338-4ddfbceb5d3c service nova] Creating event network-vif-plugged:4a71fb66-8879-4cf7-a8b3-af932c2e445a for instance abfdfde9-805c-4c3c-8e99-a3aab1d2a588 on hv-cinder-85124 Jul 27 22:50:53.460155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4b34dbba-e25f-48ec-884f-a3179a2c7f3d tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:53.466590 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-3cfe45b6-83f0-44c5-9a89-a1e491b59f50 req-87b669e4-6147-4ec6-8338-4ddfbceb5d3c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047058 Jul 27 22:50:53.470612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4b34dbba-e25f-48ec-884f-a3179a2c7f3d tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1313 microversion: 2.1 time: 0.173069 Jul 27 22:50:53.471186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 131/258] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:53 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:53.472701 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 128/259] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:53.476733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bfc6a1ca-838f-4b69-beab-18614bc9ab4a tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a4f7160>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:53.509126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bfc6a1ca-838f-4b69-beab-18614bc9ab4a tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721" status: 200 len: 287 microversion: 2.1 time: 0.036879 Jul 27 22:50:53.509683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 132/260] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 22:50:53 2022] GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:54.029319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4e24d949-6b72-4dea-a4f5-8e47d6c48389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:54.030078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4e24d949-6b72-4dea-a4f5-8e47d6c48389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:54.036708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4e24d949-6b72-4dea-a4f5-8e47d6c48389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:54.037219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4e24d949-6b72-4dea-a4f5-8e47d6c48389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:54.038042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4e24d949-6b72-4dea-a4f5-8e47d6c48389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:54.038594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4e24d949-6b72-4dea-a4f5-8e47d6c48389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:54.184077 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4e24d949-6b72-4dea-a4f5-8e47d6c48389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:54.193505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4e24d949-6b72-4dea-a4f5-8e47d6c48389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1522 microversion: 2.1 time: 0.168493 Jul 27 22:50:54.204573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 129/261] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:54 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:54.495737 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-581b74df-86d4-452d-8a15-630bcd142c31 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:54.496715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-581b74df-86d4-452d-8a15-630bcd142c31 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:54.506320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-581b74df-86d4-452d-8a15-630bcd142c31 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:54.507078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-581b74df-86d4-452d-8a15-630bcd142c31 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:54.508088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-581b74df-86d4-452d-8a15-630bcd142c31 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:54.508652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-581b74df-86d4-452d-8a15-630bcd142c31 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:54.523509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-556e642b-e8e7-43be-9fd0-549e63a14996 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a339f70>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:54.571803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-556e642b-e8e7-43be-9fd0-549e63a14996 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721" status: 200 len: 288 microversion: 2.1 time: 0.053432 Jul 27 22:50:54.572629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 130/262] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 22:50:54 2022] GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721 => generated 288 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:50:54.585177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bfa11d43-ef0e-46ee-94de-46df74df9934 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696c956ee0>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:54.681427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bfa11d43-ef0e-46ee-94de-46df74df9934 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721" status: 202 len: 0 microversion: 2.1 time: 0.101250 Jul 27 22:50:54.682219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 131/263] 10.222.0.47 () {58 vars in 1254 bytes} [Wed Jul 27 22:50:54 2022] DELETE /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 22:50:54.688781 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-581b74df-86d4-452d-8a15-630bcd142c31 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:54.696847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-92ea8e53-7cf8-4a5b-8c23-6cf336bb6f29 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a39dee0>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:54.705401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-581b74df-86d4-452d-8a15-630bcd142c31 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1313 microversion: 2.1 time: 0.215958 Jul 27 22:50:54.708754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 133/264] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:54 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:54.738282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-92ea8e53-7cf8-4a5b-8c23-6cf336bb6f29 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721" status: 200 len: 287 microversion: 2.1 time: 0.051249 Jul 27 22:50:54.739115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 132/265] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 22:50:54 2022] GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:55.219152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9e28e616-3ba9-4514-a195-c452bd489774 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:55.219750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9e28e616-3ba9-4514-a195-c452bd489774 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:55.228032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e28e616-3ba9-4514-a195-c452bd489774 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:55.228669 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e28e616-3ba9-4514-a195-c452bd489774 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:55.229637 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e28e616-3ba9-4514-a195-c452bd489774 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:55.230395 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e28e616-3ba9-4514-a195-c452bd489774 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:55.370396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9e28e616-3ba9-4514-a195-c452bd489774 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:55.378792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9e28e616-3ba9-4514-a195-c452bd489774 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1502 microversion: 2.1 time: 0.164414 Jul 27 22:50:55.379358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 134/266] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:55 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:55.400024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-eb7b2bbf-49c8-4c0b-ae32-bc1e55d0f26e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:55.400695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-eb7b2bbf-49c8-4c0b-ae32-bc1e55d0f26e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:55.407398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb7b2bbf-49c8-4c0b-ae32-bc1e55d0f26e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:55.407837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb7b2bbf-49c8-4c0b-ae32-bc1e55d0f26e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:55.408697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb7b2bbf-49c8-4c0b-ae32-bc1e55d0f26e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:55.409165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb7b2bbf-49c8-4c0b-ae32-bc1e55d0f26e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:55.542172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eb7b2bbf-49c8-4c0b-ae32-bc1e55d0f26e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:55.551263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-eb7b2bbf-49c8-4c0b-ae32-bc1e55d0f26e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1517 microversion: 2.1 time: 0.155478 Jul 27 22:50:55.551871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 133/267] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:55 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:55.729140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dc7114f6-a56f-4339-b813-c4c33ddf5bd5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:55.730380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dc7114f6-a56f-4339-b813-c4c33ddf5bd5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:55.745480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc7114f6-a56f-4339-b813-c4c33ddf5bd5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:55.752566 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b2e8f150-a310-407e-aa3f-435f4c7d5632 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a339a60>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:55.763986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc7114f6-a56f-4339-b813-c4c33ddf5bd5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:55.764845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc7114f6-a56f-4339-b813-c4c33ddf5bd5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:55.765276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc7114f6-a56f-4339-b813-c4c33ddf5bd5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:55.805720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-b2e8f150-a310-407e-aa3f-435f4c7d5632 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] HTTP exception thrown: Snapshot 5f0a0aad-d3a7-40f5-9fe4-7600e2498721 could not be found. Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b2e8f150-a310-407e-aa3f-435f4c7d5632 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Request method failure captured: Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721 HTTP/1.1 Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cFFNQokzqkQKmrGTnuIhUGviNjJ9XRt-g1c29oxNI2vgBJ7TSm_dTnaoKH4pF8c9FpbiRbQO6pgoLnFvVp28gfZRAHAWJApB7oooPe4Hquf7jra9EMqgqfIeu_AjtRG8wNIpg3toZzey9e5WZ5nBGGsTGlQEaWIQiQtN0aGKU-pnmA Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 1b2aceb66dea429daf11b310313ef84b Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2007966786 Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 22:50:55.809633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 22:50:55.811385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1b2aceb66dea429daf11b310313ef84b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1b2aceb66dea429daf11b310313ef84b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b2aceb66dea429daf11b310313ef84b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b2aceb66dea429daf11b310313ef84b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:55.811385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2007966786 Jul 27 22:50:55.811385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 1b2aceb66dea429daf11b310313ef84b Jul 27 22:50:55.811385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2007966786 Jul 27 22:50:55.811385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-VolumesSnapshotsTestJSON-2007966786-project Jul 27 22:50:55.811385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 22:50:55.811385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 22:50:55.811385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 1c0c0f2b8ec8498c8d676e9cf2bd0795 Jul 27 22:50:55.811385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2007966786-project Jul 27 22:50:55.811385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: Jul 27 22:50:55.811385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Snapshot 5f0a0aad-d3a7-40f5-9fe4-7600e2498721 could not be found. Jul 27 22:50:55.811385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': '5f0a0aad-d3a7-40f5-9fe4-7600e2498721'} Jul 27 22:50:55.811385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5f0a0aad-d3a7-40f5-9fe4-7600e2498721 could not be found. (HTTP 404) (Request-ID: req-95ecea77-cb6a-4531-8f17-9ee6dee21e9b) Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:55.812112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 22:50:55.813122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5f0a0aad-d3a7-40f5-9fe4-7600e2498721 could not be found. Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 27 22:50:55.814097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:50:55.815120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5f0a0aad-d3a7-40f5-9fe4-7600e2498721 could not be found. Jul 27 22:50:55.815120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:55.815120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:55.815120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:55.815120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:55.815120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:55.815120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:55.815120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:50:55.815120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:50:55.815120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5f0a0aad-d3a7-40f5-9fe4-7600e2498721 could not be found. Jul 27 22:50:55.815120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:55.817554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b2e8f150-a310-407e-aa3f-435f4c7d5632 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Returning 404 to user: Snapshot 5f0a0aad-d3a7-40f5-9fe4-7600e2498721 could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:55.818911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b2e8f150-a310-407e-aa3f-435f4c7d5632 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721" status: 404 len: 111 microversion: 2.1 time: 0.071482 Jul 27 22:50:55.820301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 134/268] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Jul 27 22:50:55 2022] GET /compute/v2.1/os-snapshots/5f0a0aad-d3a7-40f5-9fe4-7600e2498721 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 22:50:55.829752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-305336a0-2588-4e5e-b9f7-caaa60bddb66 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a33dee0>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:55.922150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-305336a0-2588-4e5e-b9f7-caaa60bddb66 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93" status: 202 len: 0 microversion: 2.1 time: 0.097322 Jul 27 22:50:55.922904 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 135/269] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 22:50:55 2022] DELETE /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 22:50:55.932441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9b4bad7b-9681-4578-abaf-2ceb348aa490 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a339700>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:56.013894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-dc7114f6-a56f-4339-b813-c4c33ddf5bd5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:56.015941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9b4bad7b-9681-4578-abaf-2ceb348aa490 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93" status: 200 len: 345 microversion: 2.1 time: 0.088421 Jul 27 22:50:56.017183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 136/270] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 22:50:55 2022] GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 => generated 345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:50:56.026723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dc7114f6-a56f-4339-b813-c4c33ddf5bd5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1313 microversion: 2.1 time: 0.302959 Jul 27 22:50:56.027331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 135/271] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:55 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:57.042501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-67ee9a35-056c-41f4-b5c2-615a91abe7c7 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a3399d0>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:57.053016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-455bf7e2-599e-4252-8f7a-3eb8a67e5b25 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:57.053814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-455bf7e2-599e-4252-8f7a-3eb8a67e5b25 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:57.061118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-455bf7e2-599e-4252-8f7a-3eb8a67e5b25 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:57.061628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-455bf7e2-599e-4252-8f7a-3eb8a67e5b25 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:57.062188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-67ee9a35-056c-41f4-b5c2-615a91abe7c7 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] HTTP exception thrown: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.062556 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-455bf7e2-599e-4252-8f7a-3eb8a67e5b25 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:57.063086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-455bf7e2-599e-4252-8f7a-3eb8a67e5b25 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-67ee9a35-056c-41f4-b5c2-615a91abe7c7 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Request method failure captured: Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 HTTP/1.1 Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cFFNQokzqkQKmrGTnuIhUGviNjJ9XRt-g1c29oxNI2vgBJ7TSm_dTnaoKH4pF8c9FpbiRbQO6pgoLnFvVp28gfZRAHAWJApB7oooPe4Hquf7jra9EMqgqfIeu_AjtRG8wNIpg3toZzey9e5WZ5nBGGsTGlQEaWIQiQtN0aGKU-pnmA Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 1b2aceb66dea429daf11b310313ef84b Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2007966786 Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 22:50:57.064629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 22:50:57.065824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1b2aceb66dea429daf11b310313ef84b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1b2aceb66dea429daf11b310313ef84b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b2aceb66dea429daf11b310313ef84b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b2aceb66dea429daf11b310313ef84b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:57.065824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2007966786 Jul 27 22:50:57.065824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 1b2aceb66dea429daf11b310313ef84b Jul 27 22:50:57.065824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2007966786 Jul 27 22:50:57.065824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-VolumesSnapshotsTestJSON-2007966786-project Jul 27 22:50:57.065824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 22:50:57.065824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 22:50:57.065824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 1c0c0f2b8ec8498c8d676e9cf2bd0795 Jul 27 22:50:57.065824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2007966786-project Jul 27 22:50:57.065824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: Jul 27 22:50:57.065824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.065824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': '0d247d79-7302-47c8-ace1-017c448ddd93'} Jul 27 22:50:57.065824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. (HTTP 404) (Request-ID: req-64e4ac52-eaae-4848-9031-753e3f76069d) Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:57.066525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 22:50:57.067599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 22:50:57.068650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-67ee9a35-056c-41f4-b5c2-615a91abe7c7 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Returning 404 to user: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-67ee9a35-056c-41f4-b5c2-615a91abe7c7 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93" status: 404 len: 109 microversion: 2.1 time: 0.039459 Jul 27 22:50:57.069678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 137/272] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 22:50:57 2022] GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 22:50:57.073556 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4961dfd3-3bc8-48b8-9cf1-66dd6b2fe325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:57.077059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4961dfd3-3bc8-48b8-9cf1-66dd6b2fe325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:57.083660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4961dfd3-3bc8-48b8-9cf1-66dd6b2fe325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:57.084397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4961dfd3-3bc8-48b8-9cf1-66dd6b2fe325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:57.085325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4961dfd3-3bc8-48b8-9cf1-66dd6b2fe325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:57.085682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4961dfd3-3bc8-48b8-9cf1-66dd6b2fe325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:57.110480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.objects.instance [None req-4961dfd3-3bc8-48b8-9cf1-66dd6b2fe325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lazy-loading 'flavor' on Instance uuid b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 {{(pid=129295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:50:57.199467 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-455bf7e2-599e-4252-8f7a-3eb8a67e5b25 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:57.207102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-455bf7e2-599e-4252-8f7a-3eb8a67e5b25 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1497 microversion: 2.1 time: 0.158202 Jul 27 22:50:57.207793 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 136/273] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:57 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:57.212760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-93020bb3-e85f-4019-86e5-c2974c9b5ef6 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a2ad8b0>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:57.231342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4961dfd3-3bc8-48b8-9cf1-66dd6b2fe325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "POST /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6/action" status: 200 len: 32 microversion: 2.1 time: 0.161761 Jul 27 22:50:57.236706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 138/274] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 22:50:57 2022] POST /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 22:50:57.243890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4347abf2-2ae8-4cab-9293-22bc0c302707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:57.248687 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4347abf2-2ae8-4cab-9293-22bc0c302707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:57.254344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-93020bb3-e85f-4019-86e5-c2974c9b5ef6 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] HTTP exception thrown: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.256932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4347abf2-2ae8-4cab-9293-22bc0c302707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:57.257382 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4347abf2-2ae8-4cab-9293-22bc0c302707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:57.258151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4347abf2-2ae8-4cab-9293-22bc0c302707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-93020bb3-e85f-4019-86e5-c2974c9b5ef6 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Request method failure captured: Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: DELETE /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 HTTP/1.1 Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cFFNQokzqkQKmrGTnuIhUGviNjJ9XRt-g1c29oxNI2vgBJ7TSm_dTnaoKH4pF8c9FpbiRbQO6pgoLnFvVp28gfZRAHAWJApB7oooPe4Hquf7jra9EMqgqfIeu_AjtRG8wNIpg3toZzey9e5WZ5nBGGsTGlQEaWIQiQtN0aGKU-pnmA Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 1b2aceb66dea429daf11b310313ef84b Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2007966786 Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 22:50:57.258251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 22:50:57.259376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1b2aceb66dea429daf11b310313ef84b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1b2aceb66dea429daf11b310313ef84b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b2aceb66dea429daf11b310313ef84b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b2aceb66dea429daf11b310313ef84b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:57.259376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2007966786 Jul 27 22:50:57.259376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 1b2aceb66dea429daf11b310313ef84b Jul 27 22:50:57.259376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2007966786 Jul 27 22:50:57.259376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-VolumesSnapshotsTestJSON-2007966786-project Jul 27 22:50:57.259376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 22:50:57.259376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 22:50:57.259376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 1c0c0f2b8ec8498c8d676e9cf2bd0795 Jul 27 22:50:57.259376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2007966786-project Jul 27 22:50:57.259376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: Jul 27 22:50:57.259376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.259376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '0d247d79-7302-47c8-ace1-017c448ddd93'} Jul 27 22:50:57.259376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. (HTTP 404) (Request-ID: req-f663dba4-b0e6-496c-b77b-798d397a496f) Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:57.260146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 22:50:57.261475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 22:50:57.262431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:50:57.267054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.267054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.267054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:57.267054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.267054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:57.267054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:57.267054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:57.267054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:50:57.267054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:50:57.267054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.267054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.268574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4347abf2-2ae8-4cab-9293-22bc0c302707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:57.268748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-93020bb3-e85f-4019-86e5-c2974c9b5ef6 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Returning 404 to user: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:57.268748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-93020bb3-e85f-4019-86e5-c2974c9b5ef6 tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93" status: 404 len: 109 microversion: 2.1 time: 0.050921 Jul 27 22:50:57.268748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 137/275] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 22:50:57 2022] DELETE /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 22:50:57.281681 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-48648f4d-12a3-4174-9c61-b7e8557c1aeb tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Calling method '.version_select at 0x7f696a3c0670>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:57.312881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-48648f4d-12a3-4174-9c61-b7e8557c1aeb tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] HTTP exception thrown: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-48648f4d-12a3-4174-9c61-b7e8557c1aeb tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Request method failure captured: Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 HTTP/1.1 Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cFFNQokzqkQKmrGTnuIhUGviNjJ9XRt-g1c29oxNI2vgBJ7TSm_dTnaoKH4pF8c9FpbiRbQO6pgoLnFvVp28gfZRAHAWJApB7oooPe4Hquf7jra9EMqgqfIeu_AjtRG8wNIpg3toZzey9e5WZ5nBGGsTGlQEaWIQiQtN0aGKU-pnmA Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 1b2aceb66dea429daf11b310313ef84b Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2007966786 Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 22:50:57.314857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 22:50:57.316006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1b2aceb66dea429daf11b310313ef84b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1b2aceb66dea429daf11b310313ef84b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b2aceb66dea429daf11b310313ef84b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b2aceb66dea429daf11b310313ef84b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:57.316006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2007966786 Jul 27 22:50:57.316006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 1b2aceb66dea429daf11b310313ef84b Jul 27 22:50:57.316006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2007966786 Jul 27 22:50:57.316006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-VolumesSnapshotsTestJSON-2007966786-project Jul 27 22:50:57.316006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 22:50:57.316006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 22:50:57.316006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 1c0c0f2b8ec8498c8d676e9cf2bd0795 Jul 27 22:50:57.316006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2007966786-project Jul 27 22:50:57.316006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: Jul 27 22:50:57.316006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.316006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '0d247d79-7302-47c8-ace1-017c448ddd93'} Jul 27 22:50:57.316006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. (HTTP 404) (Request-ID: req-7ac08d72-3942-4b47-96b0-7a3e67f6b36d) Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:57.316861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 22:50:57.318001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 22:50:57.319157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-48648f4d-12a3-4174-9c61-b7e8557c1aeb tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] Returning 404 to user: Volume 0d247d79-7302-47c8-ace1-017c448ddd93 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-48648f4d-12a3-4174-9c61-b7e8557c1aeb tempest-VolumesSnapshotsTestJSON-2007966786 tempest-VolumesSnapshotsTestJSON-2007966786-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93" status: 404 len: 109 microversion: 2.1 time: 0.051522 Jul 27 22:50:57.320365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 138/276] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 22:50:57 2022] GET /compute/v2.1/os-volumes/0d247d79-7302-47c8-ace1-017c448ddd93 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 22:50:57.414902 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4347abf2-2ae8-4cab-9293-22bc0c302707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:57.423903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4347abf2-2ae8-4cab-9293-22bc0c302707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.184909 Jul 27 22:50:57.442864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 139/277] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:57 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:57.729456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-58d71a5c-c5f4-4a86-9fd5-466b997176cd tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:57.730009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-58d71a5c-c5f4-4a86-9fd5-466b997176cd tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:57.736586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58d71a5c-c5f4-4a86-9fd5-466b997176cd tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:57.737094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58d71a5c-c5f4-4a86-9fd5-466b997176cd tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:57.737856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58d71a5c-c5f4-4a86-9fd5-466b997176cd tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:57.738280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58d71a5c-c5f4-4a86-9fd5-466b997176cd tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:57.760597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:57.766186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-58d71a5c-c5f4-4a86-9fd5-466b997176cd tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Going to try to terminate instance {{(pid=129294) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 22:50:57.900298 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-58d71a5c-c5f4-4a86-9fd5-466b997176cd tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "DELETE /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 204 len: 0 microversion: 2.1 time: 0.176630 Jul 27 22:50:57.901677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 139/278] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 22:50:57 2022] DELETE /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 22:50:57.910050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-19f43789-d2ae-4e29-b654-ae800c747fcf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:57.910667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-19f43789-d2ae-4e29-b654-ae800c747fcf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:57.920545 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19f43789-d2ae-4e29-b654-ae800c747fcf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:57.922538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19f43789-d2ae-4e29-b654-ae800c747fcf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:57.923701 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19f43789-d2ae-4e29-b654-ae800c747fcf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:57.925071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19f43789-d2ae-4e29-b654-ae800c747fcf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:58.101182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-19f43789-d2ae-4e29-b654-ae800c747fcf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:58.110171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-19f43789-d2ae-4e29-b654-ae800c747fcf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1503 microversion: 2.1 time: 0.203701 Jul 27 22:50:58.110736 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 140/279] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:57 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:58.449753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9b37dd19-78a2-4fb5-ad0b-f85cc516bcd5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:58.451476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9b37dd19-78a2-4fb5-ad0b-f85cc516bcd5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:58.459189 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b37dd19-78a2-4fb5-ad0b-f85cc516bcd5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:58.459868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b37dd19-78a2-4fb5-ad0b-f85cc516bcd5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:58.460689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b37dd19-78a2-4fb5-ad0b-f85cc516bcd5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:58.461130 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b37dd19-78a2-4fb5-ad0b-f85cc516bcd5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:58.605084 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9b37dd19-78a2-4fb5-ad0b-f85cc516bcd5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:58.613934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9b37dd19-78a2-4fb5-ad0b-f85cc516bcd5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.168378 Jul 27 22:50:58.616158 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 140/280] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:58 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:50:58.937684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ebad4a8d-8d4d-4578-a7c6-e1a66d6bcaa6 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Action: 'create', calling method: .version_select at 0x7f696a2d1dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1663748176", "metadata": {"Type": "work"}}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ebad4a8d-8d4d-4578-a7c6-e1a66d6bcaa6 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Request method failure captured: Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 122 Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cFSoQaUqzShxYBGgRM_skYUWQ9CriPY7LBnhW8T3Yl38LHjeLUxYx1Ef1WQ_eo44tKHQigEx9_CcSK8asAreBkNoY6nS4ORKO93NcTaOtzwt2i18h7-A0vOsy83al4DUw8hAon1vA_fI5t5gtZany6UCX7uKD5oRvS6U7m2UjH8KCA Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: a1b44a715261431c9a16fb69619a73db Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 22:50:58.951771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 22:50:58.953189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a1b44a715261431c9a16fb69619a73db", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:58.953189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:58.953189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: a1b44a715261431c9a16fb69619a73db Jul 27 22:50:58.953189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:58.953189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-VolumesNegativeTest-1486423496-project Jul 27 22:50:58.953189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 22:50:58.953189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 22:50:58.953189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: f73ab21421e3463c8316d6811cb7717b Jul 27 22:50:58.953189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-VolumesNegativeTest-1486423496-project Jul 27 22:50:58.953189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Jul 27 22:50:58.953189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1663748176", "metadata": {"Type": "work"}}} Jul 27 22:50:58.953189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: Jul 27 22:50:58.953189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1663748176', 'metadata': {'Type': 'work'}}}} Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise error Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi '#$%' Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:58.954152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 22:50:58.955614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 22:50:58.956857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 22:50:58.956857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.956857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ebad4a8d-8d4d-4578-a7c6-e1a66d6bcaa6 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:58.956857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ebad4a8d-8d4d-4578-a7c6-e1a66d6bcaa6 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132329 Jul 27 22:50:58.956857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 141/281] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Jul 27 22:50:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 22:50:58.964451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bb745637-dc4e-420a-bcbb-1a0396c425d7 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Action: 'create', calling method: .version_select at 0x7f696a24a8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-928762180", "metadata": {"Type": "work"}}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bb745637-dc4e-420a-bcbb-1a0396c425d7 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Request method failure captured: Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 119 Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cFSoQaUqzShxYBGgRM_skYUWQ9CriPY7LBnhW8T3Yl38LHjeLUxYx1Ef1WQ_eo44tKHQigEx9_CcSK8asAreBkNoY6nS4ORKO93NcTaOtzwt2i18h7-A0vOsy83al4DUw8hAon1vA_fI5t5gtZany6UCX7uKD5oRvS6U7m2UjH8KCA Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: a1b44a715261431c9a16fb69619a73db Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 22:50:58.969812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 22:50:58.971138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a1b44a715261431c9a16fb69619a73db", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:58.971138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:58.971138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: a1b44a715261431c9a16fb69619a73db Jul 27 22:50:58.971138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:58.971138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-VolumesNegativeTest-1486423496-project Jul 27 22:50:58.971138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 22:50:58.971138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 22:50:58.971138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: f73ab21421e3463c8316d6811cb7717b Jul 27 22:50:58.971138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-VolumesNegativeTest-1486423496-project Jul 27 22:50:58.971138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Jul 27 22:50:58.971138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-928762180", "metadata": {"Type": "work"}}} Jul 27 22:50:58.971138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: Jul 27 22:50:58.971138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-928762180', 'metadata': {'Type': 'work'}}}} Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise error Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi '0' Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:58.972163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 22:50:58.974754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 22:50:58.975785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 22:50:58.975785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.975785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bb745637-dc4e-420a-bcbb-1a0396c425d7 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:58.975785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bb745637-dc4e-420a-bcbb-1a0396c425d7 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010896 Jul 27 22:50:58.975785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 141/282] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Jul 27 22:50:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 22:50:58.981138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-791b291a-782c-402f-b7ff-c8c261d43fbc tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Action: 'create', calling method: .version_select at 0x7f696a339820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-840129449", "metadata": {"Type": "work"}}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-791b291a-782c-402f-b7ff-c8c261d43fbc tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Request method failure captured: Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 118 Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cFSoQaUqzShxYBGgRM_skYUWQ9CriPY7LBnhW8T3Yl38LHjeLUxYx1Ef1WQ_eo44tKHQigEx9_CcSK8asAreBkNoY6nS4ORKO93NcTaOtzwt2i18h7-A0vOsy83al4DUw8hAon1vA_fI5t5gtZany6UCX7uKD5oRvS6U7m2UjH8KCA Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: a1b44a715261431c9a16fb69619a73db Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 22:50:58.985091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 22:50:58.986447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a1b44a715261431c9a16fb69619a73db", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:58.986447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:58.986447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: a1b44a715261431c9a16fb69619a73db Jul 27 22:50:58.986447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:58.986447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-VolumesNegativeTest-1486423496-project Jul 27 22:50:58.986447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 22:50:58.986447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 22:50:58.986447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: f73ab21421e3463c8316d6811cb7717b Jul 27 22:50:58.986447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-VolumesNegativeTest-1486423496-project Jul 27 22:50:58.986447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Jul 27 22:50:58.986447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-840129449", "metadata": {"Type": "work"}}} Jul 27 22:50:58.986447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: Jul 27 22:50:58.986447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-840129449', 'metadata': {'Type': 'work'}}}} Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise error Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi '' Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:58.987300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 22:50:58.988889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 22:50:58.998546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 22:50:58.998546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:58.998546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-791b291a-782c-402f-b7ff-c8c261d43fbc tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:58.998546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-791b291a-782c-402f-b7ff-c8c261d43fbc tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009192 Jul 27 22:50:58.998546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 142/283] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Jul 27 22:50:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 22:50:58.999096 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a20140d0-852e-4426-b1a8-207aed1e674f tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Calling method '.version_select at 0x7f696a236ca0>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:59.026609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-a20140d0-852e-4426-b1a8-207aed1e674f tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] HTTP exception thrown: Volume tempest-invalid-931455914 could not be found. Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a20140d0-852e-4426-b1a8-207aed1e674f tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Request method failure captured: Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-931455914 HTTP/1.1 Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cFSoQaUqzShxYBGgRM_skYUWQ9CriPY7LBnhW8T3Yl38LHjeLUxYx1Ef1WQ_eo44tKHQigEx9_CcSK8asAreBkNoY6nS4ORKO93NcTaOtzwt2i18h7-A0vOsy83al4DUw8hAon1vA_fI5t5gtZany6UCX7uKD5oRvS6U7m2UjH8KCA Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: a1b44a715261431c9a16fb69619a73db Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 22:50:59.028521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 22:50:59.029901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a1b44a715261431c9a16fb69619a73db", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:59.029901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:59.029901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: a1b44a715261431c9a16fb69619a73db Jul 27 22:50:59.029901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:59.029901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-VolumesNegativeTest-1486423496-project Jul 27 22:50:59.029901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 22:50:59.029901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 22:50:59.029901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: f73ab21421e3463c8316d6811cb7717b Jul 27 22:50:59.029901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-VolumesNegativeTest-1486423496-project Jul 27 22:50:59.029901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: Jul 27 22:50:59.029901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Volume tempest-invalid-931455914 could not be found. Jul 27 22:50:59.029901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': 'tempest-invalid-931455914'} Jul 27 22:50:59.029901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-931455914 could not be found. (HTTP 404) (Request-ID: req-ae3eb2b4-4d2f-423e-a92d-b0c286bfc113) Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:59.030811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 22:50:59.032101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-931455914 could not be found. Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:50:59.033343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-931455914 could not be found. Jul 27 22:50:59.034675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.034675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:59.034675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.034675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:59.034675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:59.034675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:59.034675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:50:59.034675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:50:59.034675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-931455914 could not be found. Jul 27 22:50:59.034675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.034675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a20140d0-852e-4426-b1a8-207aed1e674f tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Returning 404 to user: Volume tempest-invalid-931455914 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:59.034675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a20140d0-852e-4426-b1a8-207aed1e674f tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-931455914" status: 404 len: 98 microversion: 2.1 time: 0.036684 Jul 27 22:50:59.034675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 142/284] 10.222.0.47 () {58 vars in 1215 bytes} [Wed Jul 27 22:50:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-931455914 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 27 22:50:59.039314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3d9d7f7f-055d-468f-8dcd-6c131b327c31 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003776 Jul 27 22:50:59.039804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 143/285] 10.222.0.47 () {58 vars in 1140 bytes} [Wed Jul 27 22:50:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 22:50:59.048583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f4c105f9-0a14-4a8d-97b2-595d11653e18 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004194 Jul 27 22:50:59.049285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 143/286] 10.222.0.47 () {58 vars in 1137 bytes} [Wed Jul 27 22:50:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 27 22:50:59.057689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0bd5b960-f45d-4e21-a17b-dde08d1d2546 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Calling method '.version_select at 0x7f696a371430>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:59.086159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-0bd5b960-f45d-4e21-a17b-dde08d1d2546 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] HTTP exception thrown: Volume efb667b4-543a-4457-97d1-f343fe50e1ea could not be found. Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0bd5b960-f45d-4e21-a17b-dde08d1d2546 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Request method failure captured: Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: DELETE /compute/v2.1/os-volumes/efb667b4-543a-4457-97d1-f343fe50e1ea HTTP/1.1 Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cFSoQaUqzShxYBGgRM_skYUWQ9CriPY7LBnhW8T3Yl38LHjeLUxYx1Ef1WQ_eo44tKHQigEx9_CcSK8asAreBkNoY6nS4ORKO93NcTaOtzwt2i18h7-A0vOsy83al4DUw8hAon1vA_fI5t5gtZany6UCX7uKD5oRvS6U7m2UjH8KCA Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: a1b44a715261431c9a16fb69619a73db Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 22:50:59.088125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 22:50:59.089631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a1b44a715261431c9a16fb69619a73db", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:59.089631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:59.089631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: a1b44a715261431c9a16fb69619a73db Jul 27 22:50:59.089631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:59.089631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-VolumesNegativeTest-1486423496-project Jul 27 22:50:59.089631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 22:50:59.089631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 22:50:59.089631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: f73ab21421e3463c8316d6811cb7717b Jul 27 22:50:59.089631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-VolumesNegativeTest-1486423496-project Jul 27 22:50:59.089631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: Jul 27 22:50:59.089631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Volume efb667b4-543a-4457-97d1-f343fe50e1ea could not be found. Jul 27 22:50:59.089631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': 'efb667b4-543a-4457-97d1-f343fe50e1ea'} Jul 27 22:50:59.089631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume efb667b4-543a-4457-97d1-f343fe50e1ea could not be found. (HTTP 404) (Request-ID: req-ffa92b0c-5ccc-4d68-8f43-cd80f9338637) Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:59.090983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 22:50:59.092084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume efb667b4-543a-4457-97d1-f343fe50e1ea could not be found. Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 22:50:59.093280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume efb667b4-543a-4457-97d1-f343fe50e1ea could not be found. Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume efb667b4-543a-4457-97d1-f343fe50e1ea could not be found. Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0bd5b960-f45d-4e21-a17b-dde08d1d2546 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Returning 404 to user: Volume efb667b4-543a-4457-97d1-f343fe50e1ea could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0bd5b960-f45d-4e21-a17b-dde08d1d2546 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/efb667b4-543a-4457-97d1-f343fe50e1ea" status: 404 len: 109 microversion: 2.1 time: 0.035558 Jul 27 22:50:59.094660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 144/287] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 22:50:59 2022] DELETE /compute/v2.1/os-volumes/efb667b4-543a-4457-97d1-f343fe50e1ea => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 22:50:59.104838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9949a3d3-84d4-444f-a294-de670e3e1564 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Calling method '.version_select at 0x7f696a24a310>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:59.132623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-9949a3d3-84d4-444f-a294-de670e3e1564 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] HTTP exception thrown: Volume 258b3e66-050b-4d31-8962-3e3f468f5689 could not be found. Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9949a3d3-84d4-444f-a294-de670e3e1564 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Request method failure captured: Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/os-volumes/258b3e66-050b-4d31-8962-3e3f468f5689 HTTP/1.1 Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cFSoQaUqzShxYBGgRM_skYUWQ9CriPY7LBnhW8T3Yl38LHjeLUxYx1Ef1WQ_eo44tKHQigEx9_CcSK8asAreBkNoY6nS4ORKO93NcTaOtzwt2i18h7-A0vOsy83al4DUw8hAon1vA_fI5t5gtZany6UCX7uKD5oRvS6U7m2UjH8KCA Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: a1b44a715261431c9a16fb69619a73db Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 22:50:59.134660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 22:50:59.135829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a1b44a715261431c9a16fb69619a73db", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1b44a715261431c9a16fb69619a73db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:50:59.135829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:59.135829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: a1b44a715261431c9a16fb69619a73db Jul 27 22:50:59.135829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-VolumesNegativeTest-1486423496 Jul 27 22:50:59.135829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-VolumesNegativeTest-1486423496-project Jul 27 22:50:59.135829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 22:50:59.135829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 22:50:59.135829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: f73ab21421e3463c8316d6811cb7717b Jul 27 22:50:59.135829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-VolumesNegativeTest-1486423496-project Jul 27 22:50:59.135829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: Jul 27 22:50:59.135829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Volume 258b3e66-050b-4d31-8962-3e3f468f5689 could not be found. Jul 27 22:50:59.135829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '258b3e66-050b-4d31-8962-3e3f468f5689'} Jul 27 22:50:59.135829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 258b3e66-050b-4d31-8962-3e3f468f5689 could not be found. (HTTP 404) (Request-ID: req-c384e2a0-513f-44f1-9c21-6ec260fc7ae4) Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:59.136517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 22:50:59.137529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 258b3e66-050b-4d31-8962-3e3f468f5689 could not be found. Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 22:50:59.138522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:50:59.139494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 258b3e66-050b-4d31-8962-3e3f468f5689 could not be found. Jul 27 22:50:59.139494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.139494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:50:59.139494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.139494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:50:59.139494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:50:59.139494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:50:59.139494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:50:59.139494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:50:59.139494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 258b3e66-050b-4d31-8962-3e3f468f5689 could not be found. Jul 27 22:50:59.139494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:50:59.139494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9949a3d3-84d4-444f-a294-de670e3e1564 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] Returning 404 to user: Volume 258b3e66-050b-4d31-8962-3e3f468f5689 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:50:59.139494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9949a3d3-84d4-444f-a294-de670e3e1564 tempest-VolumesNegativeTest-1486423496 tempest-VolumesNegativeTest-1486423496-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/258b3e66-050b-4d31-8962-3e3f468f5689" status: 404 len: 109 microversion: 2.1 time: 0.035579 Jul 27 22:50:59.140168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-65e9bf0f-dd65-443e-8ba3-b8235526be0f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:59.140168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-65e9bf0f-dd65-443e-8ba3-b8235526be0f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:59.141013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 144/288] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 22:50:59 2022] GET /compute/v2.1/os-volumes/258b3e66-050b-4d31-8962-3e3f468f5689 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 22:50:59.146742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65e9bf0f-dd65-443e-8ba3-b8235526be0f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:59.147183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65e9bf0f-dd65-443e-8ba3-b8235526be0f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:59.147957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65e9bf0f-dd65-443e-8ba3-b8235526be0f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:59.148385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65e9bf0f-dd65-443e-8ba3-b8235526be0f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:59.290150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-65e9bf0f-dd65-443e-8ba3-b8235526be0f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:59.298405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-65e9bf0f-dd65-443e-8ba3-b8235526be0f tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1503 microversion: 2.1 time: 0.171115 Jul 27 22:50:59.298957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 145/289] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:59 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:50:59.641069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3c60324e-d341-4154-99ce-0ead0e5ec5a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:50:59.641677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3c60324e-d341-4154-99ce-0ead0e5ec5a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:50:59.648779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c60324e-d341-4154-99ce-0ead0e5ec5a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:59.649631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c60324e-d341-4154-99ce-0ead0e5ec5a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:59.650645 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c60324e-d341-4154-99ce-0ead0e5ec5a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:50:59.651308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c60324e-d341-4154-99ce-0ead0e5ec5a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:50:59.847942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3c60324e-d341-4154-99ce-0ead0e5ec5a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:50:59.860787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3c60324e-d341-4154-99ce-0ead0e5ec5a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.225756 Jul 27 22:50:59.862265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 145/290] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:50:59 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:00.076709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-ab42dd78-ff79-4261-b374-f00db9a3e5f5 req-f4b055e3-979c-4f0e-8088-f1475eba868b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abfdfde9-805c-4c3c-8e99-a3aab1d2a588", "name": "network-vif-deleted", "tag": "4a71fb66-8879-4cf7-a8b3-af932c2e445a"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:00.089393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-ab42dd78-ff79-4261-b374-f00db9a3e5f5 req-f4b055e3-979c-4f0e-8088-f1475eba868b service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:00.089935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-ab42dd78-ff79-4261-b374-f00db9a3e5f5 req-f4b055e3-979c-4f0e-8088-f1475eba868b service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:00.104079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-ab42dd78-ff79-4261-b374-f00db9a3e5f5 req-f4b055e3-979c-4f0e-8088-f1475eba868b service nova] Creating event network-vif-deleted:4a71fb66-8879-4cf7-a8b3-af932c2e445a for instance abfdfde9-805c-4c3c-8e99-a3aab1d2a588 on hv-cinder-85124 Jul 27 22:51:00.109423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-ab42dd78-ff79-4261-b374-f00db9a3e5f5 req-f4b055e3-979c-4f0e-8088-f1475eba868b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037994 Jul 27 22:51:00.110005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 146/291] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:51:00.321458 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a3c870a4-6119-490a-8767-8adf6d6b305b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:00.322378 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a3c870a4-6119-490a-8767-8adf6d6b305b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:00.331201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3c870a4-6119-490a-8767-8adf6d6b305b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:00.332025 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3c870a4-6119-490a-8767-8adf6d6b305b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:00.332831 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3c870a4-6119-490a-8767-8adf6d6b305b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:00.333256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3c870a4-6119-490a-8767-8adf6d6b305b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:00.365965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3c870a4-6119-490a-8767-8adf6d6b305b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:00.366335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3c870a4-6119-490a-8767-8adf6d6b305b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:00.366780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.objects.instance [None req-a3c870a4-6119-490a-8767-8adf6d6b305b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lazy-loading 'fault' on Instance uuid abfdfde9-805c-4c3c-8e99-a3aab1d2a588 {{(pid=129294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:51:00.414346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a3c870a4-6119-490a-8767-8adf6d6b305b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:00.422496 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a3c870a4-6119-490a-8767-8adf6d6b305b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 200 len: 1303 microversion: 2.1 time: 0.106772 Jul 27 22:51:00.423046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 146/292] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:00 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:00.882951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-10bf1650-76c5-4493-b3f3-e4ba604566aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:00.883639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-10bf1650-76c5-4493-b3f3-e4ba604566aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:00.890224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10bf1650-76c5-4493-b3f3-e4ba604566aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:00.890740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10bf1650-76c5-4493-b3f3-e4ba604566aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:00.891655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10bf1650-76c5-4493-b3f3-e4ba604566aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:00.892211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10bf1650-76c5-4493-b3f3-e4ba604566aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:01.036468 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-10bf1650-76c5-4493-b3f3-e4ba604566aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:01.044167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-10bf1650-76c5-4493-b3f3-e4ba604566aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.165535 Jul 27 22:51:01.045359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 147/293] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:00 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:01.444280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d41a2565-2b7b-44b2-b75e-ffac790cbc8e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:01.445069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d41a2565-2b7b-44b2-b75e-ffac790cbc8e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: abfdfde9-805c-4c3c-8e99-a3aab1d2a588] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:01.451860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d41a2565-2b7b-44b2-b75e-ffac790cbc8e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:01.452309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d41a2565-2b7b-44b2-b75e-ffac790cbc8e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:01.453113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d41a2565-2b7b-44b2-b75e-ffac790cbc8e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:01.453542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d41a2565-2b7b-44b2-b75e-ffac790cbc8e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:01.467721 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-d41a2565-2b7b-44b2-b75e-ffac790cbc8e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] HTTP exception thrown: Instance abfdfde9-805c-4c3c-8e99-a3aab1d2a588 could not be found. Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d41a2565-2b7b-44b2-b75e-ffac790cbc8e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Request method failure captured: Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 HTTP/1.1 Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cE7pYsubZQlwrASEC77QkLj2Lg0cClWJ9R_RfNnLOexC8QSY4vyVWwm-HSvc0gUMsRZZ6xuL6rt6Xe-DwKFKIXomafLIStaXqD4ZUA0Dorzh_ZJObAC4WrunR20uUpWIBn3ny5LYiMUbjs9ETQn0PvZHoeJQ4pQPeKq6mOhIu64drs Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: e53f93856f7c473d8fe70557c4f973dd Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-VolumesActionsTest-677649129 Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 22:51:01.469266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 22:51:01.470716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e53f93856f7c473d8fe70557c4f973dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e53f93856f7c473d8fe70557c4f973dd", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53f93856f7c473d8fe70557c4f973dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53f93856f7c473d8fe70557c4f973dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:51:01.470716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-VolumesActionsTest-677649129 Jul 27 22:51:01.470716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: e53f93856f7c473d8fe70557c4f973dd Jul 27 22:51:01.470716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-VolumesActionsTest-677649129 Jul 27 22:51:01.470716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-VolumesActionsTest-677649129-project Jul 27 22:51:01.470716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 22:51:01.470716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 22:51:01.470716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 5916c224317640cf9c43596a1cbc585e Jul 27 22:51:01.470716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-VolumesActionsTest-677649129-project Jul 27 22:51:01.470716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 22:51:01.470716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance abfdfde9-805c-4c3c-8e99-a3aab1d2a588 could not be found. Jul 27 22:51:01.470716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': 'abfdfde9-805c-4c3c-8e99-a3aab1d2a588'} Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abfdfde9-805c-4c3c-8e99-a3aab1d2a588 could not be found. Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:51:01.471475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abfdfde9-805c-4c3c-8e99-a3aab1d2a588 could not be found. Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abfdfde9-805c-4c3c-8e99-a3aab1d2a588 could not be found. Jul 27 22:51:01.473394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:01.475494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d41a2565-2b7b-44b2-b75e-ffac790cbc8e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Returning 404 to user: Instance abfdfde9-805c-4c3c-8e99-a3aab1d2a588 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:51:01.475494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d41a2565-2b7b-44b2-b75e-ffac790cbc8e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588" status: 404 len: 111 microversion: 2.1 time: 0.030288 Jul 27 22:51:01.475494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 147/294] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:01 2022] GET /compute/v2.1/servers/abfdfde9-805c-4c3c-8e99-a3aab1d2a588 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 22:51:01.577457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1990475458", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "networks": [{"uuid": "a925bc0c-dbf5-4a80-a685-8b5fad12016a"}]}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:01.638178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.network.neutron [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] validate_networks() for [('a925bc0c-dbf5-4a80-a685-8b5fad12016a', None, None, None, None, None)] {{(pid=129295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 22:51:02.049278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Flavor limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 22:51:02.050359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Image limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 22:51:02.050907 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Flavor pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 22:51:02.051376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Image pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 22:51:02.051843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 22:51:02.060514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:02.061048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:02.061912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:02.062466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:02.066642 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c507b938-c4e5-4d6f-a65b-3977d8506b20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:02.067451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c507b938-c4e5-4d6f-a65b-3977d8506b20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:02.073828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c507b938-c4e5-4d6f-a65b-3977d8506b20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:02.074278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c507b938-c4e5-4d6f-a65b-3977d8506b20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:02.075211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c507b938-c4e5-4d6f-a65b-3977d8506b20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:02.076450 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c507b938-c4e5-4d6f-a65b-3977d8506b20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:02.082957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Getting quotas for project e53f93856f7c473d8fe70557c4f973dd. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:51:02.086951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Getting quotas for user 5916c224317640cf9c43596a1cbc585e and project e53f93856f7c473d8fe70557c4f973dd. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:51:02.100763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Going to run 1 instances... {{(pid=129295) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 22:51:02.103543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 22:51:02.165578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0afa38f0-4a5d-402b-bf10-ae31f11ab8f1 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591869 Jul 27 22:51:02.166406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 148/295] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 22:51:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 22:51:02.178648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6ebdd5c4-efa5-4b8b-824b-18c2d2e728f9 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:02.179669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6ebdd5c4-efa5-4b8b-824b-18c2d2e728f9 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:02.274535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c507b938-c4e5-4d6f-a65b-3977d8506b20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:02.278806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6ebdd5c4-efa5-4b8b-824b-18c2d2e728f9 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:02.283665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c507b938-c4e5-4d6f-a65b-3977d8506b20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.221047 Jul 27 22:51:02.284426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 148/296] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:02 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:02.304064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6ebdd5c4-efa5-4b8b-824b-18c2d2e728f9 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1214 microversion: 2.1 time: 0.129823 Jul 27 22:51:02.304752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 149/297] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:02 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:03.305984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-27a3c5e1-2ac4-49b8-b3fb-0db25fde5e5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:03.306594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-27a3c5e1-2ac4-49b8-b3fb-0db25fde5e5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:03.313220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-27a3c5e1-2ac4-49b8-b3fb-0db25fde5e5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:03.313651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-27a3c5e1-2ac4-49b8-b3fb-0db25fde5e5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:03.314412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-27a3c5e1-2ac4-49b8-b3fb-0db25fde5e5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:03.314843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-27a3c5e1-2ac4-49b8-b3fb-0db25fde5e5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:03.325885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fdf3ff52-0da8-4763-813c-87cc8e9e3c61 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:03.326568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fdf3ff52-0da8-4763-813c-87cc8e9e3c61 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:03.334344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fdf3ff52-0da8-4763-813c-87cc8e9e3c61 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:03.334860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fdf3ff52-0da8-4763-813c-87cc8e9e3c61 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:03.335685 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fdf3ff52-0da8-4763-813c-87cc8e9e3c61 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:03.336177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fdf3ff52-0da8-4763-813c-87cc8e9e3c61 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:03.420739 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fdf3ff52-0da8-4763-813c-87cc8e9e3c61 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:03.425364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:03.432951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fdf3ff52-0da8-4763-813c-87cc8e9e3c61 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1218 microversion: 2.1 time: 0.110664 Jul 27 22:51:03.433990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 150/298] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:03 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:03.477333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-27a3c5e1-2ac4-49b8-b3fb-0db25fde5e5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:03.484753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-27a3c5e1-2ac4-49b8-b3fb-0db25fde5e5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.183738 Jul 27 22:51:03.485623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 149/299] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:03 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:04.455700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8f57c2f8-b258-4c93-8c4e-ac2097627b4e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:04.456385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8f57c2f8-b258-4c93-8c4e-ac2097627b4e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:04.464265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f57c2f8-b258-4c93-8c4e-ac2097627b4e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:04.464893 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f57c2f8-b258-4c93-8c4e-ac2097627b4e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:04.466413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f57c2f8-b258-4c93-8c4e-ac2097627b4e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:04.466901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f57c2f8-b258-4c93-8c4e-ac2097627b4e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:04.508580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4af445bc-a213-4360-a5e2-d1f453ac25ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:04.509407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4af445bc-a213-4360-a5e2-d1f453ac25ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:04.516928 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4af445bc-a213-4360-a5e2-d1f453ac25ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:04.517396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4af445bc-a213-4360-a5e2-d1f453ac25ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:04.518300 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4af445bc-a213-4360-a5e2-d1f453ac25ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:04.518868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4af445bc-a213-4360-a5e2-d1f453ac25ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:04.530558 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8f57c2f8-b258-4c93-8c4e-ac2097627b4e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:04.539116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8f57c2f8-b258-4c93-8c4e-ac2097627b4e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1210 microversion: 2.1 time: 0.087821 Jul 27 22:51:04.539815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 151/300] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:04 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:04.652144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4af445bc-a213-4360-a5e2-d1f453ac25ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:04.660688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4af445bc-a213-4360-a5e2-d1f453ac25ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.156668 Jul 27 22:51:04.661063 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 150/301] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:04 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:05.567899 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-311c8319-e879-4258-a5b3-6bad168c6751 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:05.568704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-311c8319-e879-4258-a5b3-6bad168c6751 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:05.574688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-311c8319-e879-4258-a5b3-6bad168c6751 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:05.575121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-311c8319-e879-4258-a5b3-6bad168c6751 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:05.576482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-311c8319-e879-4258-a5b3-6bad168c6751 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:05.576941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-311c8319-e879-4258-a5b3-6bad168c6751 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:05.639814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-311c8319-e879-4258-a5b3-6bad168c6751 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:05.647703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-311c8319-e879-4258-a5b3-6bad168c6751 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1266 microversion: 2.1 time: 0.083977 Jul 27 22:51:05.648266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 152/302] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:05 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:05.683328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-18208a60-a783-4990-8f32-1c5bea421d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:05.684030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-18208a60-a783-4990-8f32-1c5bea421d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:05.691925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-18208a60-a783-4990-8f32-1c5bea421d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:05.692360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-18208a60-a783-4990-8f32-1c5bea421d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:05.693140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-18208a60-a783-4990-8f32-1c5bea421d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:05.693569 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-18208a60-a783-4990-8f32-1c5bea421d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:05.874255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-18208a60-a783-4990-8f32-1c5bea421d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:05.882122 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-18208a60-a783-4990-8f32-1c5bea421d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.203347 Jul 27 22:51:05.882798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 151/303] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:05 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:06.673097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-43f9c7df-2ea5-4b0e-a078-008858125175 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:06.673666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-43f9c7df-2ea5-4b0e-a078-008858125175 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:06.680927 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43f9c7df-2ea5-4b0e-a078-008858125175 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:06.681588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43f9c7df-2ea5-4b0e-a078-008858125175 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:06.682357 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43f9c7df-2ea5-4b0e-a078-008858125175 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:06.682833 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43f9c7df-2ea5-4b0e-a078-008858125175 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:06.863103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-43f9c7df-2ea5-4b0e-a078-008858125175 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:06.870652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-43f9c7df-2ea5-4b0e-a078-008858125175 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1314 microversion: 2.1 time: 0.204506 Jul 27 22:51:06.871217 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 153/304] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:06 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:06.905557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f4103731-deeb-4aae-9f6b-aadc99c66cc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:06.906952 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f4103731-deeb-4aae-9f6b-aadc99c66cc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:06.916326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4103731-deeb-4aae-9f6b-aadc99c66cc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:06.917221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4103731-deeb-4aae-9f6b-aadc99c66cc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:06.918586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4103731-deeb-4aae-9f6b-aadc99c66cc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:06.919293 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4103731-deeb-4aae-9f6b-aadc99c66cc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:07.287221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f4103731-deeb-4aae-9f6b-aadc99c66cc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:07.295638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f4103731-deeb-4aae-9f6b-aadc99c66cc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.395985 Jul 27 22:51:07.296360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 152/305] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:06 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:07.804397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-ed0af3f4-f78a-4a18-92ee-7068440220b8 req-0dc33064-d750-4715-af4a-f59c21547478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bffaba-accb-402a-952c-3922e7105086", "tag": "6d3cc651-b6af-479e-9ef2-c0f131565d6c"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:07.815480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:07.820241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-ed0af3f4-f78a-4a18-92ee-7068440220b8 req-0dc33064-d750-4715-af4a-f59c21547478 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:07.820959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-ed0af3f4-f78a-4a18-92ee-7068440220b8 req-0dc33064-d750-4715-af4a-f59c21547478 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:07.835971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-ed0af3f4-f78a-4a18-92ee-7068440220b8 req-0dc33064-d750-4715-af4a-f59c21547478 service nova] Creating event network-changed:6d3cc651-b6af-479e-9ef2-c0f131565d6c for instance 71bffaba-accb-402a-952c-3922e7105086 on hv-cinder-85124 Jul 27 22:51:07.843403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-ed0af3f4-f78a-4a18-92ee-7068440220b8 req-0dc33064-d750-4715-af4a-f59c21547478 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044379 Jul 27 22:51:07.844885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 154/306] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:51:07.891978 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d1378b68-18fb-4c08-8f56-5a565c5f9d1e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:07.892657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d1378b68-18fb-4c08-8f56-5a565c5f9d1e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:07.905363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1378b68-18fb-4c08-8f56-5a565c5f9d1e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:07.905850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1378b68-18fb-4c08-8f56-5a565c5f9d1e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:07.906619 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1378b68-18fb-4c08-8f56-5a565c5f9d1e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:07.924463 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1378b68-18fb-4c08-8f56-5a565c5f9d1e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:08.089663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d1378b68-18fb-4c08-8f56-5a565c5f9d1e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:08.098651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d1378b68-18fb-4c08-8f56-5a565c5f9d1e tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1314 microversion: 2.1 time: 0.210428 Jul 27 22:51:08.099949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 153/307] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:07 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:08.317651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6555f58b-e0fa-4010-8466-f2f6dfce6d4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:08.318340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6555f58b-e0fa-4010-8466-f2f6dfce6d4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:08.325048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6555f58b-e0fa-4010-8466-f2f6dfce6d4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:08.325490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6555f58b-e0fa-4010-8466-f2f6dfce6d4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:08.326252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6555f58b-e0fa-4010-8466-f2f6dfce6d4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:08.326683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6555f58b-e0fa-4010-8466-f2f6dfce6d4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:08.457385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6555f58b-e0fa-4010-8466-f2f6dfce6d4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:08.464887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6555f58b-e0fa-4010-8466-f2f6dfce6d4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.151602 Jul 27 22:51:08.465440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 155/308] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:08 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:09.121976 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6d77c31c-66a2-48e8-b546-56c3b5ed975b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:09.123113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6d77c31c-66a2-48e8-b546-56c3b5ed975b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:09.129839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6d77c31c-66a2-48e8-b546-56c3b5ed975b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:09.130284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6d77c31c-66a2-48e8-b546-56c3b5ed975b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:09.131052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6d77c31c-66a2-48e8-b546-56c3b5ed975b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:09.131482 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6d77c31c-66a2-48e8-b546-56c3b5ed975b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:09.341608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6d77c31c-66a2-48e8-b546-56c3b5ed975b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:09.354238 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6d77c31c-66a2-48e8-b546-56c3b5ed975b tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1314 microversion: 2.1 time: 0.236603 Jul 27 22:51:09.355221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 154/309] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:09 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:09.487975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3e74af14-e555-43f8-99d3-860f94cf482e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:09.488612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3e74af14-e555-43f8-99d3-860f94cf482e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:09.494919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e74af14-e555-43f8-99d3-860f94cf482e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:09.495645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e74af14-e555-43f8-99d3-860f94cf482e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:09.496244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e74af14-e555-43f8-99d3-860f94cf482e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:09.496694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e74af14-e555-43f8-99d3-860f94cf482e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:09.642126 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3e74af14-e555-43f8-99d3-860f94cf482e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:09.650368 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3e74af14-e555-43f8-99d3-860f94cf482e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.166824 Jul 27 22:51:09.651133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 156/310] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:09 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:10.378476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-45ceb0bb-bfb9-4602-8da2-6dadb720a6b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:10.384251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-45ceb0bb-bfb9-4602-8da2-6dadb720a6b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:10.388985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:10.396035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45ceb0bb-bfb9-4602-8da2-6dadb720a6b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:10.396697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45ceb0bb-bfb9-4602-8da2-6dadb720a6b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:10.397468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45ceb0bb-bfb9-4602-8da2-6dadb720a6b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:10.397894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45ceb0bb-bfb9-4602-8da2-6dadb720a6b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:10.561322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-45ceb0bb-bfb9-4602-8da2-6dadb720a6b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:10.571070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-45ceb0bb-bfb9-4602-8da2-6dadb720a6b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1314 microversion: 2.1 time: 0.197786 Jul 27 22:51:10.572631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 155/311] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:10 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:10.672855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dfe537bc-b1c8-4168-8c98-7d7b2a95fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:10.673560 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dfe537bc-b1c8-4168-8c98-7d7b2a95fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:10.681053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfe537bc-b1c8-4168-8c98-7d7b2a95fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:10.681504 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfe537bc-b1c8-4168-8c98-7d7b2a95fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:10.682595 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfe537bc-b1c8-4168-8c98-7d7b2a95fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:10.683083 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfe537bc-b1c8-4168-8c98-7d7b2a95fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:10.924694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dfe537bc-b1c8-4168-8c98-7d7b2a95fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:10.940996 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dfe537bc-b1c8-4168-8c98-7d7b2a95fd26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.273117 Jul 27 22:51:10.944980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 157/312] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:10 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:11.597725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ebe387c7-0ae3-4d42-8ca7-9cc8e3a360c0 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:11.598346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ebe387c7-0ae3-4d42-8ca7-9cc8e3a360c0 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:11.605607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebe387c7-0ae3-4d42-8ca7-9cc8e3a360c0 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:11.606086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebe387c7-0ae3-4d42-8ca7-9cc8e3a360c0 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:11.607442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebe387c7-0ae3-4d42-8ca7-9cc8e3a360c0 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:11.607874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebe387c7-0ae3-4d42-8ca7-9cc8e3a360c0 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:11.740353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ebe387c7-0ae3-4d42-8ca7-9cc8e3a360c0 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:11.748301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ebe387c7-0ae3-4d42-8ca7-9cc8e3a360c0 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1314 microversion: 2.1 time: 0.154385 Jul 27 22:51:11.748877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 156/313] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:11 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:11.966858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-68d1a5e4-d24e-4f7b-9789-92afa8443d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:11.969946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-68d1a5e4-d24e-4f7b-9789-92afa8443d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:11.976353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68d1a5e4-d24e-4f7b-9789-92afa8443d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:11.976821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68d1a5e4-d24e-4f7b-9789-92afa8443d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:11.977584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68d1a5e4-d24e-4f7b-9789-92afa8443d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:11.978200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68d1a5e4-d24e-4f7b-9789-92afa8443d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:12.071917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:12.154050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-68d1a5e4-d24e-4f7b-9789-92afa8443d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:12.160541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-68d1a5e4-d24e-4f7b-9789-92afa8443d78 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.198337 Jul 27 22:51:12.161480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 158/314] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:11 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:12.482931 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-d4fd0f50-eda7-4937-b188-864b8ac17816 req-a2b0bebf-b893-4cee-ad3a-7bc1d9ed7f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bffaba-accb-402a-952c-3922e7105086", "name": "network-vif-plugged", "status": "completed", "tag": "6d3cc651-b6af-479e-9ef2-c0f131565d6c"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:12.492382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-d4fd0f50-eda7-4937-b188-864b8ac17816 req-a2b0bebf-b893-4cee-ad3a-7bc1d9ed7f7a service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:12.492801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-d4fd0f50-eda7-4937-b188-864b8ac17816 req-a2b0bebf-b893-4cee-ad3a-7bc1d9ed7f7a service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:12.507392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-d4fd0f50-eda7-4937-b188-864b8ac17816 req-a2b0bebf-b893-4cee-ad3a-7bc1d9ed7f7a service nova] Creating event network-vif-plugged:6d3cc651-b6af-479e-9ef2-c0f131565d6c for instance 71bffaba-accb-402a-952c-3922e7105086 on hv-cinder-85124 Jul 27 22:51:12.514295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-d4fd0f50-eda7-4937-b188-864b8ac17816 req-a2b0bebf-b893-4cee-ad3a-7bc1d9ed7f7a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035208 Jul 27 22:51:12.515109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 157/315] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:51:12.700448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-140486098", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452"}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:12.708010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=8 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:12.759707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.network.neutron [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] validate_networks() for None {{(pid=129295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 22:51:12.769392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e43eda46-02c3-40d7-be6a-fc2879a0ccee tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:12.770074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e43eda46-02c3-40d7-be6a-fc2879a0ccee tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:12.786761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e43eda46-02c3-40d7-be6a-fc2879a0ccee tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:12.787303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e43eda46-02c3-40d7-be6a-fc2879a0ccee tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:12.790802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e43eda46-02c3-40d7-be6a-fc2879a0ccee tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:12.791249 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e43eda46-02c3-40d7-be6a-fc2879a0ccee tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:13.102963 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e43eda46-02c3-40d7-be6a-fc2879a0ccee tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:13.111722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e43eda46-02c3-40d7-be6a-fc2879a0ccee tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1314 microversion: 2.1 time: 0.346214 Jul 27 22:51:13.112396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 158/316] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:12 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:13.146117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Flavor limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 22:51:13.146587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Image limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 22:51:13.146993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Flavor pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 22:51:13.147400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Image pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 22:51:13.147806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 22:51:13.159657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:13.160110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:13.160972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:13.161412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:13.181132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Getting quotas for project 7e2fc9ca645a4548866ceec8e7c046f9. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:51:13.183113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ca50e8b2-052e-4fd8-b172-ce3f1829ab0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:13.183802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ca50e8b2-052e-4fd8-b172-ce3f1829ab0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:13.186018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Getting quotas for user 50bf18bc88334eba9c94fc3388b58862 and project 7e2fc9ca645a4548866ceec8e7c046f9. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:51:13.190108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca50e8b2-052e-4fd8-b172-ce3f1829ab0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:13.190801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca50e8b2-052e-4fd8-b172-ce3f1829ab0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:13.191774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca50e8b2-052e-4fd8-b172-ce3f1829ab0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:13.192401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca50e8b2-052e-4fd8-b172-ce3f1829ab0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:13.197388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Going to run 1 instances... {{(pid=129295) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 22:51:13.199783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 22:51:13.211932 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:13.246462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bdfc76cc-d79a-4419-a951-f3046f6f9026 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550056 Jul 27 22:51:13.252702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 159/317] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 22:51:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 22:51:13.257802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-20ccc434-6e36-4383-9131-841b8956f3cd tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:13.258421 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-20ccc434-6e36-4383-9131-841b8956f3cd tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:13.332678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-20ccc434-6e36-4383-9131-841b8956f3cd tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:13.339785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-20ccc434-6e36-4383-9131-841b8956f3cd tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1214 microversion: 2.1 time: 0.085922 Jul 27 22:51:13.340538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 160/318] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:13 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:13.415214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ca50e8b2-052e-4fd8-b172-ce3f1829ab0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:13.426036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ca50e8b2-052e-4fd8-b172-ce3f1829ab0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.246951 Jul 27 22:51:13.427181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 159/319] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:13 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:14.138183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6b3a0585-52e7-44a8-acf4-891e30a45d68 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:14.139134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6b3a0585-52e7-44a8-acf4-891e30a45d68 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:14.150454 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b3a0585-52e7-44a8-acf4-891e30a45d68 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:14.150993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b3a0585-52e7-44a8-acf4-891e30a45d68 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:14.152076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b3a0585-52e7-44a8-acf4-891e30a45d68 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:14.152888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b3a0585-52e7-44a8-acf4-891e30a45d68 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:14.292164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6b3a0585-52e7-44a8-acf4-891e30a45d68 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:14.300323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6b3a0585-52e7-44a8-acf4-891e30a45d68 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1314 microversion: 2.1 time: 0.167143 Jul 27 22:51:14.301006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 161/320] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:14 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:14.360172 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d46a9161-6269-46e3-b93d-ccabbf33e9b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:14.361230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d46a9161-6269-46e3-b93d-ccabbf33e9b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:14.367055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d46a9161-6269-46e3-b93d-ccabbf33e9b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:14.367498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d46a9161-6269-46e3-b93d-ccabbf33e9b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:14.368251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d46a9161-6269-46e3-b93d-ccabbf33e9b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:14.368713 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d46a9161-6269-46e3-b93d-ccabbf33e9b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:14.430966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d46a9161-6269-46e3-b93d-ccabbf33e9b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:14.439523 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d46a9161-6269-46e3-b93d-ccabbf33e9b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1266 microversion: 2.1 time: 0.083096 Jul 27 22:51:14.440081 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 160/321] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:14 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:14.447292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-56659d2f-b237-4865-bb13-8da6cf1f9208 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:14.447878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-56659d2f-b237-4865-bb13-8da6cf1f9208 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:14.454361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56659d2f-b237-4865-bb13-8da6cf1f9208 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:14.454801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56659d2f-b237-4865-bb13-8da6cf1f9208 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:14.455556 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56659d2f-b237-4865-bb13-8da6cf1f9208 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:14.455978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56659d2f-b237-4865-bb13-8da6cf1f9208 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:14.556906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-17e67f90-1e2e-4844-b650-41ae4c903c4d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:14.557972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-17e67f90-1e2e-4844-b650-41ae4c903c4d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:14.564958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-17e67f90-1e2e-4844-b650-41ae4c903c4d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:14.565517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-17e67f90-1e2e-4844-b650-41ae4c903c4d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:14.566360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-17e67f90-1e2e-4844-b650-41ae4c903c4d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:14.567012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-17e67f90-1e2e-4844-b650-41ae4c903c4d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:14.599450 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-17e67f90-1e2e-4844-b650-41ae4c903c4d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/ips" status: 200 len: 144 microversion: 2.1 time: 0.046702 Jul 27 22:51:14.600192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 161/322] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 22:51:14 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/ips => generated 144 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:51:14.674821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-56659d2f-b237-4865-bb13-8da6cf1f9208 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:14.682939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-56659d2f-b237-4865-bb13-8da6cf1f9208 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.239548 Jul 27 22:51:14.683584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 162/323] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:14 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:15.321795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4aa15dfe-9939-48ac-b6e2-b1d629422799 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:15.322399 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4aa15dfe-9939-48ac-b6e2-b1d629422799 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:15.328739 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4aa15dfe-9939-48ac-b6e2-b1d629422799 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:15.328848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4aa15dfe-9939-48ac-b6e2-b1d629422799 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:15.329574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4aa15dfe-9939-48ac-b6e2-b1d629422799 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:15.330169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4aa15dfe-9939-48ac-b6e2-b1d629422799 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:15.360389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9a89d648-0db8-4b96-a177-f2fce03dd2ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:15.360987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9a89d648-0db8-4b96-a177-f2fce03dd2ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:15.366796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a89d648-0db8-4b96-a177-f2fce03dd2ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:15.367242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a89d648-0db8-4b96-a177-f2fce03dd2ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:15.367994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a89d648-0db8-4b96-a177-f2fce03dd2ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:15.368422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a89d648-0db8-4b96-a177-f2fce03dd2ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:15.394262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9a89d648-0db8-4b96-a177-f2fce03dd2ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/ips" status: 200 len: 150 microversion: 2.20 time: 0.037914 Jul 27 22:51:15.395006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 163/324] 10.222.0.47 () {60 vars in 1289 bytes} [Wed Jul 27 22:51:15 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:51:15.461437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-73eaf87b-1be6-4888-8a83-13e87c3c69ef tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:15.462185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-73eaf87b-1be6-4888-8a83-13e87c3c69ef tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:15.469327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73eaf87b-1be6-4888-8a83-13e87c3c69ef tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:15.470080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73eaf87b-1be6-4888-8a83-13e87c3c69ef tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:15.471188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73eaf87b-1be6-4888-8a83-13e87c3c69ef tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:15.472008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73eaf87b-1be6-4888-8a83-13e87c3c69ef tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:15.516629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4aa15dfe-9939-48ac-b6e2-b1d629422799 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:15.528025 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4aa15dfe-9939-48ac-b6e2-b1d629422799 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1497 microversion: 2.1 time: 0.209956 Jul 27 22:51:15.529274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 162/325] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:15 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:15.565009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-73eaf87b-1be6-4888-8a83-13e87c3c69ef tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:15.578768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-73eaf87b-1be6-4888-8a83-13e87c3c69ef tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1284 microversion: 2.1 time: 0.121203 Jul 27 22:51:15.592578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 164/326] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:15 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:15.704872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a1c696f0-cc25-4b20-81c6-f4fdbef64855 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:15.724921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a1c696f0-cc25-4b20-81c6-f4fdbef64855 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:15.730617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1c696f0-cc25-4b20-81c6-f4fdbef64855 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:15.731950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1c696f0-cc25-4b20-81c6-f4fdbef64855 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:15.732899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1c696f0-cc25-4b20-81c6-f4fdbef64855 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:15.733437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1c696f0-cc25-4b20-81c6-f4fdbef64855 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:15.933069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1c696f0-cc25-4b20-81c6-f4fdbef64855 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:15.941743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a1c696f0-cc25-4b20-81c6-f4fdbef64855 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.240616 Jul 27 22:51:15.942378 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 163/327] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:15 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:16.314724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a2f5e52a-c8cc-4d4e-b581-fb17557bb9bf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:16.316426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a2f5e52a-c8cc-4d4e-b581-fb17557bb9bf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:16.323664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2f5e52a-c8cc-4d4e-b581-fb17557bb9bf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:16.324323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2f5e52a-c8cc-4d4e-b581-fb17557bb9bf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:16.325789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2f5e52a-c8cc-4d4e-b581-fb17557bb9bf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:16.326224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2f5e52a-c8cc-4d4e-b581-fb17557bb9bf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:16.492874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a2f5e52a-c8cc-4d4e-b581-fb17557bb9bf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Going to try to terminate instance {{(pid=129295) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 22:51:16.591729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a2f5e52a-c8cc-4d4e-b581-fb17557bb9bf tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "DELETE /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 204 len: 0 microversion: 2.1 time: 0.282581 Jul 27 22:51:16.592305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 165/328] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 22:51:16 2022] DELETE /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 22:51:16.600848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-071b850d-ffa6-4e4a-a0fe-b90ff89eb9b8 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:16.601665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-071b850d-ffa6-4e4a-a0fe-b90ff89eb9b8 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:16.610070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-071b850d-ffa6-4e4a-a0fe-b90ff89eb9b8 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:16.610724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-071b850d-ffa6-4e4a-a0fe-b90ff89eb9b8 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:16.611686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-071b850d-ffa6-4e4a-a0fe-b90ff89eb9b8 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:16.612832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-071b850d-ffa6-4e4a-a0fe-b90ff89eb9b8 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:16.623389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-44353704-71f0-4868-ab56-9657a6caa84a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:16.640182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-44353704-71f0-4868-ab56-9657a6caa84a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:16.640182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44353704-71f0-4868-ab56-9657a6caa84a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:16.640182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44353704-71f0-4868-ab56-9657a6caa84a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:16.640182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44353704-71f0-4868-ab56-9657a6caa84a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:16.640817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44353704-71f0-4868-ab56-9657a6caa84a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:16.763263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-44353704-71f0-4868-ab56-9657a6caa84a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:16.772128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-44353704-71f0-4868-ab56-9657a6caa84a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1272 microversion: 2.1 time: 0.154411 Jul 27 22:51:16.785040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 166/329] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:16 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:16.835324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-071b850d-ffa6-4e4a-a0fe-b90ff89eb9b8 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:16.844221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-071b850d-ffa6-4e4a-a0fe-b90ff89eb9b8 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1503 microversion: 2.1 time: 0.247591 Jul 27 22:51:16.844825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 164/330] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:16 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:16.969089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-17085549-c63a-4339-ace1-1e5a5625025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:16.969666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-17085549-c63a-4339-ace1-1e5a5625025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:16.982402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17085549-c63a-4339-ace1-1e5a5625025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:16.983120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17085549-c63a-4339-ace1-1e5a5625025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:16.984060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17085549-c63a-4339-ace1-1e5a5625025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:16.984672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17085549-c63a-4339-ace1-1e5a5625025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:17.131939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-17085549-c63a-4339-ace1-1e5a5625025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:17.141862 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-17085549-c63a-4339-ace1-1e5a5625025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.179688 Jul 27 22:51:17.143586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 167/331] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:16 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:17.794646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bc185149-6448-4667-b296-dd4945843151 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:17.795121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bc185149-6448-4667-b296-dd4945843151 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:17.801539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bc185149-6448-4667-b296-dd4945843151 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:17.801978 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bc185149-6448-4667-b296-dd4945843151 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:17.802731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bc185149-6448-4667-b296-dd4945843151 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:17.803152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bc185149-6448-4667-b296-dd4945843151 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:17.866512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1dbed31c-abb2-4a88-9f3f-9995d9b0a342 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:17.868994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1dbed31c-abb2-4a88-9f3f-9995d9b0a342 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:17.877657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1dbed31c-abb2-4a88-9f3f-9995d9b0a342 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:17.878391 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1dbed31c-abb2-4a88-9f3f-9995d9b0a342 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:17.879602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1dbed31c-abb2-4a88-9f3f-9995d9b0a342 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:17.880244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1dbed31c-abb2-4a88-9f3f-9995d9b0a342 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:17.899867 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:17.989919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bc185149-6448-4667-b296-dd4945843151 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:18.003743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bc185149-6448-4667-b296-dd4945843151 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.211343 Jul 27 22:51:18.003743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 165/332] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:17 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:18.045095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1dbed31c-abb2-4a88-9f3f-9995d9b0a342 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:18.052800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1dbed31c-abb2-4a88-9f3f-9995d9b0a342 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1503 microversion: 2.1 time: 0.190028 Jul 27 22:51:18.053363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 168/333] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:17 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:18.163303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-83c9bd19-0111-407d-a43d-8e84103891d9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:18.163906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-83c9bd19-0111-407d-a43d-8e84103891d9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:18.170441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83c9bd19-0111-407d-a43d-8e84103891d9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:18.170881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83c9bd19-0111-407d-a43d-8e84103891d9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:18.171631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83c9bd19-0111-407d-a43d-8e84103891d9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:18.172058 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83c9bd19-0111-407d-a43d-8e84103891d9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:18.319295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-83c9bd19-0111-407d-a43d-8e84103891d9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:18.327015 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-83c9bd19-0111-407d-a43d-8e84103891d9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.167490 Jul 27 22:51:18.327580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 166/334] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:18 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:18.511115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5c6492d7-45e5-4719-8fc9-48c2c993af05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:18.511844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5c6492d7-45e5-4719-8fc9-48c2c993af05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:18.526173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c6492d7-45e5-4719-8fc9-48c2c993af05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:18.526623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c6492d7-45e5-4719-8fc9-48c2c993af05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:18.527521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c6492d7-45e5-4719-8fc9-48c2c993af05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:18.528085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c6492d7-45e5-4719-8fc9-48c2c993af05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:18.551919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.objects.instance [None req-5c6492d7-45e5-4719-8fc9-48c2c993af05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lazy-loading 'flavor' on Instance uuid e457f5fc-ae83-4b88-87be-ba1007c5865e {{(pid=129295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:51:18.776241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9e710cdf-f9fd-414f-a9d5-e1a5980f66a0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87ca4702-4dfa-4134-91b2-9ff474759e60"}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:18.780577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9e710cdf-f9fd-414f-a9d5-e1a5980f66a0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:18.786751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e710cdf-f9fd-414f-a9d5-e1a5980f66a0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:18.787514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e710cdf-f9fd-414f-a9d5-e1a5980f66a0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:18.788497 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e710cdf-f9fd-414f-a9d5-e1a5980f66a0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:18.789041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e710cdf-f9fd-414f-a9d5-e1a5980f66a0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:18.822720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5c6492d7-45e5-4719-8fc9-48c2c993af05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "POST /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/action" status: 202 len: 0 microversion: 2.20 time: 0.315811 Jul 27 22:51:18.823180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 169/335] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Jul 27 22:51:18 2022] POST /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 22:51:18.832472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-343b5d5b-23ce-4684-9fc5-9c0007299dac tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:18.833185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-343b5d5b-23ce-4684-9fc5-9c0007299dac tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:18.839780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-343b5d5b-23ce-4684-9fc5-9c0007299dac tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:18.840226 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-343b5d5b-23ce-4684-9fc5-9c0007299dac tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:18.841055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-343b5d5b-23ce-4684-9fc5-9c0007299dac tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:18.841482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-343b5d5b-23ce-4684-9fc5-9c0007299dac tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:19.003696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-343b5d5b-23ce-4684-9fc5-9c0007299dac tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:19.013562 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-343b5d5b-23ce-4684-9fc5-9c0007299dac tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:19.015205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-343b5d5b-23ce-4684-9fc5-9c0007299dac tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:19.016913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-343b5d5b-23ce-4684-9fc5-9c0007299dac tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.188015 Jul 27 22:51:19.028211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 170/336] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:51:19.028211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-63d074e6-c31f-4775-bad8-1483b57a199b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:19.028211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-63d074e6-c31f-4775-bad8-1483b57a199b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:19.034879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-63d074e6-c31f-4775-bad8-1483b57a199b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:19.035632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-63d074e6-c31f-4775-bad8-1483b57a199b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:19.036686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-63d074e6-c31f-4775-bad8-1483b57a199b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:19.037328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-63d074e6-c31f-4775-bad8-1483b57a199b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:19.183098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-63d074e6-c31f-4775-bad8-1483b57a199b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:19.191436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-63d074e6-c31f-4775-bad8-1483b57a199b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.172848 Jul 27 22:51:19.191989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 171/337] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:19 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:19.196635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e9689c05-444c-4cfa-866b-bd5a6a0f14c4 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:19.197237 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e9689c05-444c-4cfa-866b-bd5a6a0f14c4 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:19.203975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9689c05-444c-4cfa-866b-bd5a6a0f14c4 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:19.204375 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9689c05-444c-4cfa-866b-bd5a6a0f14c4 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:19.205155 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9689c05-444c-4cfa-866b-bd5a6a0f14c4 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:19.205582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9689c05-444c-4cfa-866b-bd5a6a0f14c4 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:19.362943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e9689c05-444c-4cfa-866b-bd5a6a0f14c4 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:19.370509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e9689c05-444c-4cfa-866b-bd5a6a0f14c4 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1503 microversion: 2.1 time: 0.177329 Jul 27 22:51:19.371075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 172/338] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:19 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:19.389123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-0993e3ea-b708-41db-bdbd-d63e75563c22 req-fe251735-d362-440b-b134-7312370d92bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e29c5888-2a33-4b7c-887c-3d121f51c045", "tag": "46802986-4219-4000-8b11-a7d6d2866f86"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:19.398518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-0993e3ea-b708-41db-bdbd-d63e75563c22 req-fe251735-d362-440b-b134-7312370d92bb service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:19.398954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-0993e3ea-b708-41db-bdbd-d63e75563c22 req-fe251735-d362-440b-b134-7312370d92bb service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:19.413437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-0993e3ea-b708-41db-bdbd-d63e75563c22 req-fe251735-d362-440b-b134-7312370d92bb service nova] Creating event network-changed:46802986-4219-4000-8b11-a7d6d2866f86 for instance e29c5888-2a33-4b7c-887c-3d121f51c045 on hv-cinder-85124 Jul 27 22:51:19.418225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-0993e3ea-b708-41db-bdbd-d63e75563c22 req-fe251735-d362-440b-b134-7312370d92bb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033050 Jul 27 22:51:19.419424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 173/339] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:51:19.424265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6e2e0ad5-e914-45c1-9b8f-f32da7713bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:19.424996 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6e2e0ad5-e914-45c1-9b8f-f32da7713bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:19.431260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e2e0ad5-e914-45c1-9b8f-f32da7713bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:19.431710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e2e0ad5-e914-45c1-9b8f-f32da7713bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:19.432476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e2e0ad5-e914-45c1-9b8f-f32da7713bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:19.432937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e2e0ad5-e914-45c1-9b8f-f32da7713bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:19.600877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6e2e0ad5-e914-45c1-9b8f-f32da7713bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:19.609635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6e2e0ad5-e914-45c1-9b8f-f32da7713bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.189043 Jul 27 22:51:19.610206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 174/340] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:19 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:19.827940 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9e710cdf-f9fd-414f-a9d5-e1a5980f66a0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "POST /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.056120 Jul 27 22:51:19.828704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 167/341] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 22:51:18 2022] POST /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/os-volume_attachments => generated 194 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:51:20.040359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8630586b-57d3-4e30-a38c-9d0f4a008437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:20.041085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8630586b-57d3-4e30-a38c-9d0f4a008437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:20.050576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8630586b-57d3-4e30-a38c-9d0f4a008437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.051103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8630586b-57d3-4e30-a38c-9d0f4a008437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.051949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8630586b-57d3-4e30-a38c-9d0f4a008437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.052450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8630586b-57d3-4e30-a38c-9d0f4a008437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.212041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8630586b-57d3-4e30-a38c-9d0f4a008437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:20.214488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-20f27ce3-2936-4894-a8bc-c15cd9d0464b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:20.216545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-20f27ce3-2936-4894-a8bc-c15cd9d0464b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:20.223388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-20f27ce3-2936-4894-a8bc-c15cd9d0464b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.224250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-20f27ce3-2936-4894-a8bc-c15cd9d0464b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.225329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-20f27ce3-2936-4894-a8bc-c15cd9d0464b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.225945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-20f27ce3-2936-4894-a8bc-c15cd9d0464b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.229086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8630586b-57d3-4e30-a38c-9d0f4a008437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:20.230964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8630586b-57d3-4e30-a38c-9d0f4a008437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:20.233806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8630586b-57d3-4e30-a38c-9d0f4a008437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.198024 Jul 27 22:51:20.234546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 175/342] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:20.371277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-20f27ce3-2936-4894-a8bc-c15cd9d0464b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:20.383029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-20f27ce3-2936-4894-a8bc-c15cd9d0464b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.173876 Jul 27 22:51:20.383705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 168/343] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:20 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:20.391694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2b0bdfe6-2655-4026-94ad-01ba4db9a8e3 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:20.392443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2b0bdfe6-2655-4026-94ad-01ba4db9a8e3 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:20.398517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b0bdfe6-2655-4026-94ad-01ba4db9a8e3 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.398956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b0bdfe6-2655-4026-94ad-01ba4db9a8e3 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.399719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b0bdfe6-2655-4026-94ad-01ba4db9a8e3 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.400140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b0bdfe6-2655-4026-94ad-01ba4db9a8e3 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.429681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b0bdfe6-2655-4026-94ad-01ba4db9a8e3 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.430380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b0bdfe6-2655-4026-94ad-01ba4db9a8e3 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.430834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.objects.instance [None req-2b0bdfe6-2655-4026-94ad-01ba4db9a8e3 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lazy-loading 'fault' on Instance uuid 71bffaba-accb-402a-952c-3922e7105086 {{(pid=129295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:51:20.475149 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2b0bdfe6-2655-4026-94ad-01ba4db9a8e3 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:20.482828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2b0bdfe6-2655-4026-94ad-01ba4db9a8e3 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1304 microversion: 2.1 time: 0.095469 Jul 27 22:51:20.483404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 176/344] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:20 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:20.630862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-de30c31a-8456-4d2b-ad3c-b01ee8ac7e82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:20.631478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-de30c31a-8456-4d2b-ad3c-b01ee8ac7e82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:20.638072 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de30c31a-8456-4d2b-ad3c-b01ee8ac7e82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.638515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de30c31a-8456-4d2b-ad3c-b01ee8ac7e82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.639269 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de30c31a-8456-4d2b-ad3c-b01ee8ac7e82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.639701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de30c31a-8456-4d2b-ad3c-b01ee8ac7e82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.772105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-de30c31a-8456-4d2b-ad3c-b01ee8ac7e82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:20.779501 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-de30c31a-8456-4d2b-ad3c-b01ee8ac7e82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1503 microversion: 2.1 time: 0.152481 Jul 27 22:51:20.780048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 169/345] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:20 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:20.803702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a5dfbc40-1cb1-41b6-97de-bd7bee8d9bcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49d0df01-6c9e-4c9d-b2eb-03335f35a0fa"}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:20.806130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a5dfbc40-1cb1-41b6-97de-bd7bee8d9bcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:20.812684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a5dfbc40-1cb1-41b6-97de-bd7bee8d9bcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.813123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a5dfbc40-1cb1-41b6-97de-bd7bee8d9bcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.813869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a5dfbc40-1cb1-41b6-97de-bd7bee8d9bcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.814296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a5dfbc40-1cb1-41b6-97de-bd7bee8d9bcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.837542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-a5dfbc40-1cb1-41b6-97de-bd7bee8d9bcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] HTTP exception thrown: Cannot 'attach_volume' instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 while it is in vm_state rescued Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a5dfbc40-1cb1-41b6-97de-bd7bee8d9bcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Request method failure captured: Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: POST /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6/os-volume_attachments HTTP/1.1 Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 74 Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cDsRp2x8UpNMJ6HnBL-04WjUw31hp5CQUUOuE9hX6DL43I06gDHp83bInXEQLrb4zFa-kZlcoaFH3UrxhEO0ftl3Kz56nR7Tj73l4oReVlfBtLEtyl0TNrPvrewHdkBZTsrykZJENrf-93DZvOEzTZW--OfosHDvz7hDCnuewnIq_c Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: fc02f444ea474300a879336c8b122303 Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1076644021 Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 22:51:20.839209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 22:51:20.840809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fc02f444ea474300a879336c8b122303"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fc02f444ea474300a879336c8b122303", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fc02f444ea474300a879336c8b122303"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fc02f444ea474300a879336c8b122303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:51:20.840809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1076644021 Jul 27 22:51:20.840809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: fc02f444ea474300a879336c8b122303 Jul 27 22:51:20.840809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1076644021 Jul 27 22:51:20.840809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-ServerRescueNegativeTestJSON-1076644021-project Jul 27 22:51:20.840809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 22:51:20.840809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 22:51:20.840809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: a5c5f856a38849a39d84b6cd0706da4e Jul 27 22:51:20.840809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1076644021-project Jul 27 22:51:20.840809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Jul 27 22:51:20.840809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {"volumeAttachment": {"volumeId": "49d0df01-6c9e-4c9d-b2eb-03335f35a0fa"}} Jul 27 22:51:20.840809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Cannot 'attach_volume' instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 while it is in vm_state rescued Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'server_id': 'b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6', 'body': {'volumeAttachment': {'volumeId': '49d0df01-6c9e-4c9d-b2eb-03335f35a0fa'}}} Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:51:20.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 while it is in vm_state rescued Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:51:20.843013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:51:20.844316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:51:20.844316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:51:20.844316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 while it is in vm_state rescued Jul 27 22:51:20.844316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:51:20.844316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a5dfbc40-1cb1-41b6-97de-bd7bee8d9bcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Returning 409 to user: Cannot 'attach_volume' instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 while it is in vm_state rescued {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:51:20.844316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a5dfbc40-1cb1-41b6-97de-bd7bee8d9bcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "POST /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040936 Jul 27 22:51:20.844316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 177/346] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 22:51:20 2022] POST /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 27 22:51:20.850080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ff084389-1568-4178-b094-a5c89516827e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:20.850707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ff084389-1568-4178-b094-a5c89516827e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:20.857126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff084389-1568-4178-b094-a5c89516827e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.857565 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff084389-1568-4178-b094-a5c89516827e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.858308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff084389-1568-4178-b094-a5c89516827e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.858731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff084389-1568-4178-b094-a5c89516827e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.924496 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ff084389-1568-4178-b094-a5c89516827e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "POST /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6/action" status: 202 len: 0 microversion: 2.1 time: 0.078331 Jul 27 22:51:20.925431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 170/347] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 22:51:20 2022] POST /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 22:51:20.935879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6677e267-f425-458c-8a97-1376b49fc644 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:20.936495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6677e267-f425-458c-8a97-1376b49fc644 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:20.942583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6677e267-f425-458c-8a97-1376b49fc644 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.943041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6677e267-f425-458c-8a97-1376b49fc644 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:20.943996 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6677e267-f425-458c-8a97-1376b49fc644 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:20.944427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6677e267-f425-458c-8a97-1376b49fc644 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:21.076854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6677e267-f425-458c-8a97-1376b49fc644 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:21.085182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6677e267-f425-458c-8a97-1376b49fc644 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.153947 Jul 27 22:51:21.085753 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 178/348] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:20 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:21.262466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d457764d-b7c9-4d98-b5d7-f120a6383a54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:21.263185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d457764d-b7c9-4d98-b5d7-f120a6383a54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:21.269330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d457764d-b7c9-4d98-b5d7-f120a6383a54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:21.269883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d457764d-b7c9-4d98-b5d7-f120a6383a54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:21.270724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d457764d-b7c9-4d98-b5d7-f120a6383a54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:21.271160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d457764d-b7c9-4d98-b5d7-f120a6383a54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:21.405532 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dac3e553-6cae-4bde-817e-fb0b7f56cd2d tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:21.406140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dac3e553-6cae-4bde-817e-fb0b7f56cd2d tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:21.406672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d457764d-b7c9-4d98-b5d7-f120a6383a54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:21.412050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dac3e553-6cae-4bde-817e-fb0b7f56cd2d tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:21.412494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dac3e553-6cae-4bde-817e-fb0b7f56cd2d tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:21.413360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dac3e553-6cae-4bde-817e-fb0b7f56cd2d tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:21.413714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dac3e553-6cae-4bde-817e-fb0b7f56cd2d tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:21.414961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d457764d-b7c9-4d98-b5d7-f120a6383a54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:21.416494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d457764d-b7c9-4d98-b5d7-f120a6383a54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:21.417719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d457764d-b7c9-4d98-b5d7-f120a6383a54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.159977 Jul 27 22:51:21.418267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 171/349] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:21 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:21.440646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-37531bc4-0043-465c-a86b-23b5a7e21a4f req-d073e2d5-da7b-45e7-b789-bb59b355b22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bffaba-accb-402a-952c-3922e7105086", "name": "network-vif-deleted", "tag": "6d3cc651-b6af-479e-9ef2-c0f131565d6c"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:21.450599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-37531bc4-0043-465c-a86b-23b5a7e21a4f req-d073e2d5-da7b-45e7-b789-bb59b355b22e service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:21.451034 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-37531bc4-0043-465c-a86b-23b5a7e21a4f req-d073e2d5-da7b-45e7-b789-bb59b355b22e service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:21.463573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-37531bc4-0043-465c-a86b-23b5a7e21a4f req-d073e2d5-da7b-45e7-b789-bb59b355b22e service nova] Creating event network-vif-deleted:6d3cc651-b6af-479e-9ef2-c0f131565d6c for instance 71bffaba-accb-402a-952c-3922e7105086 on hv-cinder-85124 Jul 27 22:51:21.468837 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-37531bc4-0043-465c-a86b-23b5a7e21a4f req-d073e2d5-da7b-45e7-b789-bb59b355b22e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031765 Jul 27 22:51:21.469428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 172/350] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:51:21.503795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-36da2754-9cd1-450d-abbe-a12e35a8633a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:21.504482 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-36da2754-9cd1-450d-abbe-a12e35a8633a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:21.510630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36da2754-9cd1-450d-abbe-a12e35a8633a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:21.511069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36da2754-9cd1-450d-abbe-a12e35a8633a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:21.511823 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36da2754-9cd1-450d-abbe-a12e35a8633a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:21.512255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36da2754-9cd1-450d-abbe-a12e35a8633a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:21.544355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36da2754-9cd1-450d-abbe-a12e35a8633a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:21.544798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36da2754-9cd1-450d-abbe-a12e35a8633a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:21.545242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.objects.instance [None req-36da2754-9cd1-450d-abbe-a12e35a8633a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lazy-loading 'fault' on Instance uuid 71bffaba-accb-402a-952c-3922e7105086 {{(pid=129294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:51:21.546708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dac3e553-6cae-4bde-817e-fb0b7f56cd2d tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:21.554399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dac3e553-6cae-4bde-817e-fb0b7f56cd2d tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.153293 Jul 27 22:51:21.555044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 179/351] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:21 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:21.586673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-36da2754-9cd1-450d-abbe-a12e35a8633a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:21.595082 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-36da2754-9cd1-450d-abbe-a12e35a8633a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1304 microversion: 2.1 time: 0.095435 Jul 27 22:51:21.595633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 173/352] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:21 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:22.108847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-13b0c838-59a5-48b9-adef-9647e28a7d3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:22.109449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-13b0c838-59a5-48b9-adef-9647e28a7d3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:22.115396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-13b0c838-59a5-48b9-adef-9647e28a7d3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:22.115829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-13b0c838-59a5-48b9-adef-9647e28a7d3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:22.116587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-13b0c838-59a5-48b9-adef-9647e28a7d3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:22.117047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-13b0c838-59a5-48b9-adef-9647e28a7d3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:22.262429 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-13b0c838-59a5-48b9-adef-9647e28a7d3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:22.269828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-13b0c838-59a5-48b9-adef-9647e28a7d3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.165334 Jul 27 22:51:22.270381 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 180/353] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:22 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:22.441166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-56db4425-39df-4143-b2bc-a7dbd6545416 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:22.441775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-56db4425-39df-4143-b2bc-a7dbd6545416 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:22.448251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-56db4425-39df-4143-b2bc-a7dbd6545416 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:22.448741 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-56db4425-39df-4143-b2bc-a7dbd6545416 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:22.449520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-56db4425-39df-4143-b2bc-a7dbd6545416 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:22.449956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-56db4425-39df-4143-b2bc-a7dbd6545416 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:22.467874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:22.574963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5d0a5e75-6c37-4a2c-a2d5-4f93dd87741f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:22.575562 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5d0a5e75-6c37-4a2c-a2d5-4f93dd87741f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:22.582048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d0a5e75-6c37-4a2c-a2d5-4f93dd87741f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:22.582489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d0a5e75-6c37-4a2c-a2d5-4f93dd87741f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:22.582744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-56db4425-39df-4143-b2bc-a7dbd6545416 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:22.583237 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d0a5e75-6c37-4a2c-a2d5-4f93dd87741f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:22.583661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d0a5e75-6c37-4a2c-a2d5-4f93dd87741f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:22.590950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-56db4425-39df-4143-b2bc-a7dbd6545416 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:22.592497 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-56db4425-39df-4143-b2bc-a7dbd6545416 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:22.593683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-56db4425-39df-4143-b2bc-a7dbd6545416 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.156695 Jul 27 22:51:22.594234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 174/354] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:22 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:22.616457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d9c6c7b5-226e-41c6-b341-c061227dce1a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:22.618930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d9c6c7b5-226e-41c6-b341-c061227dce1a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:22.626039 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9c6c7b5-226e-41c6-b341-c061227dce1a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:22.626484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9c6c7b5-226e-41c6-b341-c061227dce1a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:22.627261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9c6c7b5-226e-41c6-b341-c061227dce1a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:22.627690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9c6c7b5-226e-41c6-b341-c061227dce1a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:22.661170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9c6c7b5-226e-41c6-b341-c061227dce1a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:22.661709 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9c6c7b5-226e-41c6-b341-c061227dce1a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:22.662267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.objects.instance [None req-d9c6c7b5-226e-41c6-b341-c061227dce1a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lazy-loading 'fault' on Instance uuid 71bffaba-accb-402a-952c-3922e7105086 {{(pid=129294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:51:22.721082 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d9c6c7b5-226e-41c6-b341-c061227dce1a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:22.728913 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d9c6c7b5-226e-41c6-b341-c061227dce1a tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1304 microversion: 2.1 time: 0.116260 Jul 27 22:51:22.729478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 175/355] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:22 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:22.753761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5d0a5e75-6c37-4a2c-a2d5-4f93dd87741f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:22.761356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5d0a5e75-6c37-4a2c-a2d5-4f93dd87741f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.190253 Jul 27 22:51:22.763238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 181/356] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:22 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:23.290591 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a0a016c6-cc8e-415a-ac91-293885211500 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:23.291226 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a0a016c6-cc8e-415a-ac91-293885211500 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:23.297813 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a0a016c6-cc8e-415a-ac91-293885211500 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:23.298256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a0a016c6-cc8e-415a-ac91-293885211500 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:23.299009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a0a016c6-cc8e-415a-ac91-293885211500 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:23.299470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a0a016c6-cc8e-415a-ac91-293885211500 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:23.428762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a0a016c6-cc8e-415a-ac91-293885211500 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:23.436533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a0a016c6-cc8e-415a-ac91-293885211500 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.149702 Jul 27 22:51:23.437131 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 176/357] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:23 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:23.619324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f2ab7a78-9e4e-48a1-b536-bdba49890ca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:23.619935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f2ab7a78-9e4e-48a1-b536-bdba49890ca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:23.621938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:23.622658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=8 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:23.629355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f2ab7a78-9e4e-48a1-b536-bdba49890ca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:23.629809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f2ab7a78-9e4e-48a1-b536-bdba49890ca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:23.630579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f2ab7a78-9e4e-48a1-b536-bdba49890ca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:23.631014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f2ab7a78-9e4e-48a1-b536-bdba49890ca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:23.750509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fad91b9b-035e-425a-a94a-a365f3c2c3b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:23.751301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fad91b9b-035e-425a-a94a-a365f3c2c3b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:23.759335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fad91b9b-035e-425a-a94a-a365f3c2c3b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:23.759936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fad91b9b-035e-425a-a94a-a365f3c2c3b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:23.761566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fad91b9b-035e-425a-a94a-a365f3c2c3b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:23.762218 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fad91b9b-035e-425a-a94a-a365f3c2c3b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:23.770585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f2ab7a78-9e4e-48a1-b536-bdba49890ca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:23.780171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f2ab7a78-9e4e-48a1-b536-bdba49890ca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:23.781670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f2ab7a78-9e4e-48a1-b536-bdba49890ca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:23.782857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f2ab7a78-9e4e-48a1-b536-bdba49890ca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.167563 Jul 27 22:51:23.783398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 182/358] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:23 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:23.787704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-483192de-6f49-43db-9059-a59dde6bcbf5 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:23.788298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-483192de-6f49-43db-9059-a59dde6bcbf5 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:23.795481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-483192de-6f49-43db-9059-a59dde6bcbf5 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:23.796072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-483192de-6f49-43db-9059-a59dde6bcbf5 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:23.796983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-483192de-6f49-43db-9059-a59dde6bcbf5 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:23.797601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-483192de-6f49-43db-9059-a59dde6bcbf5 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:23.802036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fad91b9b-035e-425a-a94a-a365f3c2c3b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:23.802482 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fad91b9b-035e-425a-a94a-a365f3c2c3b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:23.802922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.objects.instance [None req-fad91b9b-035e-425a-a94a-a365f3c2c3b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lazy-loading 'fault' on Instance uuid 71bffaba-accb-402a-952c-3922e7105086 {{(pid=129294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:51:23.847481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fad91b9b-035e-425a-a94a-a365f3c2c3b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5916c224317640cf9c43596a1cbc585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53f93856f7c473d8fe70557c4f973dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:23.855257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fad91b9b-035e-425a-a94a-a365f3c2c3b5 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 200 len: 1304 microversion: 2.1 time: 0.109706 Jul 27 22:51:23.855820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 177/359] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:23 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:23.941640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-483192de-6f49-43db-9059-a59dde6bcbf5 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:23.945299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:23.950188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-483192de-6f49-43db-9059-a59dde6bcbf5 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.165861 Jul 27 22:51:23.950739 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 183/360] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:23 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:24.458666 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5e99358b-7878-4185-94c4-35b76c6fd3ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:24.459275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5e99358b-7878-4185-94c4-35b76c6fd3ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:24.465315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e99358b-7878-4185-94c4-35b76c6fd3ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:24.465786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e99358b-7878-4185-94c4-35b76c6fd3ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:24.466580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e99358b-7878-4185-94c4-35b76c6fd3ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:24.468386 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e99358b-7878-4185-94c4-35b76c6fd3ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:24.612208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5e99358b-7878-4185-94c4-35b76c6fd3ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:24.619988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5e99358b-7878-4185-94c4-35b76c6fd3ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.165418 Jul 27 22:51:24.620545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 178/361] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:24 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:24.806555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ae3b61d0-4c9f-4797-be57-e996c9e34fbc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:24.807187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ae3b61d0-4c9f-4797-be57-e996c9e34fbc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:24.814144 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae3b61d0-4c9f-4797-be57-e996c9e34fbc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:24.814578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae3b61d0-4c9f-4797-be57-e996c9e34fbc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:24.815321 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae3b61d0-4c9f-4797-be57-e996c9e34fbc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:24.815742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae3b61d0-4c9f-4797-be57-e996c9e34fbc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:24.877480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4b383bc0-1346-4bfc-b4dc-da3687775644 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:24.878082 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4b383bc0-1346-4bfc-b4dc-da3687775644 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] [instance: 71bffaba-accb-402a-952c-3922e7105086] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:24.884246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b383bc0-1346-4bfc-b4dc-da3687775644 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:24.884724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b383bc0-1346-4bfc-b4dc-da3687775644 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:24.885477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b383bc0-1346-4bfc-b4dc-da3687775644 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:24.885911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b383bc0-1346-4bfc-b4dc-da3687775644 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:24.899251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-4b383bc0-1346-4bfc-b4dc-da3687775644 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] HTTP exception thrown: Instance 71bffaba-accb-402a-952c-3922e7105086 could not be found. Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4b383bc0-1346-4bfc-b4dc-da3687775644 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Request method failure captured: Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 HTTP/1.1 Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cE7pYsubZQlwrASEC77QkLj2Lg0cClWJ9R_RfNnLOexC8QSY4vyVWwm-HSvc0gUMsRZZ6xuL6rt6Xe-DwKFKIXomafLIStaXqD4ZUA0Dorzh_ZJObAC4WrunR20uUpWIBn3ny5LYiMUbjs9ETQn0PvZHoeJQ4pQPeKq6mOhIu64drs Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: e53f93856f7c473d8fe70557c4f973dd Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-VolumesActionsTest-677649129 Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 22:51:24.900887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 22:51:24.902453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e53f93856f7c473d8fe70557c4f973dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e53f93856f7c473d8fe70557c4f973dd", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53f93856f7c473d8fe70557c4f973dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e53f93856f7c473d8fe70557c4f973dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:51:24.902453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-VolumesActionsTest-677649129 Jul 27 22:51:24.902453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: e53f93856f7c473d8fe70557c4f973dd Jul 27 22:51:24.902453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-VolumesActionsTest-677649129 Jul 27 22:51:24.902453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-VolumesActionsTest-677649129-project Jul 27 22:51:24.902453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 22:51:24.902453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 22:51:24.902453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 5916c224317640cf9c43596a1cbc585e Jul 27 22:51:24.902453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-VolumesActionsTest-677649129-project Jul 27 22:51:24.902453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 22:51:24.902453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance 71bffaba-accb-402a-952c-3922e7105086 could not be found. Jul 27 22:51:24.902453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '71bffaba-accb-402a-952c-3922e7105086'} Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bffaba-accb-402a-952c-3922e7105086 could not be found. Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:51:24.903306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bffaba-accb-402a-952c-3922e7105086 could not be found. Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bffaba-accb-402a-952c-3922e7105086 could not be found. Jul 27 22:51:24.905215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:24.906295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4b383bc0-1346-4bfc-b4dc-da3687775644 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] Returning 404 to user: Instance 71bffaba-accb-402a-952c-3922e7105086 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:51:24.906295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4b383bc0-1346-4bfc-b4dc-da3687775644 tempest-VolumesActionsTest-677649129 tempest-VolumesActionsTest-677649129-project] 10.222.0.47 "GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086" status: 404 len: 111 microversion: 2.1 time: 0.028821 Jul 27 22:51:24.907395 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 179/362] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:24 2022] GET /compute/v2.1/servers/71bffaba-accb-402a-952c-3922e7105086 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 22:51:24.948613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ae3b61d0-4c9f-4797-be57-e996c9e34fbc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:24.958031 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ae3b61d0-4c9f-4797-be57-e996c9e34fbc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:24.960092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ae3b61d0-4c9f-4797-be57-e996c9e34fbc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:24.961861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ae3b61d0-4c9f-4797-be57-e996c9e34fbc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.159286 Jul 27 22:51:24.962567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 184/363] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:24 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:24.971901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-83e01b6b-d4c4-4aa1-8d2a-52783b2c19b4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:24.972444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-83e01b6b-d4c4-4aa1-8d2a-52783b2c19b4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:24.979057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83e01b6b-d4c4-4aa1-8d2a-52783b2c19b4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:24.979735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83e01b6b-d4c4-4aa1-8d2a-52783b2c19b4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:24.980493 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83e01b6b-d4c4-4aa1-8d2a-52783b2c19b4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:24.980949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83e01b6b-d4c4-4aa1-8d2a-52783b2c19b4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:25.111401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-83e01b6b-d4c4-4aa1-8d2a-52783b2c19b4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:25.119957 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-83e01b6b-d4c4-4aa1-8d2a-52783b2c19b4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.151924 Jul 27 22:51:25.120515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 180/364] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:24 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:25.642483 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dd9324a0-93c9-4f1e-8861-91fd516e841c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:25.643165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dd9324a0-93c9-4f1e-8861-91fd516e841c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:25.653735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd9324a0-93c9-4f1e-8861-91fd516e841c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:25.654175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd9324a0-93c9-4f1e-8861-91fd516e841c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:25.655192 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd9324a0-93c9-4f1e-8861-91fd516e841c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:25.655625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd9324a0-93c9-4f1e-8861-91fd516e841c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:25.788834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dd9324a0-93c9-4f1e-8861-91fd516e841c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:25.796460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dd9324a0-93c9-4f1e-8861-91fd516e841c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.159325 Jul 27 22:51:25.797145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 185/365] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:25 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:25.986117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a1c6b728-ed72-4dd9-92cb-1e161d5f9518 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:25.986719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a1c6b728-ed72-4dd9-92cb-1e161d5f9518 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:25.993136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1c6b728-ed72-4dd9-92cb-1e161d5f9518 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:25.993575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1c6b728-ed72-4dd9-92cb-1e161d5f9518 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:25.994322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1c6b728-ed72-4dd9-92cb-1e161d5f9518 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:25.994748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1c6b728-ed72-4dd9-92cb-1e161d5f9518 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:26.123855 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1c6b728-ed72-4dd9-92cb-1e161d5f9518 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:26.131816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1c6b728-ed72-4dd9-92cb-1e161d5f9518 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:26.133340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1c6b728-ed72-4dd9-92cb-1e161d5f9518 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:26.134527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a1c6b728-ed72-4dd9-92cb-1e161d5f9518 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.152548 Jul 27 22:51:26.135267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 181/366] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:25 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:26.141176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-66153d90-db88-4266-8445-97b59e7176f1 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:26.141817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-66153d90-db88-4266-8445-97b59e7176f1 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:26.147811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66153d90-db88-4266-8445-97b59e7176f1 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:26.148251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66153d90-db88-4266-8445-97b59e7176f1 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:26.149043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66153d90-db88-4266-8445-97b59e7176f1 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:26.149474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66153d90-db88-4266-8445-97b59e7176f1 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:26.279838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-66153d90-db88-4266-8445-97b59e7176f1 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:26.287723 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-66153d90-db88-4266-8445-97b59e7176f1 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.150592 Jul 27 22:51:26.288283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 186/367] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:26 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:26.820350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-01edf066-e16b-4f9c-91b0-f1f45af4378d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:26.820996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-01edf066-e16b-4f9c-91b0-f1f45af4378d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:26.827059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01edf066-e16b-4f9c-91b0-f1f45af4378d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:26.827498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01edf066-e16b-4f9c-91b0-f1f45af4378d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:26.828251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01edf066-e16b-4f9c-91b0-f1f45af4378d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:26.828708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01edf066-e16b-4f9c-91b0-f1f45af4378d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:26.960163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-01edf066-e16b-4f9c-91b0-f1f45af4378d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:26.971803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-01edf066-e16b-4f9c-91b0-f1f45af4378d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.154972 Jul 27 22:51:26.973213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 182/368] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:26 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:27.158262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b5254339-76ca-4952-9d4f-e24090425432 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:27.158861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b5254339-76ca-4952-9d4f-e24090425432 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:27.166435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5254339-76ca-4952-9d4f-e24090425432 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:27.166873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5254339-76ca-4952-9d4f-e24090425432 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:27.167635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5254339-76ca-4952-9d4f-e24090425432 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:27.168059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5254339-76ca-4952-9d4f-e24090425432 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:27.294868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b5254339-76ca-4952-9d4f-e24090425432 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:27.303656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b5254339-76ca-4952-9d4f-e24090425432 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:27.305187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b5254339-76ca-4952-9d4f-e24090425432 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:27.306339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b5254339-76ca-4952-9d4f-e24090425432 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.153627 Jul 27 22:51:27.316573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 187/369] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:27 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:27.316930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d0da8905-b063-49db-9340-9d5ee987656f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:27.316930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d0da8905-b063-49db-9340-9d5ee987656f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:27.316930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d0da8905-b063-49db-9340-9d5ee987656f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:27.316930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d0da8905-b063-49db-9340-9d5ee987656f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:27.317547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d0da8905-b063-49db-9340-9d5ee987656f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:27.317547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d0da8905-b063-49db-9340-9d5ee987656f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:27.453756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d0da8905-b063-49db-9340-9d5ee987656f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:27.461032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d0da8905-b063-49db-9340-9d5ee987656f tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.156752 Jul 27 22:51:27.461584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 183/370] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:27 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:27.995523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-96d0320c-31dd-47b9-8233-28d202209899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:27.996125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-96d0320c-31dd-47b9-8233-28d202209899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:28.002536 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96d0320c-31dd-47b9-8233-28d202209899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:28.002976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96d0320c-31dd-47b9-8233-28d202209899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:28.003726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96d0320c-31dd-47b9-8233-28d202209899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:28.004148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96d0320c-31dd-47b9-8233-28d202209899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:28.134177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-96d0320c-31dd-47b9-8233-28d202209899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:28.142306 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-96d0320c-31dd-47b9-8233-28d202209899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.150824 Jul 27 22:51:28.142874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 188/371] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:27 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:28.331803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7c55dd82-2828-4447-8e02-1989aaf97d2f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:28.333048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7c55dd82-2828-4447-8e02-1989aaf97d2f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:28.341185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7c55dd82-2828-4447-8e02-1989aaf97d2f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:28.341994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7c55dd82-2828-4447-8e02-1989aaf97d2f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:28.343232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7c55dd82-2828-4447-8e02-1989aaf97d2f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:28.344095 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7c55dd82-2828-4447-8e02-1989aaf97d2f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:28.482349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6689df06-2f16-436e-9b34-439b436949e4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:28.483689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6689df06-2f16-436e-9b34-439b436949e4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:28.489157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7c55dd82-2828-4447-8e02-1989aaf97d2f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:28.490706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6689df06-2f16-436e-9b34-439b436949e4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:28.491229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6689df06-2f16-436e-9b34-439b436949e4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:28.492245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6689df06-2f16-436e-9b34-439b436949e4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:28.492768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6689df06-2f16-436e-9b34-439b436949e4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:28.497886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7c55dd82-2828-4447-8e02-1989aaf97d2f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:28.499386 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7c55dd82-2828-4447-8e02-1989aaf97d2f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:28.500618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7c55dd82-2828-4447-8e02-1989aaf97d2f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.174673 Jul 27 22:51:28.501213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 184/372] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:28 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:28.635242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6689df06-2f16-436e-9b34-439b436949e4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:28.642676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6689df06-2f16-436e-9b34-439b436949e4 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.164569 Jul 27 22:51:28.643224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 189/373] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:28 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:29.163175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-775c4b02-dfc8-44ec-b7d7-b65531e022b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:29.163849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-775c4b02-dfc8-44ec-b7d7-b65531e022b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:29.169865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-775c4b02-dfc8-44ec-b7d7-b65531e022b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:29.170306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-775c4b02-dfc8-44ec-b7d7-b65531e022b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:29.171088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-775c4b02-dfc8-44ec-b7d7-b65531e022b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:29.171499 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-775c4b02-dfc8-44ec-b7d7-b65531e022b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:29.295088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-775c4b02-dfc8-44ec-b7d7-b65531e022b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:29.304192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-775c4b02-dfc8-44ec-b7d7-b65531e022b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.144831 Jul 27 22:51:29.304773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 185/374] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:29 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:29.523195 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-58c85148-41db-4f93-9e46-e423d2b427e9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:29.523720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-58c85148-41db-4f93-9e46-e423d2b427e9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:29.529775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-58c85148-41db-4f93-9e46-e423d2b427e9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:29.530221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-58c85148-41db-4f93-9e46-e423d2b427e9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:29.530970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-58c85148-41db-4f93-9e46-e423d2b427e9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:29.531401 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-58c85148-41db-4f93-9e46-e423d2b427e9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:29.659719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-58c85148-41db-4f93-9e46-e423d2b427e9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:29.662711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3b002a79-e583-4881-a6c7-d029ef8768cc tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:29.663316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3b002a79-e583-4881-a6c7-d029ef8768cc tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:29.667742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-58c85148-41db-4f93-9e46-e423d2b427e9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:29.669292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-58c85148-41db-4f93-9e46-e423d2b427e9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:29.669916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b002a79-e583-4881-a6c7-d029ef8768cc tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:29.670350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b002a79-e583-4881-a6c7-d029ef8768cc tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:29.670450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-58c85148-41db-4f93-9e46-e423d2b427e9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.151180 Jul 27 22:51:29.670963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 190/375] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:29 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:29.671101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b002a79-e583-4881-a6c7-d029ef8768cc tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:29.672026 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b002a79-e583-4881-a6c7-d029ef8768cc tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:29.798319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3b002a79-e583-4881-a6c7-d029ef8768cc tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:29.805629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3b002a79-e583-4881-a6c7-d029ef8768cc tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.146685 Jul 27 22:51:29.806180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 186/376] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:29 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:30.325644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-087300b6-856c-42dc-b8bb-e9350ae35338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:30.326272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-087300b6-856c-42dc-b8bb-e9350ae35338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:30.332242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-087300b6-856c-42dc-b8bb-e9350ae35338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:30.332729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-087300b6-856c-42dc-b8bb-e9350ae35338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:30.333512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-087300b6-856c-42dc-b8bb-e9350ae35338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:30.333944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-087300b6-856c-42dc-b8bb-e9350ae35338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:30.638223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-087300b6-856c-42dc-b8bb-e9350ae35338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:30.646123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-087300b6-856c-42dc-b8bb-e9350ae35338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.324371 Jul 27 22:51:30.646669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 191/377] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:30 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:30.693735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5ab0ae12-a653-47d3-b96f-0271c151173d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:30.694306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5ab0ae12-a653-47d3-b96f-0271c151173d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:30.700900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5ab0ae12-a653-47d3-b96f-0271c151173d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:30.701344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5ab0ae12-a653-47d3-b96f-0271c151173d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:30.702108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5ab0ae12-a653-47d3-b96f-0271c151173d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:30.702540 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5ab0ae12-a653-47d3-b96f-0271c151173d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:30.826724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ab0e8fbc-42c3-4271-8841-73dbad26fa3c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:30.827328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ab0e8fbc-42c3-4271-8841-73dbad26fa3c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:30.829769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:30.834915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ab0e8fbc-42c3-4271-8841-73dbad26fa3c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:30.835363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ab0e8fbc-42c3-4271-8841-73dbad26fa3c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:30.836125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ab0e8fbc-42c3-4271-8841-73dbad26fa3c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:30.836581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ab0e8fbc-42c3-4271-8841-73dbad26fa3c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:30.843870 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5ab0ae12-a653-47d3-b96f-0271c151173d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:30.851989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5ab0ae12-a653-47d3-b96f-0271c151173d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:30.853521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5ab0ae12-a653-47d3-b96f-0271c151173d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:30.854727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5ab0ae12-a653-47d3-b96f-0271c151173d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.164902 Jul 27 22:51:30.855267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 187/378] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:30.967866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ab0e8fbc-42c3-4271-8841-73dbad26fa3c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:30.976160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ab0e8fbc-42c3-4271-8841-73dbad26fa3c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.152545 Jul 27 22:51:30.980028 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 192/379] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:30 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:31.666937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2035255b-7803-47ff-a42d-f17ea80cc6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:31.667550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2035255b-7803-47ff-a42d-f17ea80cc6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:31.673555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2035255b-7803-47ff-a42d-f17ea80cc6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:31.674004 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2035255b-7803-47ff-a42d-f17ea80cc6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:31.674767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2035255b-7803-47ff-a42d-f17ea80cc6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:31.675200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2035255b-7803-47ff-a42d-f17ea80cc6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:31.802038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2035255b-7803-47ff-a42d-f17ea80cc6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:31.809437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2035255b-7803-47ff-a42d-f17ea80cc6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.146238 Jul 27 22:51:31.809991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 188/380] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:31 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:31.878198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-07cdd370-68f5-4702-b964-b5287b71771f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:31.878811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-07cdd370-68f5-4702-b964-b5287b71771f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:31.884812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07cdd370-68f5-4702-b964-b5287b71771f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:31.885259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07cdd370-68f5-4702-b964-b5287b71771f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:31.886015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07cdd370-68f5-4702-b964-b5287b71771f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:31.886448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07cdd370-68f5-4702-b964-b5287b71771f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:31.999264 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d3b78b48-3d1a-4f14-892d-1d2987678e9e tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:32.000515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d3b78b48-3d1a-4f14-892d-1d2987678e9e tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:32.007055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3b78b48-3d1a-4f14-892d-1d2987678e9e tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:32.007501 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3b78b48-3d1a-4f14-892d-1d2987678e9e tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:32.008664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3b78b48-3d1a-4f14-892d-1d2987678e9e tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:32.009291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3b78b48-3d1a-4f14-892d-1d2987678e9e tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:32.021376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-07cdd370-68f5-4702-b964-b5287b71771f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:32.031680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-07cdd370-68f5-4702-b964-b5287b71771f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:32.033326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-07cdd370-68f5-4702-b964-b5287b71771f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:32.034564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-07cdd370-68f5-4702-b964-b5287b71771f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.160834 Jul 27 22:51:32.036598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 193/381] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:31 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:32.144164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-40db197f-d6a5-488c-90ae-d76f44f4a8e7 req-a5b008ea-530f-43e9-8c50-b251713b6856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29c5888-2a33-4b7c-887c-3d121f51c045", "name": "network-vif-plugged", "status": "completed", "tag": "46802986-4219-4000-8b11-a7d6d2866f86"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:32.154663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-40db197f-d6a5-488c-90ae-d76f44f4a8e7 req-a5b008ea-530f-43e9-8c50-b251713b6856 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:32.155314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-40db197f-d6a5-488c-90ae-d76f44f4a8e7 req-a5b008ea-530f-43e9-8c50-b251713b6856 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:32.156274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d3b78b48-3d1a-4f14-892d-1d2987678e9e tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:32.163925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d3b78b48-3d1a-4f14-892d-1d2987678e9e tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.168458 Jul 27 22:51:32.164861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 189/382] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:31 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:32.168657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-40db197f-d6a5-488c-90ae-d76f44f4a8e7 req-a5b008ea-530f-43e9-8c50-b251713b6856 service nova] Creating event network-vif-plugged:46802986-4219-4000-8b11-a7d6d2866f86 for instance e29c5888-2a33-4b7c-887c-3d121f51c045 on hv-cinder-85124 Jul 27 22:51:32.174743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-40db197f-d6a5-488c-90ae-d76f44f4a8e7 req-a5b008ea-530f-43e9-8c50-b251713b6856 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034240 Jul 27 22:51:32.175464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 194/383] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:51:32.830550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6caf93d7-5862-4bb3-87f5-5ee354ba008d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:32.831189 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6caf93d7-5862-4bb3-87f5-5ee354ba008d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:32.838169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6caf93d7-5862-4bb3-87f5-5ee354ba008d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:32.838617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6caf93d7-5862-4bb3-87f5-5ee354ba008d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:32.839373 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6caf93d7-5862-4bb3-87f5-5ee354ba008d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:32.839800 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6caf93d7-5862-4bb3-87f5-5ee354ba008d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:32.965403 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6caf93d7-5862-4bb3-87f5-5ee354ba008d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:32.973232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6caf93d7-5862-4bb3-87f5-5ee354ba008d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.146528 Jul 27 22:51:32.973783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 190/384] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:32 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:33.058341 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-19ded6e9-38ed-4d66-8a26-fc77c862a5f7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:33.059025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-19ded6e9-38ed-4d66-8a26-fc77c862a5f7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:33.065456 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19ded6e9-38ed-4d66-8a26-fc77c862a5f7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:33.065845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19ded6e9-38ed-4d66-8a26-fc77c862a5f7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:33.066606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19ded6e9-38ed-4d66-8a26-fc77c862a5f7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:33.067039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19ded6e9-38ed-4d66-8a26-fc77c862a5f7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:33.185800 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e93d6be7-8276-45b3-972a-a623d796612c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:33.197445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e93d6be7-8276-45b3-972a-a623d796612c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:33.201826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-19ded6e9-38ed-4d66-8a26-fc77c862a5f7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:33.203706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e93d6be7-8276-45b3-972a-a623d796612c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:33.204153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e93d6be7-8276-45b3-972a-a623d796612c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:33.205044 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e93d6be7-8276-45b3-972a-a623d796612c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:33.205511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e93d6be7-8276-45b3-972a-a623d796612c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:33.209496 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:33.210082 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-19ded6e9-38ed-4d66-8a26-fc77c862a5f7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:33.211445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-19ded6e9-38ed-4d66-8a26-fc77c862a5f7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:33.212645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-19ded6e9-38ed-4d66-8a26-fc77c862a5f7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.158432 Jul 27 22:51:33.213441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 195/385] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:33.332241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e93d6be7-8276-45b3-972a-a623d796612c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:33.339731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e93d6be7-8276-45b3-972a-a623d796612c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.157979 Jul 27 22:51:33.340290 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 191/386] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:33 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:33.995386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2504a71c-4fe1-4334-a6a9-250644cd1b18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:33.995923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2504a71c-4fe1-4334-a6a9-250644cd1b18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:34.002679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2504a71c-4fe1-4334-a6a9-250644cd1b18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:34.003103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2504a71c-4fe1-4334-a6a9-250644cd1b18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:34.003856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2504a71c-4fe1-4334-a6a9-250644cd1b18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:34.004288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2504a71c-4fe1-4334-a6a9-250644cd1b18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:34.137103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2504a71c-4fe1-4334-a6a9-250644cd1b18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:34.144976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2504a71c-4fe1-4334-a6a9-250644cd1b18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.153395 Jul 27 22:51:34.145530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 196/387] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:33 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:34.236607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fdf86a5d-3cae-4df1-804a-526640f47de3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:34.237253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fdf86a5d-3cae-4df1-804a-526640f47de3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:34.243926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdf86a5d-3cae-4df1-804a-526640f47de3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:34.244369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdf86a5d-3cae-4df1-804a-526640f47de3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:34.245188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdf86a5d-3cae-4df1-804a-526640f47de3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:34.245672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdf86a5d-3cae-4df1-804a-526640f47de3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:34.361715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3b32371d-6782-4675-9a20-526c4453985a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:34.362631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3b32371d-6782-4675-9a20-526c4453985a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:34.368497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b32371d-6782-4675-9a20-526c4453985a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:34.368969 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b32371d-6782-4675-9a20-526c4453985a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:34.369793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b32371d-6782-4675-9a20-526c4453985a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:34.370255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b32371d-6782-4675-9a20-526c4453985a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:34.371901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fdf86a5d-3cae-4df1-804a-526640f47de3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:34.380355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fdf86a5d-3cae-4df1-804a-526640f47de3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:34.381880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fdf86a5d-3cae-4df1-804a-526640f47de3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:34.383030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fdf86a5d-3cae-4df1-804a-526640f47de3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.150737 Jul 27 22:51:34.383580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 192/388] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:34 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:34.500308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3b32371d-6782-4675-9a20-526c4453985a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:34.507791 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3b32371d-6782-4675-9a20-526c4453985a tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.150500 Jul 27 22:51:34.508354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 197/389] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:34 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:35.166168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ba496db0-f695-463e-8843-fb0bad74c558 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:35.166819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ba496db0-f695-463e-8843-fb0bad74c558 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:35.173032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba496db0-f695-463e-8843-fb0bad74c558 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:35.173475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba496db0-f695-463e-8843-fb0bad74c558 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:35.174241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba496db0-f695-463e-8843-fb0bad74c558 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:35.174774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba496db0-f695-463e-8843-fb0bad74c558 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:35.309182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ba496db0-f695-463e-8843-fb0bad74c558 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:35.317454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ba496db0-f695-463e-8843-fb0bad74c558 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.155307 Jul 27 22:51:35.318006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 193/390] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:35 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:35.404988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d23d85e9-3fbc-435e-88e9-ad636225c832 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:35.405886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d23d85e9-3fbc-435e-88e9-ad636225c832 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:35.411822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d23d85e9-3fbc-435e-88e9-ad636225c832 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:35.412258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d23d85e9-3fbc-435e-88e9-ad636225c832 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:35.413037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d23d85e9-3fbc-435e-88e9-ad636225c832 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:35.413470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d23d85e9-3fbc-435e-88e9-ad636225c832 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:35.528208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3bfd864f-f547-495b-bb23-ee5e6c2add68 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:35.528939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3bfd864f-f547-495b-bb23-ee5e6c2add68 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:35.534904 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3bfd864f-f547-495b-bb23-ee5e6c2add68 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:35.535341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3bfd864f-f547-495b-bb23-ee5e6c2add68 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:35.536100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3bfd864f-f547-495b-bb23-ee5e6c2add68 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:35.536527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3bfd864f-f547-495b-bb23-ee5e6c2add68 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:35.538785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d23d85e9-3fbc-435e-88e9-ad636225c832 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:35.547151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d23d85e9-3fbc-435e-88e9-ad636225c832 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:35.548814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d23d85e9-3fbc-435e-88e9-ad636225c832 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:35.549963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d23d85e9-3fbc-435e-88e9-ad636225c832 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.148830 Jul 27 22:51:35.550508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 198/391] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:35.666634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3bfd864f-f547-495b-bb23-ee5e6c2add68 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:35.675511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3bfd864f-f547-495b-bb23-ee5e6c2add68 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.150992 Jul 27 22:51:35.676074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 194/392] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:35 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:36.340505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ccbc58ef-01a7-4db3-b588-c087b6721fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:36.341515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ccbc58ef-01a7-4db3-b588-c087b6721fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:36.350969 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccbc58ef-01a7-4db3-b588-c087b6721fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:36.351426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccbc58ef-01a7-4db3-b588-c087b6721fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:36.352201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccbc58ef-01a7-4db3-b588-c087b6721fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:36.352724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccbc58ef-01a7-4db3-b588-c087b6721fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:36.573633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cf5a9eb6-be17-4dd9-951f-33ed9cebde7d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:36.574319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cf5a9eb6-be17-4dd9-951f-33ed9cebde7d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:36.585136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cf5a9eb6-be17-4dd9-951f-33ed9cebde7d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:36.586937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cf5a9eb6-be17-4dd9-951f-33ed9cebde7d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:36.587828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cf5a9eb6-be17-4dd9-951f-33ed9cebde7d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:36.588481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cf5a9eb6-be17-4dd9-951f-33ed9cebde7d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:36.640085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ccbc58ef-01a7-4db3-b588-c087b6721fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:36.659700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ccbc58ef-01a7-4db3-b588-c087b6721fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1511 microversion: 2.1 time: 0.324842 Jul 27 22:51:36.663994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 199/393] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:36 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:36.698548 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b3f198b8-7418-49ad-b80f-e81db5d4aa96 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:36.699832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b3f198b8-7418-49ad-b80f-e81db5d4aa96 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:36.714519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3f198b8-7418-49ad-b80f-e81db5d4aa96 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:36.715078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3f198b8-7418-49ad-b80f-e81db5d4aa96 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:36.716156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3f198b8-7418-49ad-b80f-e81db5d4aa96 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:36.720116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3f198b8-7418-49ad-b80f-e81db5d4aa96 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:36.790696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cf5a9eb6-be17-4dd9-951f-33ed9cebde7d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:36.815293 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cf5a9eb6-be17-4dd9-951f-33ed9cebde7d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:36.819647 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cf5a9eb6-be17-4dd9-951f-33ed9cebde7d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:36.820906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cf5a9eb6-be17-4dd9-951f-33ed9cebde7d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1722 microversion: 2.20 time: 0.251624 Jul 27 22:51:36.821464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 195/394] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:51:36.948697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b3f198b8-7418-49ad-b80f-e81db5d4aa96 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:36.957893 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b3f198b8-7418-49ad-b80f-e81db5d4aa96 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.263551 Jul 27 22:51:36.958801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 200/395] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:36 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:37.686163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4acbc7d7-0b73-40f4-8497-ac71658f6718 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:37.686856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4acbc7d7-0b73-40f4-8497-ac71658f6718 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:37.698508 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4acbc7d7-0b73-40f4-8497-ac71658f6718 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:37.699048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4acbc7d7-0b73-40f4-8497-ac71658f6718 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:37.699895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4acbc7d7-0b73-40f4-8497-ac71658f6718 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:37.700541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4acbc7d7-0b73-40f4-8497-ac71658f6718 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:37.849379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-79201828-eb9e-439c-9a6c-051eee8c8137 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:37.851312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-79201828-eb9e-439c-9a6c-051eee8c8137 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:37.857877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79201828-eb9e-439c-9a6c-051eee8c8137 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:37.858859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79201828-eb9e-439c-9a6c-051eee8c8137 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:37.859883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79201828-eb9e-439c-9a6c-051eee8c8137 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:37.860872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79201828-eb9e-439c-9a6c-051eee8c8137 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:37.865839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:37.877784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4acbc7d7-0b73-40f4-8497-ac71658f6718 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:37.894082 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4acbc7d7-0b73-40f4-8497-ac71658f6718 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1517 microversion: 2.1 time: 0.212236 Jul 27 22:51:37.895226 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 196/396] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:37 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1517 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:37.988306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7a682063-298c-4a59-a007-137be6b7a451 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:37.989351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7a682063-298c-4a59-a007-137be6b7a451 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:37.998525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a682063-298c-4a59-a007-137be6b7a451 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:38.001164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a682063-298c-4a59-a007-137be6b7a451 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:38.003718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a682063-298c-4a59-a007-137be6b7a451 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:38.004688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a682063-298c-4a59-a007-137be6b7a451 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:38.166062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-79201828-eb9e-439c-9a6c-051eee8c8137 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:38.176452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-79201828-eb9e-439c-9a6c-051eee8c8137 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:38.178428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-79201828-eb9e-439c-9a6c-051eee8c8137 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:38.179899 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-79201828-eb9e-439c-9a6c-051eee8c8137 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1743 microversion: 2.20 time: 0.334620 Jul 27 22:51:38.181048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 201/397] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1743 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:51:38.186243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c93dc7cc-cb06-4a69-85d1-3781848123f5 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:38.212493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c93dc7cc-cb06-4a69-85d1-3781848123f5 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:38.213378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c93dc7cc-cb06-4a69-85d1-3781848123f5 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:38.287525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7a682063-298c-4a59-a007-137be6b7a451 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:38.299476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7a682063-298c-4a59-a007-137be6b7a451 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1314 microversion: 2.1 time: 0.318090 Jul 27 22:51:38.300144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 197/398] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:37 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:38.406087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c93dc7cc-cb06-4a69-85d1-3781848123f5 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Going to try to stop instance {{(pid=129295) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 27 22:51:38.475355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c93dc7cc-cb06-4a69-85d1-3781848123f5 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "POST /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/action" status: 202 len: 0 microversion: 2.1 time: 0.292692 Jul 27 22:51:38.476056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 202/399] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 22:51:38 2022] POST /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 22:51:38.484868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5946850e-ccd8-496e-b1b7-83de9e2df808 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:38.485929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5946850e-ccd8-496e-b1b7-83de9e2df808 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:38.493140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5946850e-ccd8-496e-b1b7-83de9e2df808 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:38.494522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5946850e-ccd8-496e-b1b7-83de9e2df808 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:38.495380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5946850e-ccd8-496e-b1b7-83de9e2df808 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:38.495977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5946850e-ccd8-496e-b1b7-83de9e2df808 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:38.692779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5946850e-ccd8-496e-b1b7-83de9e2df808 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:38.701587 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5946850e-ccd8-496e-b1b7-83de9e2df808 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1723 microversion: 2.1 time: 0.221103 Jul 27 22:51:38.715624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 198/400] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:38 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:39.212592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-813c4c7c-167d-421b-9916-6b1a1f302ef7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:39.213328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-813c4c7c-167d-421b-9916-6b1a1f302ef7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:39.230031 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-813c4c7c-167d-421b-9916-6b1a1f302ef7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:39.230471 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-813c4c7c-167d-421b-9916-6b1a1f302ef7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:39.231256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-813c4c7c-167d-421b-9916-6b1a1f302ef7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:39.231879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-813c4c7c-167d-421b-9916-6b1a1f302ef7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:39.331671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-95037113-b099-4454-a0bc-e9d041eda403 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:39.332930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-95037113-b099-4454-a0bc-e9d041eda403 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:39.345071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-95037113-b099-4454-a0bc-e9d041eda403 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:39.345907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-95037113-b099-4454-a0bc-e9d041eda403 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:39.346944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-95037113-b099-4454-a0bc-e9d041eda403 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:39.347648 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-95037113-b099-4454-a0bc-e9d041eda403 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:39.529089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-813c4c7c-167d-421b-9916-6b1a1f302ef7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:39.539066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-813c4c7c-167d-421b-9916-6b1a1f302ef7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:39.541127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-813c4c7c-167d-421b-9916-6b1a1f302ef7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:39.542593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-813c4c7c-167d-421b-9916-6b1a1f302ef7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1743 microversion: 2.20 time: 0.340574 Jul 27 22:51:39.543978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 203/401] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1743 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:39.549134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-255db4b4-42c7-4c39-888b-6a0c8a1350b9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Action: 'create', calling method: .version_select at 0x7f696a2d19d0>, body: {"keypair": {"name": "tempest-keypair-359978473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAC/xgZTzKAGDqPP5t92+u46deRodE5LvMSRyPXUUbcapIzBFyfgm7DTp8alyHYJjLvxSiCfxhhNBg2aSRFnO/Cii4Ll2UvVMl3m9oSp+RP4eLZX5z6WYSZdUItVIC+tw=="}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:39.567108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-255db4b4-42c7-4c39-888b-6a0c8a1350b9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Getting quotas for project fc02f444ea474300a879336c8b122303. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:51:39.571543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-255db4b4-42c7-4c39-888b-6a0c8a1350b9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Getting quotas for user a5c5f856a38849a39d84b6cd0706da4e and project fc02f444ea474300a879336c8b122303. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:51:39.616358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-255db4b4-42c7-4c39-888b-6a0c8a1350b9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071270 Jul 27 22:51:39.617109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 204/402] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 22:51:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:51:39.663409 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-95037113-b099-4454-a0bc-e9d041eda403 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:39.677007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-95037113-b099-4454-a0bc-e9d041eda403 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1464 microversion: 2.1 time: 0.348794 Jul 27 22:51:39.680254 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 199/403] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:39 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1464 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:39.725163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6a5392c3-af41-4624-9eb7-1d1b8f8d1c0e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:39.726645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6a5392c3-af41-4624-9eb7-1d1b8f8d1c0e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:39.736383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6a5392c3-af41-4624-9eb7-1d1b8f8d1c0e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:39.736789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6a5392c3-af41-4624-9eb7-1d1b8f8d1c0e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:39.738312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6a5392c3-af41-4624-9eb7-1d1b8f8d1c0e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:39.738826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6a5392c3-af41-4624-9eb7-1d1b8f8d1c0e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:39.741173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-35620934-20b2-4873-9358-a686812d971b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:39.741747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-35620934-20b2-4873-9358-a686812d971b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:39.753761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-35620934-20b2-4873-9358-a686812d971b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:39.754630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-35620934-20b2-4873-9358-a686812d971b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:39.756242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-35620934-20b2-4873-9358-a686812d971b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:39.756953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-35620934-20b2-4873-9358-a686812d971b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:39.825703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-35620934-20b2-4873-9358-a686812d971b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Going to try to terminate instance {{(pid=129294) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 22:51:39.942358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:39.947797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-35620934-20b2-4873-9358-a686812d971b tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 204 len: 0 microversion: 2.1 time: 0.210377 Jul 27 22:51:39.949405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 200/404] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 22:51:39 2022] DELETE /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 22:51:39.966569 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c8e81d28-e13b-48e4-b11a-780626e9b22c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:39.979197 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c8e81d28-e13b-48e4-b11a-780626e9b22c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:39.994591 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8e81d28-e13b-48e4-b11a-780626e9b22c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:39.997190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8e81d28-e13b-48e4-b11a-780626e9b22c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:39.998034 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8e81d28-e13b-48e4-b11a-780626e9b22c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:39.998481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8e81d28-e13b-48e4-b11a-780626e9b22c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:40.010159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6a5392c3-af41-4624-9eb7-1d1b8f8d1c0e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:40.021391 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6a5392c3-af41-4624-9eb7-1d1b8f8d1c0e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1723 microversion: 2.1 time: 0.299653 Jul 27 22:51:40.038788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 205/405] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:39 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:40.199331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c8e81d28-e13b-48e4-b11a-780626e9b22c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:40.212415 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c8e81d28-e13b-48e4-b11a-780626e9b22c tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1470 microversion: 2.1 time: 0.257289 Jul 27 22:51:40.213341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 201/406] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:39 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1470 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:40.581775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e435017b-23c4-4490-9016-372368ac15b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:40.583143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e435017b-23c4-4490-9016-372368ac15b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:40.592139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e435017b-23c4-4490-9016-372368ac15b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:40.592793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e435017b-23c4-4490-9016-372368ac15b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:40.593705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e435017b-23c4-4490-9016-372368ac15b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:40.594729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e435017b-23c4-4490-9016-372368ac15b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:40.843590 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e435017b-23c4-4490-9016-372368ac15b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:40.853712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e435017b-23c4-4490-9016-372368ac15b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:40.855659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e435017b-23c4-4490-9016-372368ac15b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:40.857408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e435017b-23c4-4490-9016-372368ac15b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1743 microversion: 2.20 time: 0.288017 Jul 27 22:51:40.858179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 206/407] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1743 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:51:41.044815 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7e94ef4e-7619-4b50-80c1-6d6f7ee17c4c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:41.046061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7e94ef4e-7619-4b50-80c1-6d6f7ee17c4c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:41.066802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7e94ef4e-7619-4b50-80c1-6d6f7ee17c4c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:41.067247 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7e94ef4e-7619-4b50-80c1-6d6f7ee17c4c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:41.068265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7e94ef4e-7619-4b50-80c1-6d6f7ee17c4c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:41.068761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7e94ef4e-7619-4b50-80c1-6d6f7ee17c4c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:41.235594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-651b1acd-f762-4566-a6e5-3d6611891c40 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:41.236202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-651b1acd-f762-4566-a6e5-3d6611891c40 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:41.245359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-651b1acd-f762-4566-a6e5-3d6611891c40 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:41.246144 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-651b1acd-f762-4566-a6e5-3d6611891c40 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:41.247794 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-651b1acd-f762-4566-a6e5-3d6611891c40 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:41.248924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-651b1acd-f762-4566-a6e5-3d6611891c40 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:41.306239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7e94ef4e-7619-4b50-80c1-6d6f7ee17c4c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:41.318839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7e94ef4e-7619-4b50-80c1-6d6f7ee17c4c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1723 microversion: 2.1 time: 0.275019 Jul 27 22:51:41.319479 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 202/408] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:41 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:41.547360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-651b1acd-f762-4566-a6e5-3d6611891c40 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:41.558307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-651b1acd-f762-4566-a6e5-3d6611891c40 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1470 microversion: 2.1 time: 0.326937 Jul 27 22:51:41.561666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 207/409] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:41 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1470 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:41.889101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d667721f-d046-4faa-981d-7d17f12ad3e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:41.890941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d667721f-d046-4faa-981d-7d17f12ad3e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:41.903560 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d667721f-d046-4faa-981d-7d17f12ad3e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:41.905118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d667721f-d046-4faa-981d-7d17f12ad3e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:41.908770 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d667721f-d046-4faa-981d-7d17f12ad3e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:41.910139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d667721f-d046-4faa-981d-7d17f12ad3e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:42.339784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d756aeef-88ce-4899-8eb3-7adf9a90304c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:42.341161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d756aeef-88ce-4899-8eb3-7adf9a90304c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:42.354030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d756aeef-88ce-4899-8eb3-7adf9a90304c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:42.354917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d756aeef-88ce-4899-8eb3-7adf9a90304c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:42.355964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d756aeef-88ce-4899-8eb3-7adf9a90304c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:42.358600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d756aeef-88ce-4899-8eb3-7adf9a90304c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:42.383362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d667721f-d046-4faa-981d-7d17f12ad3e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:42.409729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d667721f-d046-4faa-981d-7d17f12ad3e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:42.413699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d667721f-d046-4faa-981d-7d17f12ad3e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:42.416754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d667721f-d046-4faa-981d-7d17f12ad3e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1738 microversion: 2.20 time: 0.531223 Jul 27 22:51:42.433534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 203/410] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1738 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:42.580612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-1ac2a2ea-7f0b-4421-a46a-51993fe48d9e req-af2b97be-c4e2-46e4-bb24-6905e5fdd275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e457f5fc-ae83-4b88-87be-ba1007c5865e", "name": "network-vif-plugged", "status": "completed", "tag": "977e384c-b17c-446d-945e-7c6a9e7c3e88"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:42.607223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-1ac2a2ea-7f0b-4421-a46a-51993fe48d9e req-af2b97be-c4e2-46e4-bb24-6905e5fdd275 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:42.610421 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-1ac2a2ea-7f0b-4421-a46a-51993fe48d9e req-af2b97be-c4e2-46e4-bb24-6905e5fdd275 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:42.645164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-1ac2a2ea-7f0b-4421-a46a-51993fe48d9e req-af2b97be-c4e2-46e4-bb24-6905e5fdd275 service nova] Creating event network-vif-plugged:977e384c-b17c-446d-945e-7c6a9e7c3e88 for instance e457f5fc-ae83-4b88-87be-ba1007c5865e on hv-cinder-85124 Jul 27 22:51:42.671584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-1ac2a2ea-7f0b-4421-a46a-51993fe48d9e req-af2b97be-c4e2-46e4-bb24-6905e5fdd275 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092812 Jul 27 22:51:42.676340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 204/411] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:51:42.682519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-af631b76-7125-46da-a9b4-5a8e38fa5122 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:42.691868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-af631b76-7125-46da-a9b4-5a8e38fa5122 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:42.714422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af631b76-7125-46da-a9b4-5a8e38fa5122 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:42.721570 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d756aeef-88ce-4899-8eb3-7adf9a90304c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:42.726197 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af631b76-7125-46da-a9b4-5a8e38fa5122 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:42.739027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af631b76-7125-46da-a9b4-5a8e38fa5122 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:42.739480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d756aeef-88ce-4899-8eb3-7adf9a90304c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1723 microversion: 2.1 time: 0.401463 Jul 27 22:51:42.739480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 208/412] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:42 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1723 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:51:42.751247 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af631b76-7125-46da-a9b4-5a8e38fa5122 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:42.759649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-640015554", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b15daecf-7efc-40e4-aa11-6d83d979ffdf"}], "security_groups": [{"name": "tempest-securitygroup--241711557"}], "key_name": "tempest-keypair-359978473", "user_data": "}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:42.940915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-af631b76-7125-46da-a9b4-5a8e38fa5122 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf18bc88334eba9c94fc3388b58862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2fc9ca645a4548866ceec8e7c046f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:42.949284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-af631b76-7125-46da-a9b4-5a8e38fa5122 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 200 len: 1428 microversion: 2.1 time: 0.271547 Jul 27 22:51:42.960692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 205/413] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:42 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 1428 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:42.967309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-b642b746-5778-4b48-b7a9-0aea7c31801f req-0c29727e-6d74-40c5-bdf7-9ada95467a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29c5888-2a33-4b7c-887c-3d121f51c045", "name": "network-vif-deleted", "tag": "46802986-4219-4000-8b11-a7d6d2866f86"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:42.986287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-b642b746-5778-4b48-b7a9-0aea7c31801f req-0c29727e-6d74-40c5-bdf7-9ada95467a2e service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:42.986987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-b642b746-5778-4b48-b7a9-0aea7c31801f req-0c29727e-6d74-40c5-bdf7-9ada95467a2e service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:43.023936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-b642b746-5778-4b48-b7a9-0aea7c31801f req-0c29727e-6d74-40c5-bdf7-9ada95467a2e service nova] Creating event network-vif-deleted:46802986-4219-4000-8b11-a7d6d2866f86 for instance e29c5888-2a33-4b7c-887c-3d121f51c045 on hv-cinder-85124 Jul 27 22:51:43.036773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-b642b746-5778-4b48-b7a9-0aea7c31801f req-0c29727e-6d74-40c5-bdf7-9ada95467a2e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072285 Jul 27 22:51:43.039827 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 206/414] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:51:43.449897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5b6c25d6-a25d-4b4a-bc6e-b89766373a43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:43.451408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5b6c25d6-a25d-4b4a-bc6e-b89766373a43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:43.479154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b6c25d6-a25d-4b4a-bc6e-b89766373a43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:43.481234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b6c25d6-a25d-4b4a-bc6e-b89766373a43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:43.482310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b6c25d6-a25d-4b4a-bc6e-b89766373a43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:43.484498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b6c25d6-a25d-4b4a-bc6e-b89766373a43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:43.534800 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:43.717081 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5b6c25d6-a25d-4b4a-bc6e-b89766373a43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:43.741645 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5b6c25d6-a25d-4b4a-bc6e-b89766373a43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:43.744771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5b6c25d6-a25d-4b4a-bc6e-b89766373a43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:43.746259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5b6c25d6-a25d-4b4a-bc6e-b89766373a43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1738 microversion: 2.20 time: 0.301950 Jul 27 22:51:43.747115 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 207/415] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:51:43.760577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8be7c213-4184-474f-9ced-c9394dbed8f3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:43.761508 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8be7c213-4184-474f-9ced-c9394dbed8f3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:43.777395 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8be7c213-4184-474f-9ced-c9394dbed8f3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:43.779230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8be7c213-4184-474f-9ced-c9394dbed8f3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:43.782359 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8be7c213-4184-474f-9ced-c9394dbed8f3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:43.783055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8be7c213-4184-474f-9ced-c9394dbed8f3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:44.067894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8be7c213-4184-474f-9ced-c9394dbed8f3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:44.082988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8be7c213-4184-474f-9ced-c9394dbed8f3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1723 microversion: 2.1 time: 0.323972 Jul 27 22:51:44.085834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 208/416] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:43 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:44.090668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f6384a09-ad97-4425-b530-176c5fff81b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:44.096827 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f6384a09-ad97-4425-b530-176c5fff81b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] [instance: e29c5888-2a33-4b7c-887c-3d121f51c045] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:44.110498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6384a09-ad97-4425-b530-176c5fff81b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:44.113493 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6384a09-ad97-4425-b530-176c5fff81b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:44.116807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6384a09-ad97-4425-b530-176c5fff81b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:44.123461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6384a09-ad97-4425-b530-176c5fff81b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:44.166326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-f6384a09-ad97-4425-b530-176c5fff81b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] HTTP exception thrown: Instance e29c5888-2a33-4b7c-887c-3d121f51c045 could not be found. Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f6384a09-ad97-4425-b530-176c5fff81b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Request method failure captured: Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 HTTP/1.1 Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cFeX81ei6Nb3VsHTmDEIxMZLZjU_7dX46F6oCvClmvD--_kWVwFe4lBLUV2C2w5Bo5fAE8O3ItPc5l67ST1KLP5NjYcyKxshZo3mhUSNtzJvT3xTm84Nsp_X7T_Jt-fuq1poGHiQzXnrSL-FYgz2NU7Tq3KtP5VlbCVbXlV09HcXjE Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 7e2fc9ca645a4548866ceec8e7c046f9 Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-VolumesNegativeTest-335787241 Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 22:51:44.168310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 22:51:44.169854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7e2fc9ca645a4548866ceec8e7c046f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7e2fc9ca645a4548866ceec8e7c046f9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7e2fc9ca645a4548866ceec8e7c046f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7e2fc9ca645a4548866ceec8e7c046f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:51:44.169854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-VolumesNegativeTest-335787241 Jul 27 22:51:44.169854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 7e2fc9ca645a4548866ceec8e7c046f9 Jul 27 22:51:44.169854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-VolumesNegativeTest-335787241 Jul 27 22:51:44.169854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-VolumesNegativeTest-335787241-project Jul 27 22:51:44.169854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 22:51:44.169854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 22:51:44.169854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 50bf18bc88334eba9c94fc3388b58862 Jul 27 22:51:44.169854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-VolumesNegativeTest-335787241-project Jul 27 22:51:44.169854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 22:51:44.169854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance e29c5888-2a33-4b7c-887c-3d121f51c045 could not be found. Jul 27 22:51:44.169854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': 'e29c5888-2a33-4b7c-887c-3d121f51c045'} Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e29c5888-2a33-4b7c-887c-3d121f51c045 could not be found. Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:51:44.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e29c5888-2a33-4b7c-887c-3d121f51c045 could not be found. Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e29c5888-2a33-4b7c-887c-3d121f51c045 could not be found. Jul 27 22:51:44.172685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:51:44.176113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f6384a09-ad97-4425-b530-176c5fff81b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] Returning 404 to user: Instance e29c5888-2a33-4b7c-887c-3d121f51c045 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:51:44.177316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f6384a09-ad97-4425-b530-176c5fff81b8 tempest-VolumesNegativeTest-335787241 tempest-VolumesNegativeTest-335787241-project] 10.222.0.47 "GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045" status: 404 len: 111 microversion: 2.1 time: 0.090341 Jul 27 22:51:44.178114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 209/417] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:44 2022] GET /compute/v2.1/servers/e29c5888-2a33-4b7c-887c-3d121f51c045 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 22:51:44.776321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b2d1fbcf-dd5a-495d-9e05-d5c554b3f229 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:44.777087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b2d1fbcf-dd5a-495d-9e05-d5c554b3f229 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:44.792630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2d1fbcf-dd5a-495d-9e05-d5c554b3f229 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:44.793451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2d1fbcf-dd5a-495d-9e05-d5c554b3f229 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:44.795841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2d1fbcf-dd5a-495d-9e05-d5c554b3f229 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:44.800284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2d1fbcf-dd5a-495d-9e05-d5c554b3f229 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:45.037645 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b2d1fbcf-dd5a-495d-9e05-d5c554b3f229 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:45.052783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b2d1fbcf-dd5a-495d-9e05-d5c554b3f229 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:45.055306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b2d1fbcf-dd5a-495d-9e05-d5c554b3f229 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:45.056717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b2d1fbcf-dd5a-495d-9e05-d5c554b3f229 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1738 microversion: 2.20 time: 0.284279 Jul 27 22:51:45.057423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 210/418] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:44 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1738 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:51:45.110855 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fa6e7cf4-7704-4acb-bd88-d2e37b43d0b9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:45.111455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fa6e7cf4-7704-4acb-bd88-d2e37b43d0b9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:45.126259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa6e7cf4-7704-4acb-bd88-d2e37b43d0b9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:45.127046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa6e7cf4-7704-4acb-bd88-d2e37b43d0b9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:45.127833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa6e7cf4-7704-4acb-bd88-d2e37b43d0b9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:45.128449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa6e7cf4-7704-4acb-bd88-d2e37b43d0b9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:45.374486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fa6e7cf4-7704-4acb-bd88-d2e37b43d0b9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:45.387065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fa6e7cf4-7704-4acb-bd88-d2e37b43d0b9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1723 microversion: 2.1 time: 0.281278 Jul 27 22:51:45.393035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 211/419] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:45 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:46.082980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7019afc9-c09b-4459-81c5-ce63ff163c3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:46.083790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7019afc9-c09b-4459-81c5-ce63ff163c3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:46.096487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7019afc9-c09b-4459-81c5-ce63ff163c3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:46.100092 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7019afc9-c09b-4459-81c5-ce63ff163c3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:46.102505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7019afc9-c09b-4459-81c5-ce63ff163c3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:46.102956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7019afc9-c09b-4459-81c5-ce63ff163c3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:46.326398 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7019afc9-c09b-4459-81c5-ce63ff163c3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:46.341848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7019afc9-c09b-4459-81c5-ce63ff163c3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:46.347950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7019afc9-c09b-4459-81c5-ce63ff163c3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:46.353461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7019afc9-c09b-4459-81c5-ce63ff163c3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1738 microversion: 2.20 time: 0.275786 Jul 27 22:51:46.357088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 212/420] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1738 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:46.413605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e526d7a9-e754-4973-a0ec-636a13ff6dca tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:46.414793 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e526d7a9-e754-4973-a0ec-636a13ff6dca tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:46.426656 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e526d7a9-e754-4973-a0ec-636a13ff6dca tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:46.433030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e526d7a9-e754-4973-a0ec-636a13ff6dca tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:46.434108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e526d7a9-e754-4973-a0ec-636a13ff6dca tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:46.434705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e526d7a9-e754-4973-a0ec-636a13ff6dca tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:46.853783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e526d7a9-e754-4973-a0ec-636a13ff6dca tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:46.880951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e526d7a9-e754-4973-a0ec-636a13ff6dca tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1723 microversion: 2.1 time: 0.474637 Jul 27 22:51:46.898194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 213/421] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:46 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1723 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:47.382204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-23ae88aa-9417-43e9-a61c-a4108c318238 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:47.383018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-23ae88aa-9417-43e9-a61c-a4108c318238 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:47.397758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23ae88aa-9417-43e9-a61c-a4108c318238 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:47.405511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23ae88aa-9417-43e9-a61c-a4108c318238 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:47.407478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23ae88aa-9417-43e9-a61c-a4108c318238 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:47.409252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23ae88aa-9417-43e9-a61c-a4108c318238 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:48.250528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-23ae88aa-9417-43e9-a61c-a4108c318238 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:48.262579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-23ae88aa-9417-43e9-a61c-a4108c318238 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:48.267195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-23ae88aa-9417-43e9-a61c-a4108c318238 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:48.268409 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-23ae88aa-9417-43e9-a61c-a4108c318238 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1738 microversion: 2.20 time: 0.891618 Jul 27 22:51:48.279234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 214/422] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1738 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:48.287659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2579dbb1-8379-4c28-b3df-66438ffd11db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:48.296267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2579dbb1-8379-4c28-b3df-66438ffd11db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:48.307221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2579dbb1-8379-4c28-b3df-66438ffd11db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:48.307981 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2579dbb1-8379-4c28-b3df-66438ffd11db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:48.308969 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2579dbb1-8379-4c28-b3df-66438ffd11db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:48.309559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2579dbb1-8379-4c28-b3df-66438ffd11db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:48.850140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2579dbb1-8379-4c28-b3df-66438ffd11db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:48.888957 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2579dbb1-8379-4c28-b3df-66438ffd11db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1723 microversion: 2.1 time: 0.598890 Jul 27 22:51:48.891947 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 215/423] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:48 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1723 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:49.291979 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-844224f5-2589-477e-82ba-515e007f785a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:49.294422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-844224f5-2589-477e-82ba-515e007f785a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:49.306170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-844224f5-2589-477e-82ba-515e007f785a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:49.310988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-844224f5-2589-477e-82ba-515e007f785a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:49.312028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-844224f5-2589-477e-82ba-515e007f785a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:49.313054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-844224f5-2589-477e-82ba-515e007f785a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:49.579532 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=4 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:49.748107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-844224f5-2589-477e-82ba-515e007f785a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:49.766474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-844224f5-2589-477e-82ba-515e007f785a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:49.771882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-844224f5-2589-477e-82ba-515e007f785a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:49.773451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-844224f5-2589-477e-82ba-515e007f785a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1738 microversion: 2.20 time: 0.486018 Jul 27 22:51:49.780111 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 216/424] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:49 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1738 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:51:49.917038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-08770435-86aa-4a5e-a0ce-f0c24f65163c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:49.918443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-08770435-86aa-4a5e-a0ce-f0c24f65163c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:49.951856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08770435-86aa-4a5e-a0ce-f0c24f65163c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:49.953128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08770435-86aa-4a5e-a0ce-f0c24f65163c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:49.954095 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08770435-86aa-4a5e-a0ce-f0c24f65163c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:49.955022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08770435-86aa-4a5e-a0ce-f0c24f65163c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:50.510839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-08770435-86aa-4a5e-a0ce-f0c24f65163c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:50.535219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-08770435-86aa-4a5e-a0ce-f0c24f65163c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1700 microversion: 2.1 time: 0.627637 Jul 27 22:51:50.536259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 217/425] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:49 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1700 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:50.571747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c501b9ed-70bc-4864-8ec3-5e6e2bc123b7 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:51:50.585831 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c501b9ed-70bc-4864-8ec3-5e6e2bc123b7 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:50.587726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c501b9ed-70bc-4864-8ec3-5e6e2bc123b7 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:50.731130 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c501b9ed-70bc-4864-8ec3-5e6e2bc123b7 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Going to try to start instance {{(pid=129294) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 27 22:51:50.823744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c501b9ed-70bc-4864-8ec3-5e6e2bc123b7 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "POST /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/action" status: 202 len: 0 microversion: 2.1 time: 0.265645 Jul 27 22:51:50.824735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 218/426] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 22:51:50 2022] POST /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 22:51:50.838648 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-54a25406-b94e-48cb-a6d4-ba20f2a864c2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:50.839481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-54a25406-b94e-48cb-a6d4-ba20f2a864c2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:50.856650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54a25406-b94e-48cb-a6d4-ba20f2a864c2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:50.861801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54a25406-b94e-48cb-a6d4-ba20f2a864c2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:50.863230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54a25406-b94e-48cb-a6d4-ba20f2a864c2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:50.863911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54a25406-b94e-48cb-a6d4-ba20f2a864c2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:51.764627 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-54a25406-b94e-48cb-a6d4-ba20f2a864c2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:51.828047 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-54a25406-b94e-48cb-a6d4-ba20f2a864c2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:51.836611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-54a25406-b94e-48cb-a6d4-ba20f2a864c2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:51.840159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-54a25406-b94e-48cb-a6d4-ba20f2a864c2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1738 microversion: 2.20 time: 1.013713 Jul 27 22:51:51.854892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 219/427] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:50 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1738 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:51.867553 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-23c985d5-d576-4ba7-95ee-e8e46717c7af tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:51.868353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-23c985d5-d576-4ba7-95ee-e8e46717c7af tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:51.880915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23c985d5-d576-4ba7-95ee-e8e46717c7af tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:51.885589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23c985d5-d576-4ba7-95ee-e8e46717c7af tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:51.888858 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23c985d5-d576-4ba7-95ee-e8e46717c7af tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:51.890309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23c985d5-d576-4ba7-95ee-e8e46717c7af tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:52.610068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-23c985d5-d576-4ba7-95ee-e8e46717c7af tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:52.622591 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-23c985d5-d576-4ba7-95ee-e8e46717c7af tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1709 microversion: 2.1 time: 0.765990 Jul 27 22:51:52.625021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 220/428] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:51 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1709 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:52.727018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:52.838984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:52.875944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4876f1e7-a060-498a-8a93-0b561138063b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:52.876579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4876f1e7-a060-498a-8a93-0b561138063b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:52.888715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4876f1e7-a060-498a-8a93-0b561138063b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:52.889178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4876f1e7-a060-498a-8a93-0b561138063b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:52.889973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4876f1e7-a060-498a-8a93-0b561138063b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:52.890407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4876f1e7-a060-498a-8a93-0b561138063b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:53.538358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4876f1e7-a060-498a-8a93-0b561138063b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:53.554547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4876f1e7-a060-498a-8a93-0b561138063b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:53.557358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4876f1e7-a060-498a-8a93-0b561138063b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:53.558871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4876f1e7-a060-498a-8a93-0b561138063b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1738 microversion: 2.20 time: 0.687197 Jul 27 22:51:53.559665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 221/429] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:52 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1738 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:53.658845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e8506e6f-5ad5-4400-b2fe-a760d00c3942 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:53.659458 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e8506e6f-5ad5-4400-b2fe-a760d00c3942 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:53.751229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8506e6f-5ad5-4400-b2fe-a760d00c3942 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:53.752191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8506e6f-5ad5-4400-b2fe-a760d00c3942 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:53.753281 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8506e6f-5ad5-4400-b2fe-a760d00c3942 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:53.753972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8506e6f-5ad5-4400-b2fe-a760d00c3942 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:54.102993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e8506e6f-5ad5-4400-b2fe-a760d00c3942 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:54.117298 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e8506e6f-5ad5-4400-b2fe-a760d00c3942 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1713 microversion: 2.1 time: 0.468858 Jul 27 22:51:54.144657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 222/430] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:53 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1713 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:51:54.590177 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-245c714e-053b-4710-b1bf-ad4b89dc483b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:54.591076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-245c714e-053b-4710-b1bf-ad4b89dc483b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:54.604326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-245c714e-053b-4710-b1bf-ad4b89dc483b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:54.605797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-245c714e-053b-4710-b1bf-ad4b89dc483b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:54.608742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-245c714e-053b-4710-b1bf-ad4b89dc483b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:54.609733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-245c714e-053b-4710-b1bf-ad4b89dc483b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:55.138827 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-245c714e-053b-4710-b1bf-ad4b89dc483b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:55.143931 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:55.159303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-245c714e-053b-4710-b1bf-ad4b89dc483b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:55.161211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-245c714e-053b-4710-b1bf-ad4b89dc483b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:55.161972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-245c714e-053b-4710-b1bf-ad4b89dc483b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1738 microversion: 2.20 time: 0.577830 Jul 27 22:51:55.176589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 223/431] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:54 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1738 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:56.195678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bcaf21b3-4c59-4a7b-ae63-738ba2cdb559 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:56.196519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bcaf21b3-4c59-4a7b-ae63-738ba2cdb559 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:56.207945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bcaf21b3-4c59-4a7b-ae63-738ba2cdb559 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:56.210552 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bcaf21b3-4c59-4a7b-ae63-738ba2cdb559 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:56.211428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bcaf21b3-4c59-4a7b-ae63-738ba2cdb559 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:56.220770 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bcaf21b3-4c59-4a7b-ae63-738ba2cdb559 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:56.537080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bcaf21b3-4c59-4a7b-ae63-738ba2cdb559 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:56.564340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bcaf21b3-4c59-4a7b-ae63-738ba2cdb559 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:56.572529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bcaf21b3-4c59-4a7b-ae63-738ba2cdb559 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:56.576644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bcaf21b3-4c59-4a7b-ae63-738ba2cdb559 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1738 microversion: 2.20 time: 0.389720 Jul 27 22:51:56.588576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 224/432] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1738 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:51:57.613834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1201aacd-80a2-484b-b61d-1bb54942dd23 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:57.615187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1201aacd-80a2-484b-b61d-1bb54942dd23 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:57.624110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1201aacd-80a2-484b-b61d-1bb54942dd23 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:57.632769 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1201aacd-80a2-484b-b61d-1bb54942dd23 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:57.633979 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1201aacd-80a2-484b-b61d-1bb54942dd23 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:57.634582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1201aacd-80a2-484b-b61d-1bb54942dd23 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:57.849068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1201aacd-80a2-484b-b61d-1bb54942dd23 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:57.861837 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1201aacd-80a2-484b-b61d-1bb54942dd23 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:57.864397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1201aacd-80a2-484b-b61d-1bb54942dd23 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:57.866035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1201aacd-80a2-484b-b61d-1bb54942dd23 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1738 microversion: 2.20 time: 0.256241 Jul 27 22:51:57.866889 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 225/433] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:57 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:51:58.595859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.network.neutron [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] validate_networks() for [('b15daecf-7efc-40e4-aa11-6d83d979ffdf', None, None, None, None, None)] {{(pid=129295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 22:51:58.891612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b1c58ad9-e02d-4f96-b550-9bf06e98a4f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:58.892520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b1c58ad9-e02d-4f96-b550-9bf06e98a4f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:58.907779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1c58ad9-e02d-4f96-b550-9bf06e98a4f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:58.913215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1c58ad9-e02d-4f96-b550-9bf06e98a4f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:58.916052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1c58ad9-e02d-4f96-b550-9bf06e98a4f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:58.916675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1c58ad9-e02d-4f96-b550-9bf06e98a4f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:59.323781 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b1c58ad9-e02d-4f96-b550-9bf06e98a4f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:59.336526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b1c58ad9-e02d-4f96-b550-9bf06e98a4f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:59.340092 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b1c58ad9-e02d-4f96-b550-9bf06e98a4f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:51:59.341790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b1c58ad9-e02d-4f96-b550-9bf06e98a4f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1738 microversion: 2.20 time: 0.454605 Jul 27 22:51:59.345628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 226/434] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:51:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1738 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:51:59.551898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Flavor limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 22:51:59.552677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Image limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 22:51:59.553440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Flavor pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 22:51:59.554074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Image pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 22:51:59.554710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 22:51:59.583702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:59.584613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:59.587274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:51:59.587986 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:51:59.641917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Getting quotas for project fc02f444ea474300a879336c8b122303. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:51:59.652109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Getting quotas for user a5c5f856a38849a39d84b6cd0706da4e and project fc02f444ea474300a879336c8b122303. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:51:59.679807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Going to run 1 instances... {{(pid=129295) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 22:51:59.684366 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 22:51:59.846395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ccbdad1c-3340-4fc3-b1a6-f7482dc157a2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 17.080866 Jul 27 22:51:59.860147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9cc5c95b-3ddd-44f4-b80e-d39f1c60f577 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:51:59.861121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9cc5c95b-3ddd-44f4-b80e-d39f1c60f577 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:51:59.866524 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 209/435] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 22:51:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 17128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 22:52:00.125723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9cc5c95b-3ddd-44f4-b80e-d39f1c60f577 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:00.150871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9cc5c95b-3ddd-44f4-b80e-d39f1c60f577 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1244 microversion: 2.1 time: 0.292197 Jul 27 22:52:00.163008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 227/436] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:51:59 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1244 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:00.374761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-586543aa-30fd-44ab-8b13-fa9a445461ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:00.375976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-586543aa-30fd-44ab-8b13-fa9a445461ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:00.397162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-586543aa-30fd-44ab-8b13-fa9a445461ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:00.397622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-586543aa-30fd-44ab-8b13-fa9a445461ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:00.398784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-586543aa-30fd-44ab-8b13-fa9a445461ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:00.399223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-586543aa-30fd-44ab-8b13-fa9a445461ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:00.748230 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-586543aa-30fd-44ab-8b13-fa9a445461ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:00.760120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-586543aa-30fd-44ab-8b13-fa9a445461ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:00.764334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-586543aa-30fd-44ab-8b13-fa9a445461ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:00.767215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-586543aa-30fd-44ab-8b13-fa9a445461ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1720 microversion: 2.20 time: 0.399174 Jul 27 22:52:00.767782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 210/437] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:00 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1720 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:01.177377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a4050376-0591-4830-a830-1195c00bb94d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:01.178765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a4050376-0591-4830-a830-1195c00bb94d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:01.206908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a4050376-0591-4830-a830-1195c00bb94d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:01.209085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a4050376-0591-4830-a830-1195c00bb94d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:01.211569 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a4050376-0591-4830-a830-1195c00bb94d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:01.213701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a4050376-0591-4830-a830-1195c00bb94d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:01.361280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a4050376-0591-4830-a830-1195c00bb94d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:01.369939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a4050376-0591-4830-a830-1195c00bb94d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1296 microversion: 2.1 time: 0.202220 Jul 27 22:52:01.370906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 228/438] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:01 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1296 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:01.797485 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8c86e926-f520-4890-83ec-e765c6afd00a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:01.798110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8c86e926-f520-4890-83ec-e765c6afd00a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:01.809786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c86e926-f520-4890-83ec-e765c6afd00a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:01.810241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c86e926-f520-4890-83ec-e765c6afd00a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:01.818249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c86e926-f520-4890-83ec-e765c6afd00a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:01.820154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c86e926-f520-4890-83ec-e765c6afd00a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:02.104911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8c86e926-f520-4890-83ec-e765c6afd00a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:02.120634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8c86e926-f520-4890-83ec-e765c6afd00a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:02.122356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8c86e926-f520-4890-83ec-e765c6afd00a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:02.123787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8c86e926-f520-4890-83ec-e765c6afd00a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1720 microversion: 2.20 time: 0.335373 Jul 27 22:52:02.125572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 211/439] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:01 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1720 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:02.393158 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5cde94dd-6cdd-4ac3-973c-57ab590aeeee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:02.397817 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5cde94dd-6cdd-4ac3-973c-57ab590aeeee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:02.409448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5cde94dd-6cdd-4ac3-973c-57ab590aeeee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:02.410028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5cde94dd-6cdd-4ac3-973c-57ab590aeeee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:02.411152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5cde94dd-6cdd-4ac3-973c-57ab590aeeee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:02.411804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5cde94dd-6cdd-4ac3-973c-57ab590aeeee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:02.534513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5cde94dd-6cdd-4ac3-973c-57ab590aeeee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:02.543543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5cde94dd-6cdd-4ac3-973c-57ab590aeeee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1302 microversion: 2.1 time: 0.156183 Jul 27 22:52:02.544119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 229/440] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:02 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1302 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:03.154898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-72d84bf9-6902-4e53-9ca1-f7b8fd766f40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:03.156248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-72d84bf9-6902-4e53-9ca1-f7b8fd766f40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:03.164890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72d84bf9-6902-4e53-9ca1-f7b8fd766f40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:03.165558 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72d84bf9-6902-4e53-9ca1-f7b8fd766f40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:03.166576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72d84bf9-6902-4e53-9ca1-f7b8fd766f40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:03.167195 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72d84bf9-6902-4e53-9ca1-f7b8fd766f40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:03.336665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-72d84bf9-6902-4e53-9ca1-f7b8fd766f40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:03.347704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-72d84bf9-6902-4e53-9ca1-f7b8fd766f40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:03.350172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-72d84bf9-6902-4e53-9ca1-f7b8fd766f40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:03.361860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-72d84bf9-6902-4e53-9ca1-f7b8fd766f40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1720 microversion: 2.20 time: 0.217303 Jul 27 22:52:03.367749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 212/441] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:03.565648 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1f6142aa-9dc1-4479-aff5-02e92e003510 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:03.566206 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1f6142aa-9dc1-4479-aff5-02e92e003510 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:03.573861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f6142aa-9dc1-4479-aff5-02e92e003510 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:03.574249 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f6142aa-9dc1-4479-aff5-02e92e003510 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:03.575027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f6142aa-9dc1-4479-aff5-02e92e003510 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:03.575458 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f6142aa-9dc1-4479-aff5-02e92e003510 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:03.646657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1f6142aa-9dc1-4479-aff5-02e92e003510 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:03.654728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1f6142aa-9dc1-4479-aff5-02e92e003510 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1302 microversion: 2.1 time: 0.093562 Jul 27 22:52:03.656456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 230/442] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:03 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:04.238279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-53293cab-ebad-4a70-90ca-b2c4cd52c662 req-9707518a-4ad5-4299-8588-52e7e1864e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e457f5fc-ae83-4b88-87be-ba1007c5865e", "name": "network-vif-unplugged", "status": "completed", "tag": "977e384c-b17c-446d-945e-7c6a9e7c3e88"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:04.253162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-53293cab-ebad-4a70-90ca-b2c4cd52c662 req-9707518a-4ad5-4299-8588-52e7e1864e5d service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:04.253835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-53293cab-ebad-4a70-90ca-b2c4cd52c662 req-9707518a-4ad5-4299-8588-52e7e1864e5d service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:04.274605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-53293cab-ebad-4a70-90ca-b2c4cd52c662 req-9707518a-4ad5-4299-8588-52e7e1864e5d service nova] Creating event network-vif-unplugged:977e384c-b17c-446d-945e-7c6a9e7c3e88 for instance e457f5fc-ae83-4b88-87be-ba1007c5865e on hv-cinder-85124 Jul 27 22:52:04.292056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-53293cab-ebad-4a70-90ca-b2c4cd52c662 req-9707518a-4ad5-4299-8588-52e7e1864e5d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059132 Jul 27 22:52:04.298294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 213/443] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:52:04.392187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1edb6cfb-28df-476e-bbb1-7175e9e2f9c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:04.393510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1edb6cfb-28df-476e-bbb1-7175e9e2f9c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:04.414651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1edb6cfb-28df-476e-bbb1-7175e9e2f9c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:04.415117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1edb6cfb-28df-476e-bbb1-7175e9e2f9c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:04.416545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1edb6cfb-28df-476e-bbb1-7175e9e2f9c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:04.417020 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1edb6cfb-28df-476e-bbb1-7175e9e2f9c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:04.677293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b7830d1f-ab76-4a73-9e0f-ca6c6a66ff2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:04.677936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b7830d1f-ab76-4a73-9e0f-ca6c6a66ff2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:04.685622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7830d1f-ab76-4a73-9e0f-ca6c6a66ff2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:04.686071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7830d1f-ab76-4a73-9e0f-ca6c6a66ff2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:04.686837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7830d1f-ab76-4a73-9e0f-ca6c6a66ff2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:04.687305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7830d1f-ab76-4a73-9e0f-ca6c6a66ff2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:04.763495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1edb6cfb-28df-476e-bbb1-7175e9e2f9c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:04.778984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1edb6cfb-28df-476e-bbb1-7175e9e2f9c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:04.786421 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1edb6cfb-28df-476e-bbb1-7175e9e2f9c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:04.790213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1edb6cfb-28df-476e-bbb1-7175e9e2f9c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1723 microversion: 2.20 time: 0.401394 Jul 27 22:52:04.790991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 231/444] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:04 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1723 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:04.816519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3b9bff0e-ef17-4129-9a75-c057ddeac8b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8d4527a-c1f8-4fc3-a5d7-4d4b6e7d043c"}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:04.819387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3b9bff0e-ef17-4129-9a75-c057ddeac8b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:04.831670 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b9bff0e-ef17-4129-9a75-c057ddeac8b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:04.832388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b9bff0e-ef17-4129-9a75-c057ddeac8b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:04.835592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b9bff0e-ef17-4129-9a75-c057ddeac8b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:04.836234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b9bff0e-ef17-4129-9a75-c057ddeac8b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:05.044527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b7830d1f-ab76-4a73-9e0f-ca6c6a66ff2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:05.066631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b7830d1f-ab76-4a73-9e0f-ca6c6a66ff2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1369 microversion: 2.1 time: 0.392229 Jul 27 22:52:05.068778 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 214/445] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:04 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1369 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:52:05.612319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3b9bff0e-ef17-4129-9a75-c057ddeac8b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "POST /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.800106 Jul 27 22:52:05.614583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 232/446] 10.222.0.47 () {62 vars in 1364 bytes} [Wed Jul 27 22:52:04 2022] POST /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 188 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:52:05.848895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-44d079d0-ff2d-451d-87fd-ab7ab717d892 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:05.851214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-44d079d0-ff2d-451d-87fd-ab7ab717d892 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:05.861306 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44d079d0-ff2d-451d-87fd-ab7ab717d892 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:05.862332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44d079d0-ff2d-451d-87fd-ab7ab717d892 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:05.863275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44d079d0-ff2d-451d-87fd-ab7ab717d892 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:05.867461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44d079d0-ff2d-451d-87fd-ab7ab717d892 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:05.946302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-44d079d0-ff2d-451d-87fd-ab7ab717d892 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129295) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 27 22:52:06.093838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-05615b58-9cf2-4be4-8b92-a740e22652fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:06.099959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-05615b58-9cf2-4be4-8b92-a740e22652fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:06.103798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-44d079d0-ff2d-451d-87fd-ab7ab717d892 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "POST /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/action" status: 202 len: 0 microversion: 2.20 time: 0.261951 Jul 27 22:52:06.104919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 215/447] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Jul 27 22:52:05 2022] POST /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 22:52:06.107744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05615b58-9cf2-4be4-8b92-a740e22652fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:06.108200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05615b58-9cf2-4be4-8b92-a740e22652fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:06.109565 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05615b58-9cf2-4be4-8b92-a740e22652fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:06.110017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05615b58-9cf2-4be4-8b92-a740e22652fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:06.115353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1f20de9d-4e20-478e-8e62-159598750573 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:06.116372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1f20de9d-4e20-478e-8e62-159598750573 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:06.125781 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f20de9d-4e20-478e-8e62-159598750573 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:06.126575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f20de9d-4e20-478e-8e62-159598750573 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:06.127407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f20de9d-4e20-478e-8e62-159598750573 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:06.128291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f20de9d-4e20-478e-8e62-159598750573 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:06.423507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-05615b58-9cf2-4be4-8b92-a740e22652fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:06.443572 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-05615b58-9cf2-4be4-8b92-a740e22652fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1369 microversion: 2.1 time: 0.344289 Jul 27 22:52:06.444521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 233/448] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:06 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1369 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:52:06.449637 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-9984038d-a703-4731-a7dd-1e1c6be90667 req-00efe864-667d-43bb-9f06-c637e60da420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a5ccc96-6331-4ef5-a712-a72739545469", "tag": "e522cce6-f90b-46c9-abd8-23ce56eaac03"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:06.462032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-9984038d-a703-4731-a7dd-1e1c6be90667 req-00efe864-667d-43bb-9f06-c637e60da420 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:06.465520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-9984038d-a703-4731-a7dd-1e1c6be90667 req-00efe864-667d-43bb-9f06-c637e60da420 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:06.494464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-9984038d-a703-4731-a7dd-1e1c6be90667 req-00efe864-667d-43bb-9f06-c637e60da420 service nova] Creating event network-changed:e522cce6-f90b-46c9-abd8-23ce56eaac03 for instance 9a5ccc96-6331-4ef5-a712-a72739545469 on hv-cinder-85124 Jul 27 22:52:06.500053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1f20de9d-4e20-478e-8e62-159598750573 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:06.500881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-9984038d-a703-4731-a7dd-1e1c6be90667 req-00efe864-667d-43bb-9f06-c637e60da420 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054384 Jul 27 22:52:06.502438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 234/449] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:52:06.521435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1f20de9d-4e20-478e-8e62-159598750573 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:06.523238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1f20de9d-4e20-478e-8e62-159598750573 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:06.524442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1f20de9d-4e20-478e-8e62-159598750573 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1749 microversion: 2.20 time: 0.415396 Jul 27 22:52:06.525054 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 216/450] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1749 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:52:07.467540 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c9c82aa0-114e-4c2b-97b7-1d525267fc17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:07.468249 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c9c82aa0-114e-4c2b-97b7-1d525267fc17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:07.482408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c9c82aa0-114e-4c2b-97b7-1d525267fc17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:07.483119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c9c82aa0-114e-4c2b-97b7-1d525267fc17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:07.485116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c9c82aa0-114e-4c2b-97b7-1d525267fc17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:07.485927 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c9c82aa0-114e-4c2b-97b7-1d525267fc17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:07.551394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fa12e418-7f6e-4155-8550-1bb620d7a24c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:07.552521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fa12e418-7f6e-4155-8550-1bb620d7a24c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:07.563168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fa12e418-7f6e-4155-8550-1bb620d7a24c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:07.564367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fa12e418-7f6e-4155-8550-1bb620d7a24c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:07.564742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fa12e418-7f6e-4155-8550-1bb620d7a24c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:07.568682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fa12e418-7f6e-4155-8550-1bb620d7a24c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:07.722189 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c9c82aa0-114e-4c2b-97b7-1d525267fc17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:07.736618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c9c82aa0-114e-4c2b-97b7-1d525267fc17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1369 microversion: 2.1 time: 0.273722 Jul 27 22:52:07.739366 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 235/451] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:07 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1369 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:07.789062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fa12e418-7f6e-4155-8550-1bb620d7a24c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:07.799782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fa12e418-7f6e-4155-8550-1bb620d7a24c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:07.806955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fa12e418-7f6e-4155-8550-1bb620d7a24c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:07.814319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fa12e418-7f6e-4155-8550-1bb620d7a24c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1749 microversion: 2.20 time: 0.262101 Jul 27 22:52:07.815266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 217/452] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:07 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1749 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:52:08.771530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ce9a490d-f735-42e9-855d-f30c13685afe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:08.772994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ce9a490d-f735-42e9-855d-f30c13685afe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:08.783672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce9a490d-f735-42e9-855d-f30c13685afe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:08.784614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce9a490d-f735-42e9-855d-f30c13685afe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:08.786203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce9a490d-f735-42e9-855d-f30c13685afe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:08.787325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce9a490d-f735-42e9-855d-f30c13685afe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:08.840721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dcd076a0-f01b-4dc1-a1d2-df1cb32b7b30 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:08.841441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dcd076a0-f01b-4dc1-a1d2-df1cb32b7b30 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:08.851734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dcd076a0-f01b-4dc1-a1d2-df1cb32b7b30 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:08.852311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dcd076a0-f01b-4dc1-a1d2-df1cb32b7b30 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:08.853225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dcd076a0-f01b-4dc1-a1d2-df1cb32b7b30 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:08.853762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dcd076a0-f01b-4dc1-a1d2-df1cb32b7b30 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:09.484423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ce9a490d-f735-42e9-855d-f30c13685afe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:09.495738 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ce9a490d-f735-42e9-855d-f30c13685afe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1369 microversion: 2.1 time: 0.737214 Jul 27 22:52:09.498700 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 236/453] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:08 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1369 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:09.617828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:09.670721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=6 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:09.913800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dcd076a0-f01b-4dc1-a1d2-df1cb32b7b30 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:09.926373 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dcd076a0-f01b-4dc1-a1d2-df1cb32b7b30 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:09.928241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dcd076a0-f01b-4dc1-a1d2-df1cb32b7b30 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:09.932575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dcd076a0-f01b-4dc1-a1d2-df1cb32b7b30 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1749 microversion: 2.20 time: 1.095999 Jul 27 22:52:09.936503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 218/454] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:08 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1749 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:10.523829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2d4efa21-d9a5-49bc-a772-d399782f3708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:10.524435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2d4efa21-d9a5-49bc-a772-d399782f3708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:10.535626 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=2 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:10.538101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:10.541301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d4efa21-d9a5-49bc-a772-d399782f3708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:10.542682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d4efa21-d9a5-49bc-a772-d399782f3708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:10.544901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d4efa21-d9a5-49bc-a772-d399782f3708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:10.546260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d4efa21-d9a5-49bc-a772-d399782f3708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:10.968727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d930466e-c94a-4e4f-939b-d6ff8e2ff88d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:10.969980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d930466e-c94a-4e4f-939b-d6ff8e2ff88d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:11.003550 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d930466e-c94a-4e4f-939b-d6ff8e2ff88d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:11.007821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d930466e-c94a-4e4f-939b-d6ff8e2ff88d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:11.008673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d930466e-c94a-4e4f-939b-d6ff8e2ff88d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:11.009115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d930466e-c94a-4e4f-939b-d6ff8e2ff88d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:11.041555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2d4efa21-d9a5-49bc-a772-d399782f3708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:11.054370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2d4efa21-d9a5-49bc-a772-d399782f3708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1369 microversion: 2.1 time: 0.536198 Jul 27 22:52:11.054953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 237/455] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:10 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1369 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:11.364596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d930466e-c94a-4e4f-939b-d6ff8e2ff88d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:11.379012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d930466e-c94a-4e4f-939b-d6ff8e2ff88d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:11.380684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d930466e-c94a-4e4f-939b-d6ff8e2ff88d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:11.383057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d930466e-c94a-4e4f-939b-d6ff8e2ff88d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.418575 Jul 27 22:52:11.383623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 219/456] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:10 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:12.075923 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c8479d0e-59cd-4f37-9025-2babbf428a61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:12.080751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c8479d0e-59cd-4f37-9025-2babbf428a61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:12.094550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8479d0e-59cd-4f37-9025-2babbf428a61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:12.096655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8479d0e-59cd-4f37-9025-2babbf428a61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:12.097704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8479d0e-59cd-4f37-9025-2babbf428a61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:12.100202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8479d0e-59cd-4f37-9025-2babbf428a61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:12.410195 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-079aaa89-d625-45c5-a2fd-ca4f0ea8db6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:12.410725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-079aaa89-d625-45c5-a2fd-ca4f0ea8db6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:12.420466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c8479d0e-59cd-4f37-9025-2babbf428a61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:12.421088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-079aaa89-d625-45c5-a2fd-ca4f0ea8db6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:12.422338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-079aaa89-d625-45c5-a2fd-ca4f0ea8db6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:12.423280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-079aaa89-d625-45c5-a2fd-ca4f0ea8db6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:12.425085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-079aaa89-d625-45c5-a2fd-ca4f0ea8db6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:12.433142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c8479d0e-59cd-4f37-9025-2babbf428a61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1369 microversion: 2.1 time: 0.360918 Jul 27 22:52:12.447234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 238/457] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:12 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1369 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:12.772422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-079aaa89-d625-45c5-a2fd-ca4f0ea8db6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:12.782763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-079aaa89-d625-45c5-a2fd-ca4f0ea8db6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:12.793423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-079aaa89-d625-45c5-a2fd-ca4f0ea8db6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:12.794993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-079aaa89-d625-45c5-a2fd-ca4f0ea8db6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.389050 Jul 27 22:52:12.798154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 220/458] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:12.869505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-afaeda24-9593-4b2d-a4d6-f3ed03d72002 req-ca2ff596-6232-4128-9264-d634f2fde280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a5ccc96-6331-4ef5-a712-a72739545469", "name": "network-vif-plugged", "status": "completed", "tag": "e522cce6-f90b-46c9-abd8-23ce56eaac03"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:12.893208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-afaeda24-9593-4b2d-a4d6-f3ed03d72002 req-ca2ff596-6232-4128-9264-d634f2fde280 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:12.893992 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-afaeda24-9593-4b2d-a4d6-f3ed03d72002 req-ca2ff596-6232-4128-9264-d634f2fde280 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:12.907993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-afaeda24-9593-4b2d-a4d6-f3ed03d72002 req-ca2ff596-6232-4128-9264-d634f2fde280 service nova] Creating event network-vif-plugged:e522cce6-f90b-46c9-abd8-23ce56eaac03 for instance 9a5ccc96-6331-4ef5-a712-a72739545469 on hv-cinder-85124 Jul 27 22:52:12.941546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-afaeda24-9593-4b2d-a4d6-f3ed03d72002 req-ca2ff596-6232-4128-9264-d634f2fde280 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070664 Jul 27 22:52:12.945452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 239/459] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:52:13.189856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1124366008", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "networks": [{"uuid": "20ad5378-8633-4a8e-a6b8-ecb264c9ac93"}]}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:13.303478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.network.neutron [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] validate_networks() for [('20ad5378-8633-4a8e-a6b8-ecb264c9ac93', None, None, None, None, None)] {{(pid=129295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 22:52:13.458401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-12f02453-08e0-4a18-a969-74fee579cec0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:13.459741 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-12f02453-08e0-4a18-a969-74fee579cec0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:13.469180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-12f02453-08e0-4a18-a969-74fee579cec0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:13.469901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-12f02453-08e0-4a18-a969-74fee579cec0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:13.470967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-12f02453-08e0-4a18-a969-74fee579cec0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:13.471558 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-12f02453-08e0-4a18-a969-74fee579cec0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:13.477324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:14.335036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-12f02453-08e0-4a18-a969-74fee579cec0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:14.343628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-12f02453-08e0-4a18-a969-74fee579cec0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1369 microversion: 2.1 time: 0.890038 Jul 27 22:52:14.346283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 240/460] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:13 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1369 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:14.365800 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-26127f27-0eb2-499c-b9e1-97ad0fd1510a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:14.368278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-26127f27-0eb2-499c-b9e1-97ad0fd1510a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:14.394796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-26127f27-0eb2-499c-b9e1-97ad0fd1510a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:14.395463 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-26127f27-0eb2-499c-b9e1-97ad0fd1510a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:14.399116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-26127f27-0eb2-499c-b9e1-97ad0fd1510a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:14.399697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-26127f27-0eb2-499c-b9e1-97ad0fd1510a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:14.843044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Flavor limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 22:52:14.844014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Image limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 22:52:14.847445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Flavor pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 22:52:14.847985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Image pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 22:52:14.849128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 22:52:14.869115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:14.869930 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:14.873062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:14.873944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:14.929751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Getting quotas for project 002feda86f414d16b592aa9e3100b510. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:52:14.946442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Getting quotas for user 325eac13d04548138b3d541fb4740c4c and project 002feda86f414d16b592aa9e3100b510. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:52:14.987375 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Going to run 1 instances... {{(pid=129295) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 22:52:14.993695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 22:52:15.131011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-08620ebe-5efe-4b04-b45f-e612b761b19b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.949513 Jul 27 22:52:15.135218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 221/461] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 22:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 22:52:15.147516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4086b8c6-c56a-4cd3-9f9d-c490edc114d4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:15.149894 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4086b8c6-c56a-4cd3-9f9d-c490edc114d4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:15.201554 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-26127f27-0eb2-499c-b9e1-97ad0fd1510a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:15.210770 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-26127f27-0eb2-499c-b9e1-97ad0fd1510a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:15.212256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-26127f27-0eb2-499c-b9e1-97ad0fd1510a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:15.223196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-26127f27-0eb2-499c-b9e1-97ad0fd1510a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.874472 Jul 27 22:52:15.223777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 241/462] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:14 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:15.371022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-754a8425-ad64-44e7-9082-a7c8b30abee7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:15.371640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-754a8425-ad64-44e7-9082-a7c8b30abee7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:15.375921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4086b8c6-c56a-4cd3-9f9d-c490edc114d4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:15.386169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-754a8425-ad64-44e7-9082-a7c8b30abee7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:15.386411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4086b8c6-c56a-4cd3-9f9d-c490edc114d4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1219 microversion: 2.1 time: 0.243675 Jul 27 22:52:15.386604 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-754a8425-ad64-44e7-9082-a7c8b30abee7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:15.393259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-754a8425-ad64-44e7-9082-a7c8b30abee7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:15.393967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-754a8425-ad64-44e7-9082-a7c8b30abee7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:15.396804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 222/463] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:15 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1219 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:15.729962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-754a8425-ad64-44e7-9082-a7c8b30abee7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:15.756111 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-754a8425-ad64-44e7-9082-a7c8b30abee7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1563 microversion: 2.1 time: 0.388991 Jul 27 22:52:15.765698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 242/464] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1563 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:15.793874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b6d7ac87-7235-471f-b85e-d5ef4094cba0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:15.794473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b6d7ac87-7235-471f-b85e-d5ef4094cba0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:15.802176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b6d7ac87-7235-471f-b85e-d5ef4094cba0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:15.804930 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b6d7ac87-7235-471f-b85e-d5ef4094cba0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:15.806911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b6d7ac87-7235-471f-b85e-d5ef4094cba0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:15.807585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b6d7ac87-7235-471f-b85e-d5ef4094cba0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:15.994104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b6d7ac87-7235-471f-b85e-d5ef4094cba0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207345 Jul 27 22:52:15.995358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 223/465] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 22:52:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:52:16.252594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-14b90c59-24c0-46ec-8e46-afb3dcb396b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:16.254176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-14b90c59-24c0-46ec-8e46-afb3dcb396b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:16.280079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14b90c59-24c0-46ec-8e46-afb3dcb396b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:16.280454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14b90c59-24c0-46ec-8e46-afb3dcb396b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:16.297520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14b90c59-24c0-46ec-8e46-afb3dcb396b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:16.301579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14b90c59-24c0-46ec-8e46-afb3dcb396b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:16.415420 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-abd04e68-389a-4027-b3a1-b80d5f9d8c1b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:16.416589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-abd04e68-389a-4027-b3a1-b80d5f9d8c1b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:16.439085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-abd04e68-389a-4027-b3a1-b80d5f9d8c1b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:16.440440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-abd04e68-389a-4027-b3a1-b80d5f9d8c1b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:16.447437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-abd04e68-389a-4027-b3a1-b80d5f9d8c1b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:16.448225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-abd04e68-389a-4027-b3a1-b80d5f9d8c1b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:16.733381 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-abd04e68-389a-4027-b3a1-b80d5f9d8c1b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:16.760584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-abd04e68-389a-4027-b3a1-b80d5f9d8c1b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1215 microversion: 2.1 time: 0.348755 Jul 27 22:52:16.761886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 224/466] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:16 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1215 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:16.913302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-14b90c59-24c0-46ec-8e46-afb3dcb396b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:16.927396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-14b90c59-24c0-46ec-8e46-afb3dcb396b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:16.939174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-14b90c59-24c0-46ec-8e46-afb3dcb396b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:16.944695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-14b90c59-24c0-46ec-8e46-afb3dcb396b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.695122 Jul 27 22:52:16.953819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 243/467] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:16 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:17.783547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-30e78fcc-be80-4fcc-bc04-7068847a894b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:17.786040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-30e78fcc-be80-4fcc-bc04-7068847a894b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:17.797857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-30e78fcc-be80-4fcc-bc04-7068847a894b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:17.800271 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-30e78fcc-be80-4fcc-bc04-7068847a894b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:17.803002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-30e78fcc-be80-4fcc-bc04-7068847a894b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:17.803619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-30e78fcc-be80-4fcc-bc04-7068847a894b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:18.027789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bfdc06fd-9bc4-44e5-a88e-cca36c155c11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:18.029170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bfdc06fd-9bc4-44e5-a88e-cca36c155c11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:18.044240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bfdc06fd-9bc4-44e5-a88e-cca36c155c11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:18.048031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bfdc06fd-9bc4-44e5-a88e-cca36c155c11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:18.049347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bfdc06fd-9bc4-44e5-a88e-cca36c155c11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:18.049941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bfdc06fd-9bc4-44e5-a88e-cca36c155c11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:18.151561 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-30e78fcc-be80-4fcc-bc04-7068847a894b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:18.173018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-30e78fcc-be80-4fcc-bc04-7068847a894b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1277 microversion: 2.1 time: 0.390339 Jul 27 22:52:18.175532 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 225/468] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:17 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1277 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:18.434464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bfdc06fd-9bc4-44e5-a88e-cca36c155c11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:18.450902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bfdc06fd-9bc4-44e5-a88e-cca36c155c11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:18.457254 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bfdc06fd-9bc4-44e5-a88e-cca36c155c11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:18.458728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bfdc06fd-9bc4-44e5-a88e-cca36c155c11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.435418 Jul 27 22:52:18.461966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 244/469] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:18.755793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-742ff0d3-6ff8-44ab-9490-4b4147548833 req-64236cac-b8e9-41dd-85c3-ee347ee9901d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a5ccc96-6331-4ef5-a712-a72739545469", "tag": "e522cce6-f90b-46c9-abd8-23ce56eaac03"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:18.776647 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-742ff0d3-6ff8-44ab-9490-4b4147548833 req-64236cac-b8e9-41dd-85c3-ee347ee9901d service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:18.779936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-742ff0d3-6ff8-44ab-9490-4b4147548833 req-64236cac-b8e9-41dd-85c3-ee347ee9901d service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:18.807457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-742ff0d3-6ff8-44ab-9490-4b4147548833 req-64236cac-b8e9-41dd-85c3-ee347ee9901d service nova] Creating event network-changed:e522cce6-f90b-46c9-abd8-23ce56eaac03 for instance 9a5ccc96-6331-4ef5-a712-a72739545469 on hv-cinder-85124 Jul 27 22:52:18.826168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-742ff0d3-6ff8-44ab-9490-4b4147548833 req-64236cac-b8e9-41dd-85c3-ee347ee9901d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074920 Jul 27 22:52:18.838841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 226/470] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:52:19.195927 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d41b1c6e-b703-41a9-9c6d-be212e8b0cb2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:19.197201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d41b1c6e-b703-41a9-9c6d-be212e8b0cb2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:19.210273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d41b1c6e-b703-41a9-9c6d-be212e8b0cb2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:19.217292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d41b1c6e-b703-41a9-9c6d-be212e8b0cb2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:19.218138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d41b1c6e-b703-41a9-9c6d-be212e8b0cb2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:19.218594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d41b1c6e-b703-41a9-9c6d-be212e8b0cb2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:19.416039 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d41b1c6e-b703-41a9-9c6d-be212e8b0cb2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:19.427091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d41b1c6e-b703-41a9-9c6d-be212e8b0cb2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1277 microversion: 2.1 time: 0.234996 Jul 27 22:52:19.427954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 245/471] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:19 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:19.490053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4fde73d5-3671-438a-8aa2-9fe61d9e5031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:19.491026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4fde73d5-3671-438a-8aa2-9fe61d9e5031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:19.510520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4fde73d5-3671-438a-8aa2-9fe61d9e5031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:19.511481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4fde73d5-3671-438a-8aa2-9fe61d9e5031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:19.512509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4fde73d5-3671-438a-8aa2-9fe61d9e5031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:19.513179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4fde73d5-3671-438a-8aa2-9fe61d9e5031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:19.906520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4fde73d5-3671-438a-8aa2-9fe61d9e5031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:19.926418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4fde73d5-3671-438a-8aa2-9fe61d9e5031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:19.933367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4fde73d5-3671-438a-8aa2-9fe61d9e5031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:19.937490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4fde73d5-3671-438a-8aa2-9fe61d9e5031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.450701 Jul 27 22:52:19.958356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 227/472] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:19 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:20.451871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2db4f537-ddc7-4429-b935-84839b9c7dd1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:20.453208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2db4f537-ddc7-4429-b935-84839b9c7dd1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:20.468807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2db4f537-ddc7-4429-b935-84839b9c7dd1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:20.469546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2db4f537-ddc7-4429-b935-84839b9c7dd1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:20.472625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2db4f537-ddc7-4429-b935-84839b9c7dd1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:20.473245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2db4f537-ddc7-4429-b935-84839b9c7dd1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:20.646275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2db4f537-ddc7-4429-b935-84839b9c7dd1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:20.659399 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2db4f537-ddc7-4429-b935-84839b9c7dd1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1277 microversion: 2.1 time: 0.211495 Jul 27 22:52:20.663887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 246/473] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:20 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:52:20.970324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5deb90d5-c1fb-405d-98ea-1b1e38c038ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:20.971538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5deb90d5-c1fb-405d-98ea-1b1e38c038ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:20.992401 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5deb90d5-c1fb-405d-98ea-1b1e38c038ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:20.994049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5deb90d5-c1fb-405d-98ea-1b1e38c038ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:20.995884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5deb90d5-c1fb-405d-98ea-1b1e38c038ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:20.997435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5deb90d5-c1fb-405d-98ea-1b1e38c038ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:21.053132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:21.492862 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5deb90d5-c1fb-405d-98ea-1b1e38c038ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:21.514038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5deb90d5-c1fb-405d-98ea-1b1e38c038ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:21.518266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5deb90d5-c1fb-405d-98ea-1b1e38c038ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:21.527812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5deb90d5-c1fb-405d-98ea-1b1e38c038ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.561904 Jul 27 22:52:21.529815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 228/474] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:21.689749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6147f894-dc0b-4ff9-9487-55bb514d1699 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:21.690362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6147f894-dc0b-4ff9-9487-55bb514d1699 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:21.705145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6147f894-dc0b-4ff9-9487-55bb514d1699 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:21.705596 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6147f894-dc0b-4ff9-9487-55bb514d1699 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:21.706385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6147f894-dc0b-4ff9-9487-55bb514d1699 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:21.706821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6147f894-dc0b-4ff9-9487-55bb514d1699 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:21.959110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6147f894-dc0b-4ff9-9487-55bb514d1699 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:21.971059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6147f894-dc0b-4ff9-9487-55bb514d1699 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.285153 Jul 27 22:52:21.972289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 247/475] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:21 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:22.555600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4d4066ab-875a-4095-bea3-190a8dcc55bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:22.556209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4d4066ab-875a-4095-bea3-190a8dcc55bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:22.571718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d4066ab-875a-4095-bea3-190a8dcc55bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:22.572375 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d4066ab-875a-4095-bea3-190a8dcc55bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:22.577128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d4066ab-875a-4095-bea3-190a8dcc55bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:22.581391 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d4066ab-875a-4095-bea3-190a8dcc55bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:22.983980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4d4066ab-875a-4095-bea3-190a8dcc55bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:22.997221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ed5bb58e-2ac2-4828-a5c4-ed23b1bc84c4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:22.998681 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ed5bb58e-2ac2-4828-a5c4-ed23b1bc84c4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:23.007701 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4d4066ab-875a-4095-bea3-190a8dcc55bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:23.013176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed5bb58e-2ac2-4828-a5c4-ed23b1bc84c4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:23.013934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed5bb58e-2ac2-4828-a5c4-ed23b1bc84c4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:23.018204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4d4066ab-875a-4095-bea3-190a8dcc55bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:23.021337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4d4066ab-875a-4095-bea3-190a8dcc55bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.470334 Jul 27 22:52:23.023190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed5bb58e-2ac2-4828-a5c4-ed23b1bc84c4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:23.026016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed5bb58e-2ac2-4828-a5c4-ed23b1bc84c4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:23.028113 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 229/476] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:22 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:23.499986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ed5bb58e-2ac2-4828-a5c4-ed23b1bc84c4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:23.508762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ed5bb58e-2ac2-4828-a5c4-ed23b1bc84c4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.515743 Jul 27 22:52:23.515660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 248/477] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:22 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:23.761017 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-8352cef9-7a16-4574-8e3c-fc9c290d09fa req-6a108b70-946c-4c45-9225-568c94315342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19fab65-5354-4383-ba3a-9eb6614382ff", "tag": "e46bb58f-7220-4510-a401-14284c9dde2a"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:23.771733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:23.779110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-8352cef9-7a16-4574-8e3c-fc9c290d09fa req-6a108b70-946c-4c45-9225-568c94315342 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:23.780055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-8352cef9-7a16-4574-8e3c-fc9c290d09fa req-6a108b70-946c-4c45-9225-568c94315342 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:23.819244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-8352cef9-7a16-4574-8e3c-fc9c290d09fa req-6a108b70-946c-4c45-9225-568c94315342 service nova] Creating event network-changed:e46bb58f-7220-4510-a401-14284c9dde2a for instance b19fab65-5354-4383-ba3a-9eb6614382ff on hv-cinder-85124 Jul 27 22:52:23.832427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-8352cef9-7a16-4574-8e3c-fc9c290d09fa req-6a108b70-946c-4c45-9225-568c94315342 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074339 Jul 27 22:52:23.834402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 230/478] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:52:24.052134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-df6156f6-0029-49a1-abed-b8fb535a46be tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:24.052967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-df6156f6-0029-49a1-abed-b8fb535a46be tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:24.060269 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df6156f6-0029-49a1-abed-b8fb535a46be tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:24.060872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df6156f6-0029-49a1-abed-b8fb535a46be tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:24.061985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df6156f6-0029-49a1-abed-b8fb535a46be tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:24.062625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df6156f6-0029-49a1-abed-b8fb535a46be tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:24.372788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-df6156f6-0029-49a1-abed-b8fb535a46be tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:24.395776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-df6156f6-0029-49a1-abed-b8fb535a46be tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:24.397889 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-df6156f6-0029-49a1-abed-b8fb535a46be tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:24.399379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-df6156f6-0029-49a1-abed-b8fb535a46be tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.351496 Jul 27 22:52:24.422501 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 249/479] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:24 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:24.454360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8c6c2e5b-d1e9-498b-b320-d62c59498603 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Action: 'create', calling method: .version_select at 0x7f696a29c280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-395468210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA1BxN8w+Ocu6JdQAMpvWFIWWWEcJaCOBhpPgrtsh4VpqBbAwhWkGVvNQc1k/VmB917W+tgQf9VZOUalIiE96lZv1LkavU2S4OGvDFf/sBjBPktt3LNmjynLjmzcMJ7qQ=="}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:24.504947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-8c6c2e5b-d1e9-498b-b320-d62c59498603 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Getting quotas for project 7ecdd80c027f419e93fc7de57dfd70a6. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:52:24.516049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-8c6c2e5b-d1e9-498b-b320-d62c59498603 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Getting quotas for user 6f834cb4e134470286edcc0f1860f944 and project 7ecdd80c027f419e93fc7de57dfd70a6. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:52:24.535957 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6332b463-ff9e-45bb-b520-72a63bfd846e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:24.536889 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6332b463-ff9e-45bb-b520-72a63bfd846e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:24.547629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6332b463-ff9e-45bb-b520-72a63bfd846e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:24.548337 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6332b463-ff9e-45bb-b520-72a63bfd846e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:24.553916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6332b463-ff9e-45bb-b520-72a63bfd846e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:24.554681 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6332b463-ff9e-45bb-b520-72a63bfd846e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:24.573486 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8c6c2e5b-d1e9-498b-b320-d62c59498603 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.123495 Jul 27 22:52:24.574186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 231/480] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 22:52:24 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:52:24.831992 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6332b463-ff9e-45bb-b520-72a63bfd846e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:24.844668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6332b463-ff9e-45bb-b520-72a63bfd846e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.309568 Jul 27 22:52:24.848153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 250/481] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:24 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:24.862646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1452337692", "imageRef": "3c6fed05-1019-42c6-bbcb-3c2e944ef053", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-395468210", "networks": [{"uuid": "a327365d-99b4-4ed8-80d3-e9d0a15199ed"}]}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:24.897178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:24.986110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.network.neutron [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] validate_networks() for [('a327365d-99b4-4ed8-80d3-e9d0a15199ed', None, None, None, None, None)] {{(pid=129295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 22:52:25.432432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5777aeec-aedd-404b-b472-0912c82d477e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:25.433964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5777aeec-aedd-404b-b472-0912c82d477e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:25.451336 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5777aeec-aedd-404b-b472-0912c82d477e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:25.453134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5777aeec-aedd-404b-b472-0912c82d477e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:25.455585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5777aeec-aedd-404b-b472-0912c82d477e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:25.456032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5777aeec-aedd-404b-b472-0912c82d477e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:25.720770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Flavor limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 22:52:25.721822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Image limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 22:52:25.722517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Flavor pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 22:52:25.723681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Image pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 22:52:25.724741 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 22:52:25.740934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:25.742075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:25.743319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:25.744158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:25.806190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Getting quotas for project 7ecdd80c027f419e93fc7de57dfd70a6. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:52:25.813314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Getting quotas for user 6f834cb4e134470286edcc0f1860f944 and project 7ecdd80c027f419e93fc7de57dfd70a6. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:52:25.831270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Going to run 1 instances... {{(pid=129295) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 22:52:25.834404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c6fed05-1019-42c6-bbcb-3c2e944ef053',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 22:52:25.851018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5777aeec-aedd-404b-b472-0912c82d477e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:25.863433 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5777aeec-aedd-404b-b472-0912c82d477e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:25.866175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5777aeec-aedd-404b-b472-0912c82d477e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:25.867378 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5777aeec-aedd-404b-b472-0912c82d477e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.440828 Jul 27 22:52:25.880593 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 251/482] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:25 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:25.889334 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0bdbf13f-4770-433d-a740-2b216b0115a0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:25.890729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0bdbf13f-4770-433d-a740-2b216b0115a0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:25.901874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bdbf13f-4770-433d-a740-2b216b0115a0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:25.902322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bdbf13f-4770-433d-a740-2b216b0115a0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:25.904115 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bdbf13f-4770-433d-a740-2b216b0115a0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:25.904582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bdbf13f-4770-433d-a740-2b216b0115a0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:25.928950 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-12c7d3bd-3835-484e-a744-cdf4ce6e3f3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073558 Jul 27 22:52:25.929926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 232/483] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 22:52:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 22:52:25.942872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3275172b-ec83-4f38-b41e-b57f8b2af7db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:25.943930 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3275172b-ec83-4f38-b41e-b57f8b2af7db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:26.129215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3275172b-ec83-4f38-b41e-b57f8b2af7db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:26.149663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3275172b-ec83-4f38-b41e-b57f8b2af7db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1258 microversion: 2.1 time: 0.210601 Jul 27 22:52:26.156576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 233/484] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1258 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:26.342420 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0bdbf13f-4770-433d-a740-2b216b0115a0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:26.365546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0bdbf13f-4770-433d-a740-2b216b0115a0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.491918 Jul 27 22:52:26.366126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 252/485] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:25 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:26.902053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-05e562de-0cc8-4d73-8e1b-874f782e9e45 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:26.902707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-05e562de-0cc8-4d73-8e1b-874f782e9e45 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:26.924413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05e562de-0cc8-4d73-8e1b-874f782e9e45 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:26.928471 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05e562de-0cc8-4d73-8e1b-874f782e9e45 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:26.931962 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05e562de-0cc8-4d73-8e1b-874f782e9e45 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:26.938246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05e562de-0cc8-4d73-8e1b-874f782e9e45 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:27.180242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3bc97bc5-6537-4e8f-81b2-d4532481d36c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:27.181551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3bc97bc5-6537-4e8f-81b2-d4532481d36c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:27.212282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3bc97bc5-6537-4e8f-81b2-d4532481d36c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:27.216788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3bc97bc5-6537-4e8f-81b2-d4532481d36c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:27.220584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3bc97bc5-6537-4e8f-81b2-d4532481d36c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:27.222153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3bc97bc5-6537-4e8f-81b2-d4532481d36c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:27.504640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3bc97bc5-6537-4e8f-81b2-d4532481d36c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:27.514439 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3bc97bc5-6537-4e8f-81b2-d4532481d36c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1254 microversion: 2.1 time: 0.341190 Jul 27 22:52:27.521496 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 253/486] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:27 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1254 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:52:27.526894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0a7f3b07-78c1-4cc6-866c-8b73d496f7a3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:27.529882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0a7f3b07-78c1-4cc6-866c-8b73d496f7a3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:27.549085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a7f3b07-78c1-4cc6-866c-8b73d496f7a3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:27.549805 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a7f3b07-78c1-4cc6-866c-8b73d496f7a3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:27.553470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a7f3b07-78c1-4cc6-866c-8b73d496f7a3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:27.555595 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a7f3b07-78c1-4cc6-866c-8b73d496f7a3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:27.629725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-05e562de-0cc8-4d73-8e1b-874f782e9e45 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:27.646138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-05e562de-0cc8-4d73-8e1b-874f782e9e45 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:27.651252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-05e562de-0cc8-4d73-8e1b-874f782e9e45 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:27.658188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-05e562de-0cc8-4d73-8e1b-874f782e9e45 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.769844 Jul 27 22:52:27.658786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 234/487] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:26 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:27.881762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0a7f3b07-78c1-4cc6-866c-8b73d496f7a3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:27.890722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0a7f3b07-78c1-4cc6-866c-8b73d496f7a3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.367485 Jul 27 22:52:27.892351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 254/488] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:27 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:28.538456 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e82a1ef9-72e9-4274-a38e-a7e08be261ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:28.539081 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e82a1ef9-72e9-4274-a38e-a7e08be261ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:28.557365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e82a1ef9-72e9-4274-a38e-a7e08be261ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:28.557817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e82a1ef9-72e9-4274-a38e-a7e08be261ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:28.558605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e82a1ef9-72e9-4274-a38e-a7e08be261ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:28.559042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e82a1ef9-72e9-4274-a38e-a7e08be261ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:28.688278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6e7b4cda-e636-435b-913b-c5693bc5fe13 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:28.689171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6e7b4cda-e636-435b-913b-c5693bc5fe13 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:28.699834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6e7b4cda-e636-435b-913b-c5693bc5fe13 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:28.705872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6e7b4cda-e636-435b-913b-c5693bc5fe13 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:28.715417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6e7b4cda-e636-435b-913b-c5693bc5fe13 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:28.718115 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6e7b4cda-e636-435b-913b-c5693bc5fe13 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:28.733995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e82a1ef9-72e9-4274-a38e-a7e08be261ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:28.745963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e82a1ef9-72e9-4274-a38e-a7e08be261ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1310 microversion: 2.1 time: 0.211600 Jul 27 22:52:28.747542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 235/489] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:28 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1310 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:28.916620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0229439a-f10a-4368-b047-a209346f48e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:28.917287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0229439a-f10a-4368-b047-a209346f48e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:28.939090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0229439a-f10a-4368-b047-a209346f48e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:28.943836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0229439a-f10a-4368-b047-a209346f48e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:28.944802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0229439a-f10a-4368-b047-a209346f48e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:28.945242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0229439a-f10a-4368-b047-a209346f48e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:29.380655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6e7b4cda-e636-435b-913b-c5693bc5fe13 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:29.411169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6e7b4cda-e636-435b-913b-c5693bc5fe13 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:29.413789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6e7b4cda-e636-435b-913b-c5693bc5fe13 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:29.416024 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6e7b4cda-e636-435b-913b-c5693bc5fe13 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.732655 Jul 27 22:52:29.417674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 255/490] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:28 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:29.538069 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0229439a-f10a-4368-b047-a209346f48e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:29.550400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0229439a-f10a-4368-b047-a209346f48e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.637632 Jul 27 22:52:29.554287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 236/491] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:28 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:52:29.773708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bf83eabb-3de7-41d3-8e99-5d217bedff41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:29.774554 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bf83eabb-3de7-41d3-8e99-5d217bedff41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:29.789877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf83eabb-3de7-41d3-8e99-5d217bedff41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:29.790657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf83eabb-3de7-41d3-8e99-5d217bedff41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:29.791687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf83eabb-3de7-41d3-8e99-5d217bedff41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:29.793041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf83eabb-3de7-41d3-8e99-5d217bedff41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:29.957012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bf83eabb-3de7-41d3-8e99-5d217bedff41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:29.961990 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:29.970546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bf83eabb-3de7-41d3-8e99-5d217bedff41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1318 microversion: 2.1 time: 0.201646 Jul 27 22:52:29.974797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 256/492] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:29 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:30.442184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-07559a28-23ed-4d7c-b936-22e0978528ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:30.444267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-07559a28-23ed-4d7c-b936-22e0978528ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:30.465022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07559a28-23ed-4d7c-b936-22e0978528ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:30.465465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07559a28-23ed-4d7c-b936-22e0978528ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:30.466460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07559a28-23ed-4d7c-b936-22e0978528ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:30.467092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07559a28-23ed-4d7c-b936-22e0978528ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:30.574791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-864127dc-e1fe-4e00-89b0-4599bacff2b3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:30.577363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-864127dc-e1fe-4e00-89b0-4599bacff2b3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:30.589466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-864127dc-e1fe-4e00-89b0-4599bacff2b3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:30.593179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-864127dc-e1fe-4e00-89b0-4599bacff2b3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:30.594209 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-864127dc-e1fe-4e00-89b0-4599bacff2b3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:30.595766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-864127dc-e1fe-4e00-89b0-4599bacff2b3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:30.792668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-07559a28-23ed-4d7c-b936-22e0978528ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:30.804044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-07559a28-23ed-4d7c-b936-22e0978528ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:30.805579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-07559a28-23ed-4d7c-b936-22e0978528ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:30.806752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-07559a28-23ed-4d7c-b936-22e0978528ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.368829 Jul 27 22:52:30.807310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 237/493] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:30.829145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-864127dc-e1fe-4e00-89b0-4599bacff2b3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:30.839387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-864127dc-e1fe-4e00-89b0-4599bacff2b3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.267676 Jul 27 22:52:30.839777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 257/494] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:30 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:30.995153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-998d9bbb-ea57-44c9-8cd7-c9d5aa3482ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:30.995766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-998d9bbb-ea57-44c9-8cd7-c9d5aa3482ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:31.006969 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-998d9bbb-ea57-44c9-8cd7-c9d5aa3482ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:31.007644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-998d9bbb-ea57-44c9-8cd7-c9d5aa3482ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:31.008731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-998d9bbb-ea57-44c9-8cd7-c9d5aa3482ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:31.009363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-998d9bbb-ea57-44c9-8cd7-c9d5aa3482ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:31.109628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-998d9bbb-ea57-44c9-8cd7-c9d5aa3482ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:31.119178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-998d9bbb-ea57-44c9-8cd7-c9d5aa3482ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1318 microversion: 2.1 time: 0.128503 Jul 27 22:52:31.120280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 238/495] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:30 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1318 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:31.838596 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-75e46114-b343-4f28-a62f-7f33c7e1555b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:31.839199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-75e46114-b343-4f28-a62f-7f33c7e1555b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:31.849008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75e46114-b343-4f28-a62f-7f33c7e1555b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:31.850963 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75e46114-b343-4f28-a62f-7f33c7e1555b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:31.851906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75e46114-b343-4f28-a62f-7f33c7e1555b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:31.852522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75e46114-b343-4f28-a62f-7f33c7e1555b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:31.862293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5b468996-8ff3-4433-8f75-3bd234b4178d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:31.862919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5b468996-8ff3-4433-8f75-3bd234b4178d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:31.873037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b468996-8ff3-4433-8f75-3bd234b4178d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:31.873486 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b468996-8ff3-4433-8f75-3bd234b4178d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:31.881593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b468996-8ff3-4433-8f75-3bd234b4178d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:31.882207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b468996-8ff3-4433-8f75-3bd234b4178d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:32.111114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-75e46114-b343-4f28-a62f-7f33c7e1555b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:32.125490 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-75e46114-b343-4f28-a62f-7f33c7e1555b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:32.127075 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-75e46114-b343-4f28-a62f-7f33c7e1555b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:32.138672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-75e46114-b343-4f28-a62f-7f33c7e1555b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.303808 Jul 27 22:52:32.152738 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 258/496] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:31 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:32.169355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7e55e183-e05b-4e82-bb2c-fac10961ef8a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:32.169355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7e55e183-e05b-4e82-bb2c-fac10961ef8a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:32.176863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7e55e183-e05b-4e82-bb2c-fac10961ef8a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:32.177319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7e55e183-e05b-4e82-bb2c-fac10961ef8a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:32.178099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7e55e183-e05b-4e82-bb2c-fac10961ef8a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:32.178583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7e55e183-e05b-4e82-bb2c-fac10961ef8a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:32.209569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5b468996-8ff3-4433-8f75-3bd234b4178d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:32.217776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5b468996-8ff3-4433-8f75-3bd234b4178d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.360844 Jul 27 22:52:32.219300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 239/497] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:31 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:32.520784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7e55e183-e05b-4e82-bb2c-fac10961ef8a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:32.551552 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7e55e183-e05b-4e82-bb2c-fac10961ef8a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.396633 Jul 27 22:52:32.570982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 259/498] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:32 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:32.765949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-d66a3ce8-10a5-40c7-a4f2-560bdf129030 req-90f8931d-0975-4925-a866-5af6451d9806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19fab65-5354-4383-ba3a-9eb6614382ff", "name": "network-vif-plugged", "status": "completed", "tag": "e46bb58f-7220-4510-a401-14284c9dde2a"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:32.798194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-d66a3ce8-10a5-40c7-a4f2-560bdf129030 req-90f8931d-0975-4925-a866-5af6451d9806 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:32.798751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-d66a3ce8-10a5-40c7-a4f2-560bdf129030 req-90f8931d-0975-4925-a866-5af6451d9806 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:32.856672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-d66a3ce8-10a5-40c7-a4f2-560bdf129030 req-90f8931d-0975-4925-a866-5af6451d9806 service nova] Creating event network-vif-plugged:e46bb58f-7220-4510-a401-14284c9dde2a for instance b19fab65-5354-4383-ba3a-9eb6614382ff on hv-cinder-85124 Jul 27 22:52:32.868836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-d66a3ce8-10a5-40c7-a4f2-560bdf129030 req-90f8931d-0975-4925-a866-5af6451d9806 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107355 Jul 27 22:52:32.872938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 240/499] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:52:32.909236 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-295b9caa-391c-45ac-a16b-d0a85f6b909d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:32.910107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-295b9caa-391c-45ac-a16b-d0a85f6b909d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:32.922711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-295b9caa-391c-45ac-a16b-d0a85f6b909d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:32.924822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-295b9caa-391c-45ac-a16b-d0a85f6b909d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:32.926021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-295b9caa-391c-45ac-a16b-d0a85f6b909d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:32.934372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-295b9caa-391c-45ac-a16b-d0a85f6b909d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:33.394319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.objects.instance [None req-295b9caa-391c-45ac-a16b-d0a85f6b909d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lazy-loading 'services' on Instance uuid f61a77c9-764c-4eca-a654-dabb4c208454 {{(pid=129295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:52:33.408522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5bf72a08-5e25-442f-8cfc-2d464c3c081b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Action: 'create', calling method: .version_select at 0x7f696a24a0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2067908588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4ay/dFk4Op0kmGgukqv2BE3L+H9+fL/WJ1pRKd8X38YgyicUe0EYPFtT7eKseUTYiLsFqcS4JluvVAtaaJMnUIE7SIfq77rc1FWQEJSiw0poMGkWcAoK/ZGIgEyzT/0Q=="}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:33.426583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-5bf72a08-5e25-442f-8cfc-2d464c3c081b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Getting quotas for project 8df7953219954eeeb7279f310cdea955. Resources: {'key_pairs'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:52:33.431972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-5bf72a08-5e25-442f-8cfc-2d464c3c081b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Getting quotas for user fa0ac767fd754bdeb5307a1a234607e7 and project 8df7953219954eeeb7279f310cdea955. Resources: {'key_pairs'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:52:33.463923 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5bf72a08-5e25-442f-8cfc-2d464c3c081b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [2d0e462f-2da8-4a82-b692-c7b5e8411af5] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 22:52:33.706539 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-295b9caa-391c-45ac-a16b-d0a85f6b909d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/os-volume_attachments/87ca4702-4dfa-4134-91b2-9ff474759e60" status: 202 len: 0 microversion: 2.1 time: 0.801882 Jul 27 22:52:33.709811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 241/500] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 22:52:32 2022] DELETE /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/os-volume_attachments/87ca4702-4dfa-4134-91b2-9ff474759e60 => generated 0 bytes in 808 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 22:52:33.725330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-08db027e-fb05-4c2a-a5bd-cc3196392732 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:33.727252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-08db027e-fb05-4c2a-a5bd-cc3196392732 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:33.760943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08db027e-fb05-4c2a-a5bd-cc3196392732 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:33.762012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08db027e-fb05-4c2a-a5bd-cc3196392732 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:33.766000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08db027e-fb05-4c2a-a5bd-cc3196392732 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:33.771027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08db027e-fb05-4c2a-a5bd-cc3196392732 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:34.107490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-08db027e-fb05-4c2a-a5bd-cc3196392732 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:34.117385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-08db027e-fb05-4c2a-a5bd-cc3196392732 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:34.120858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-08db027e-fb05-4c2a-a5bd-cc3196392732 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:34.123474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-08db027e-fb05-4c2a-a5bd-cc3196392732 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.411387 Jul 27 22:52:34.125527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 242/501] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:34.144729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c8189b87-3dff-4abb-846d-ad8ff01a585f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:34.145701 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c8189b87-3dff-4abb-846d-ad8ff01a585f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:34.163325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8189b87-3dff-4abb-846d-ad8ff01a585f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:34.164223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8189b87-3dff-4abb-846d-ad8ff01a585f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:34.165593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8189b87-3dff-4abb-846d-ad8ff01a585f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:34.166253 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8189b87-3dff-4abb-846d-ad8ff01a585f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:34.360257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c8189b87-3dff-4abb-846d-ad8ff01a585f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:34.370160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c8189b87-3dff-4abb-846d-ad8ff01a585f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.242251 Jul 27 22:52:34.370742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 243/502] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:34 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:34.375928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-824aa59d-c684-4971-bcc8-2af5910582ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:34.376538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-824aa59d-c684-4971-bcc8-2af5910582ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:34.391519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-824aa59d-c684-4971-bcc8-2af5910582ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:34.392063 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-824aa59d-c684-4971-bcc8-2af5910582ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:34.392953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-824aa59d-c684-4971-bcc8-2af5910582ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:34.393460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-824aa59d-c684-4971-bcc8-2af5910582ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:34.477393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [None req-5bf72a08-5e25-442f-8cfc-2d464c3c081b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [2d0e462f-2da8-4a82-b692-c7b5e8411af5] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 36072. Jul 27 22:52:34.503270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5bf72a08-5e25-442f-8cfc-2d464c3c081b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.708456 Jul 27 22:52:34.504455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 260/503] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 22:52:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:52:34.532542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-0f94fc8e-d6a5-4e4e-9459-5440a5893760 req-e64f4a94-d424-46c1-a1c5-d82320c66cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a6fc53-bd93-47c4-9413-39ba0e1b6068", "tag": "ea3daece-2ad0-4979-adb0-cba646786ccc"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:34.557961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-0f94fc8e-d6a5-4e4e-9459-5440a5893760 req-e64f4a94-d424-46c1-a1c5-d82320c66cc7 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:34.565091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-0f94fc8e-d6a5-4e4e-9459-5440a5893760 req-e64f4a94-d424-46c1-a1c5-d82320c66cc7 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:34.596603 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-0f94fc8e-d6a5-4e4e-9459-5440a5893760 req-e64f4a94-d424-46c1-a1c5-d82320c66cc7 service nova] Creating event network-changed:ea3daece-2ad0-4979-adb0-cba646786ccc for instance 69a6fc53-bd93-47c4-9413-39ba0e1b6068 on hv-cinder-85124 Jul 27 22:52:34.610452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-0f94fc8e-d6a5-4e4e-9459-5440a5893760 req-e64f4a94-d424-46c1-a1c5-d82320c66cc7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104587 Jul 27 22:52:34.610674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-824aa59d-c684-4971-bcc8-2af5910582ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:34.611042 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 261/504] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:52:34.620277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-824aa59d-c684-4971-bcc8-2af5910582ed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.248486 Jul 27 22:52:34.625239 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 244/505] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:34 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:35.153698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1bf68392-f5bd-46ea-ace9-e22cdd65ceb5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:35.154402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1bf68392-f5bd-46ea-ace9-e22cdd65ceb5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:35.169106 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1bf68392-f5bd-46ea-ace9-e22cdd65ceb5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:35.169562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1bf68392-f5bd-46ea-ace9-e22cdd65ceb5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:35.171759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1bf68392-f5bd-46ea-ace9-e22cdd65ceb5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:35.172382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1bf68392-f5bd-46ea-ace9-e22cdd65ceb5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:35.391266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-72bfe8ca-2e87-4714-8617-6b75d341edfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:35.392513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-72bfe8ca-2e87-4714-8617-6b75d341edfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:35.410200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72bfe8ca-2e87-4714-8617-6b75d341edfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:35.417034 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72bfe8ca-2e87-4714-8617-6b75d341edfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:35.418166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72bfe8ca-2e87-4714-8617-6b75d341edfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:35.418797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72bfe8ca-2e87-4714-8617-6b75d341edfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:35.432739 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1bf68392-f5bd-46ea-ace9-e22cdd65ceb5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:35.448274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1bf68392-f5bd-46ea-ace9-e22cdd65ceb5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:35.453385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1bf68392-f5bd-46ea-ace9-e22cdd65ceb5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:35.454689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1bf68392-f5bd-46ea-ace9-e22cdd65ceb5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.306637 Jul 27 22:52:35.458650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 262/506] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:35.643885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-077fc0d0-2a04-4a15-8876-2f970cf182f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:35.644477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-077fc0d0-2a04-4a15-8876-2f970cf182f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:35.663589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-077fc0d0-2a04-4a15-8876-2f970cf182f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:35.665235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-077fc0d0-2a04-4a15-8876-2f970cf182f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:35.667645 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-077fc0d0-2a04-4a15-8876-2f970cf182f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:35.668595 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-077fc0d0-2a04-4a15-8876-2f970cf182f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:35.755563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:35.814318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-72bfe8ca-2e87-4714-8617-6b75d341edfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:35.832790 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-72bfe8ca-2e87-4714-8617-6b75d341edfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.439308 Jul 27 22:52:35.834013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 245/507] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:35 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:35.984518 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-077fc0d0-2a04-4a15-8876-2f970cf182f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:36.008462 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-077fc0d0-2a04-4a15-8876-2f970cf182f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.368884 Jul 27 22:52:36.022117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 263/508] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:35 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:52:36.496187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a1f651e8-f909-4594-92fd-232d071baccf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:36.496939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a1f651e8-f909-4594-92fd-232d071baccf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:36.499056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=20 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:36.505634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1f651e8-f909-4594-92fd-232d071baccf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:36.506213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1f651e8-f909-4594-92fd-232d071baccf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:36.507151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1f651e8-f909-4594-92fd-232d071baccf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:36.507684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1f651e8-f909-4594-92fd-232d071baccf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:36.776350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a1f651e8-f909-4594-92fd-232d071baccf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:36.796586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a1f651e8-f909-4594-92fd-232d071baccf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:36.798221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a1f651e8-f909-4594-92fd-232d071baccf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:36.800348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a1f651e8-f909-4594-92fd-232d071baccf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.308916 Jul 27 22:52:36.801761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 246/509] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:36.855942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a48e2f1f-473a-45fc-b4ea-5e4f5311aa29 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:36.857737 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a48e2f1f-473a-45fc-b4ea-5e4f5311aa29 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:36.868616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a48e2f1f-473a-45fc-b4ea-5e4f5311aa29 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:36.869996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a48e2f1f-473a-45fc-b4ea-5e4f5311aa29 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:36.879518 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a48e2f1f-473a-45fc-b4ea-5e4f5311aa29 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:36.880430 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a48e2f1f-473a-45fc-b4ea-5e4f5311aa29 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:37.035271 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2826bfc4-810a-48d1-88d5-780b2f67ff30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:37.035928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2826bfc4-810a-48d1-88d5-780b2f67ff30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:37.055696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2826bfc4-810a-48d1-88d5-780b2f67ff30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:37.056165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2826bfc4-810a-48d1-88d5-780b2f67ff30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:37.057001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2826bfc4-810a-48d1-88d5-780b2f67ff30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:37.057440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2826bfc4-810a-48d1-88d5-780b2f67ff30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:37.163022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a48e2f1f-473a-45fc-b4ea-5e4f5311aa29 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:37.174850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a48e2f1f-473a-45fc-b4ea-5e4f5311aa29 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.323144 Jul 27 22:52:37.177570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 264/510] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:36 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:37.388534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2826bfc4-810a-48d1-88d5-780b2f67ff30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:37.402130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2826bfc4-810a-48d1-88d5-780b2f67ff30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.371790 Jul 27 22:52:37.406718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 247/511] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:37 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:37.836543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ced50e7c-5397-4a67-b132-712992e31fb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:37.837177 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ced50e7c-5397-4a67-b132-712992e31fb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:37.844724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ced50e7c-5397-4a67-b132-712992e31fb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:37.845167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ced50e7c-5397-4a67-b132-712992e31fb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:37.845940 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ced50e7c-5397-4a67-b132-712992e31fb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:37.846365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ced50e7c-5397-4a67-b132-712992e31fb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:38.001259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ced50e7c-5397-4a67-b132-712992e31fb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:38.010166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ced50e7c-5397-4a67-b132-712992e31fb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:38.011687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ced50e7c-5397-4a67-b132-712992e31fb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:38.012929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ced50e7c-5397-4a67-b132-712992e31fb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.180270 Jul 27 22:52:38.013471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 265/512] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:38.197835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bcbc51da-96e3-4c5f-b572-67cfe54108f6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:38.198478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bcbc51da-96e3-4c5f-b572-67cfe54108f6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:38.205157 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bcbc51da-96e3-4c5f-b572-67cfe54108f6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:38.205606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bcbc51da-96e3-4c5f-b572-67cfe54108f6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:38.206382 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bcbc51da-96e3-4c5f-b572-67cfe54108f6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:38.206842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bcbc51da-96e3-4c5f-b572-67cfe54108f6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:38.225250 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:38.342864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bcbc51da-96e3-4c5f-b572-67cfe54108f6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:38.350620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bcbc51da-96e3-4c5f-b572-67cfe54108f6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.156673 Jul 27 22:52:38.351178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 248/513] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:38 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:38.440109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-db0a1072-d82c-452f-b694-52f39ab9fd78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:38.440751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-db0a1072-d82c-452f-b694-52f39ab9fd78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:38.447293 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db0a1072-d82c-452f-b694-52f39ab9fd78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:38.447852 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db0a1072-d82c-452f-b694-52f39ab9fd78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:38.448838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db0a1072-d82c-452f-b694-52f39ab9fd78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:38.449379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db0a1072-d82c-452f-b694-52f39ab9fd78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:38.651335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-db0a1072-d82c-452f-b694-52f39ab9fd78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:38.661353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-db0a1072-d82c-452f-b694-52f39ab9fd78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.225389 Jul 27 22:52:38.662804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 266/514] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:38 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:39.036694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cf9f17be-45e3-49e8-bfaa-bd75a261b059 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:39.037313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cf9f17be-45e3-49e8-bfaa-bd75a261b059 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:39.043423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf9f17be-45e3-49e8-bfaa-bd75a261b059 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:39.043856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf9f17be-45e3-49e8-bfaa-bd75a261b059 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:39.044656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf9f17be-45e3-49e8-bfaa-bd75a261b059 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:39.045094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf9f17be-45e3-49e8-bfaa-bd75a261b059 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:39.195315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cf9f17be-45e3-49e8-bfaa-bd75a261b059 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:39.204405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cf9f17be-45e3-49e8-bfaa-bd75a261b059 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:39.205925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cf9f17be-45e3-49e8-bfaa-bd75a261b059 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:39.207086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cf9f17be-45e3-49e8-bfaa-bd75a261b059 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.174349 Jul 27 22:52:39.207636 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 249/515] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:39.371312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7b0a35df-02c0-4d9d-a926-601b406dd064 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:39.371924 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7b0a35df-02c0-4d9d-a926-601b406dd064 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:39.378611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7b0a35df-02c0-4d9d-a926-601b406dd064 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:39.379056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7b0a35df-02c0-4d9d-a926-601b406dd064 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:39.379826 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7b0a35df-02c0-4d9d-a926-601b406dd064 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:39.380256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7b0a35df-02c0-4d9d-a926-601b406dd064 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:39.547600 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7b0a35df-02c0-4d9d-a926-601b406dd064 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:39.555438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7b0a35df-02c0-4d9d-a926-601b406dd064 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.187987 Jul 27 22:52:39.556001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 267/516] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:39 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:52:39.683856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f9a19364-8bd5-4e9a-be7c-afbc98176a25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:39.684755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f9a19364-8bd5-4e9a-be7c-afbc98176a25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:39.692873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f9a19364-8bd5-4e9a-be7c-afbc98176a25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:39.693552 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f9a19364-8bd5-4e9a-be7c-afbc98176a25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:39.694595 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f9a19364-8bd5-4e9a-be7c-afbc98176a25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:39.695111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f9a19364-8bd5-4e9a-be7c-afbc98176a25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:39.830213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f9a19364-8bd5-4e9a-be7c-afbc98176a25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:39.839312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f9a19364-8bd5-4e9a-be7c-afbc98176a25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.159678 Jul 27 22:52:39.839891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 250/517] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:39 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:40.232201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e94af3f1-517f-42d2-8abc-8add662dd986 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:40.232882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e94af3f1-517f-42d2-8abc-8add662dd986 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:40.239983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e94af3f1-517f-42d2-8abc-8add662dd986 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:40.240435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e94af3f1-517f-42d2-8abc-8add662dd986 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:40.241246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e94af3f1-517f-42d2-8abc-8add662dd986 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:40.241684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e94af3f1-517f-42d2-8abc-8add662dd986 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:40.389757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e94af3f1-517f-42d2-8abc-8add662dd986 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:40.402014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e94af3f1-517f-42d2-8abc-8add662dd986 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:40.408441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e94af3f1-517f-42d2-8abc-8add662dd986 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:40.409982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e94af3f1-517f-42d2-8abc-8add662dd986 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.182263 Jul 27 22:52:40.416275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 268/518] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:40.582417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ef53f82a-67a2-4800-971f-2dac70af168f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:40.583721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ef53f82a-67a2-4800-971f-2dac70af168f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:40.596023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef53f82a-67a2-4800-971f-2dac70af168f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:40.596844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef53f82a-67a2-4800-971f-2dac70af168f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:40.598342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef53f82a-67a2-4800-971f-2dac70af168f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:40.599010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef53f82a-67a2-4800-971f-2dac70af168f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:40.796428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ef53f82a-67a2-4800-971f-2dac70af168f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:40.804011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ef53f82a-67a2-4800-971f-2dac70af168f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.231774 Jul 27 22:52:40.816834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 251/519] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:40 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:40.861723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1bd5bbfe-2bb8-4492-96e2-60976b1c278a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:40.862368 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1bd5bbfe-2bb8-4492-96e2-60976b1c278a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:40.864368 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:40.870739 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1bd5bbfe-2bb8-4492-96e2-60976b1c278a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:40.871336 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1bd5bbfe-2bb8-4492-96e2-60976b1c278a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:40.872184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1bd5bbfe-2bb8-4492-96e2-60976b1c278a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:40.872723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1bd5bbfe-2bb8-4492-96e2-60976b1c278a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:41.059423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1bd5bbfe-2bb8-4492-96e2-60976b1c278a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:41.067733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1bd5bbfe-2bb8-4492-96e2-60976b1c278a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.210475 Jul 27 22:52:41.071746 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 269/520] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:40 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:41.439992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-354f8093-68d9-4093-94e2-0feb7a8ed6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:41.441185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-354f8093-68d9-4093-94e2-0feb7a8ed6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:41.461440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-354f8093-68d9-4093-94e2-0feb7a8ed6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:41.461807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-354f8093-68d9-4093-94e2-0feb7a8ed6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:41.462589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-354f8093-68d9-4093-94e2-0feb7a8ed6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:41.463264 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-354f8093-68d9-4093-94e2-0feb7a8ed6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:41.642358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-354f8093-68d9-4093-94e2-0feb7a8ed6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:41.666671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-354f8093-68d9-4093-94e2-0feb7a8ed6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:41.668273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-354f8093-68d9-4093-94e2-0feb7a8ed6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:41.669967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-354f8093-68d9-4093-94e2-0feb7a8ed6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.234554 Jul 27 22:52:41.671951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 252/521] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:41.825890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-57d0810c-2c54-45a7-ae53-d6180e55ec7c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:41.826593 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-57d0810c-2c54-45a7-ae53-d6180e55ec7c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:41.833340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-57d0810c-2c54-45a7-ae53-d6180e55ec7c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:41.833883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-57d0810c-2c54-45a7-ae53-d6180e55ec7c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:41.837608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-57d0810c-2c54-45a7-ae53-d6180e55ec7c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:41.837608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-57d0810c-2c54-45a7-ae53-d6180e55ec7c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:41.990409 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-57d0810c-2c54-45a7-ae53-d6180e55ec7c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:42.001058 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-57d0810c-2c54-45a7-ae53-d6180e55ec7c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.179389 Jul 27 22:52:42.001640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 270/522] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:41 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:42.090875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-21adf628-baa7-4d5b-83c5-630bcec24129 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:42.091491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-21adf628-baa7-4d5b-83c5-630bcec24129 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:42.098217 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21adf628-baa7-4d5b-83c5-630bcec24129 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:42.098661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21adf628-baa7-4d5b-83c5-630bcec24129 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:42.099452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21adf628-baa7-4d5b-83c5-630bcec24129 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:42.100160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21adf628-baa7-4d5b-83c5-630bcec24129 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:42.243779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-21adf628-baa7-4d5b-83c5-630bcec24129 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:42.251129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-21adf628-baa7-4d5b-83c5-630bcec24129 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.165496 Jul 27 22:52:42.251688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 253/523] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:42 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:42.598017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-cf0c841b-0922-475e-b6d8-652df13ad9e9 req-e988791c-7d72-4f2c-a792-2786de105559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e457f5fc-ae83-4b88-87be-ba1007c5865e", "name": "network-vif-plugged", "status": "completed", "tag": "977e384c-b17c-446d-945e-7c6a9e7c3e88"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:42.608814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-cf0c841b-0922-475e-b6d8-652df13ad9e9 req-e988791c-7d72-4f2c-a792-2786de105559 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:42.609338 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-cf0c841b-0922-475e-b6d8-652df13ad9e9 req-e988791c-7d72-4f2c-a792-2786de105559 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:42.620927 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-cf0c841b-0922-475e-b6d8-652df13ad9e9 req-e988791c-7d72-4f2c-a792-2786de105559 service nova] Creating event network-vif-plugged:977e384c-b17c-446d-945e-7c6a9e7c3e88 for instance e457f5fc-ae83-4b88-87be-ba1007c5865e on hv-cinder-85124 Jul 27 22:52:42.626605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-cf0c841b-0922-475e-b6d8-652df13ad9e9 req-e988791c-7d72-4f2c-a792-2786de105559 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033602 Jul 27 22:52:42.627541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 271/524] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:52:42.694676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-03173e87-35f6-440e-90a8-a9cd22557aa1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:42.695275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-03173e87-35f6-440e-90a8-a9cd22557aa1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:42.702135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-03173e87-35f6-440e-90a8-a9cd22557aa1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:42.702578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-03173e87-35f6-440e-90a8-a9cd22557aa1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:42.703360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-03173e87-35f6-440e-90a8-a9cd22557aa1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:42.703806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-03173e87-35f6-440e-90a8-a9cd22557aa1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:42.834019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-03173e87-35f6-440e-90a8-a9cd22557aa1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:42.843292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-03173e87-35f6-440e-90a8-a9cd22557aa1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:42.844832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-03173e87-35f6-440e-90a8-a9cd22557aa1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:42.845984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-03173e87-35f6-440e-90a8-a9cd22557aa1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.155444 Jul 27 22:52:42.846534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 254/525] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:43.022610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-92848b82-8b1d-47c4-a99e-3c3886067de0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:43.023333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-92848b82-8b1d-47c4-a99e-3c3886067de0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:43.029995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-92848b82-8b1d-47c4-a99e-3c3886067de0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:43.031112 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-92848b82-8b1d-47c4-a99e-3c3886067de0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:43.031961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-92848b82-8b1d-47c4-a99e-3c3886067de0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:43.032515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-92848b82-8b1d-47c4-a99e-3c3886067de0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:43.168131 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-92848b82-8b1d-47c4-a99e-3c3886067de0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:43.175697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-92848b82-8b1d-47c4-a99e-3c3886067de0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1319 microversion: 2.1 time: 0.157828 Jul 27 22:52:43.177333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 272/526] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:43 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:43.271469 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0fe12ab5-ae5b-4be4-8f49-840fff710d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:43.272075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0fe12ab5-ae5b-4be4-8f49-840fff710d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:43.278134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0fe12ab5-ae5b-4be4-8f49-840fff710d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:43.278514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0fe12ab5-ae5b-4be4-8f49-840fff710d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:43.279263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0fe12ab5-ae5b-4be4-8f49-840fff710d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:43.279697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0fe12ab5-ae5b-4be4-8f49-840fff710d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:43.407610 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0fe12ab5-ae5b-4be4-8f49-840fff710d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:43.415033 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0fe12ab5-ae5b-4be4-8f49-840fff710d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.147382 Jul 27 22:52:43.415620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 255/527] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:43 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:43.869322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ca4190ae-e85b-4601-81a1-253cd7959be9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:43.869873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ca4190ae-e85b-4601-81a1-253cd7959be9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:43.871803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=4 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:43.878668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca4190ae-e85b-4601-81a1-253cd7959be9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:43.879123 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca4190ae-e85b-4601-81a1-253cd7959be9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:43.880098 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca4190ae-e85b-4601-81a1-253cd7959be9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:43.880598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca4190ae-e85b-4601-81a1-253cd7959be9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:44.018743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ca4190ae-e85b-4601-81a1-253cd7959be9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:44.027424 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ca4190ae-e85b-4601-81a1-253cd7959be9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:44.028958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ca4190ae-e85b-4601-81a1-253cd7959be9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:44.030093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ca4190ae-e85b-4601-81a1-253cd7959be9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.164749 Jul 27 22:52:44.030636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 273/528] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:44.196202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0f4daf14-22fe-47aa-aa56-0897012860ed tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:44.196844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0f4daf14-22fe-47aa-aa56-0897012860ed tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:44.206957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0f4daf14-22fe-47aa-aa56-0897012860ed tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:44.207442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0f4daf14-22fe-47aa-aa56-0897012860ed tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:44.208331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0f4daf14-22fe-47aa-aa56-0897012860ed tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:44.208861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0f4daf14-22fe-47aa-aa56-0897012860ed tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:44.345808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0f4daf14-22fe-47aa-aa56-0897012860ed tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:44.353683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0f4daf14-22fe-47aa-aa56-0897012860ed tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1507 microversion: 2.1 time: 0.161307 Jul 27 22:52:44.365183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 256/529] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:44 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:44.436312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8e071744-a084-418a-becd-4067c7845572 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:44.437251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8e071744-a084-418a-becd-4067c7845572 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:44.443851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e071744-a084-418a-becd-4067c7845572 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:44.444284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e071744-a084-418a-becd-4067c7845572 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:44.445065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e071744-a084-418a-becd-4067c7845572 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:44.445494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e071744-a084-418a-becd-4067c7845572 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:44.581046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8e071744-a084-418a-becd-4067c7845572 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:44.589170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8e071744-a084-418a-becd-4067c7845572 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.156995 Jul 27 22:52:44.589757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 274/530] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:44 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:44.725357 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4c4a94f0-8355-4d84-90d3-35353d0849d8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:44.731830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c4a94f0-8355-4d84-90d3-35353d0849d8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:44.732397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c4a94f0-8355-4d84-90d3-35353d0849d8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:44.764367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4c4a94f0-8355-4d84-90d3-35353d0849d8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Going to try to stop instance {{(pid=129295) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 27 22:52:44.815682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4c4a94f0-8355-4d84-90d3-35353d0849d8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "POST /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/action" status: 202 len: 0 microversion: 2.1 time: 0.094393 Jul 27 22:52:44.816475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 257/531] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 22:52:44 2022] POST /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 22:52:44.828472 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e1306435-993b-4280-be42-b9cdd778b952 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:44.829122 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e1306435-993b-4280-be42-b9cdd778b952 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:44.836090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1306435-993b-4280-be42-b9cdd778b952 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:44.836502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1306435-993b-4280-be42-b9cdd778b952 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:44.837322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1306435-993b-4280-be42-b9cdd778b952 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:44.837753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1306435-993b-4280-be42-b9cdd778b952 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:44.971903 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e1306435-993b-4280-be42-b9cdd778b952 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:44.975559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:44.980320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e1306435-993b-4280-be42-b9cdd778b952 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.155669 Jul 27 22:52:44.981049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 275/532] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:44 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:45.055990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9dc8e09d-a08f-42b3-b3df-2ffb149d0f95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:45.056727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9dc8e09d-a08f-42b3-b3df-2ffb149d0f95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:45.062853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9dc8e09d-a08f-42b3-b3df-2ffb149d0f95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:45.063248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9dc8e09d-a08f-42b3-b3df-2ffb149d0f95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:45.064005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9dc8e09d-a08f-42b3-b3df-2ffb149d0f95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:45.064437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9dc8e09d-a08f-42b3-b3df-2ffb149d0f95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:45.200862 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9dc8e09d-a08f-42b3-b3df-2ffb149d0f95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:45.209493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9dc8e09d-a08f-42b3-b3df-2ffb149d0f95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:45.210974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9dc8e09d-a08f-42b3-b3df-2ffb149d0f95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:45.212374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9dc8e09d-a08f-42b3-b3df-2ffb149d0f95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.160852 Jul 27 22:52:45.213124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 258/533] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:45 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:45.609881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f0467b0d-251b-42f0-8d77-bf370f9394d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:45.610485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f0467b0d-251b-42f0-8d77-bf370f9394d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:45.617984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f0467b0d-251b-42f0-8d77-bf370f9394d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:45.618426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f0467b0d-251b-42f0-8d77-bf370f9394d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:45.619198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f0467b0d-251b-42f0-8d77-bf370f9394d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:45.619630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f0467b0d-251b-42f0-8d77-bf370f9394d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:45.754912 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f0467b0d-251b-42f0-8d77-bf370f9394d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:45.762567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f0467b0d-251b-42f0-8d77-bf370f9394d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.156673 Jul 27 22:52:45.763132 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 276/534] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:45 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:46.003418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3da0c354-cb12-4518-8622-f94b7cf6d326 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:46.003935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3da0c354-cb12-4518-8622-f94b7cf6d326 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:46.010131 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3da0c354-cb12-4518-8622-f94b7cf6d326 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:46.010578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3da0c354-cb12-4518-8622-f94b7cf6d326 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:46.011319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3da0c354-cb12-4518-8622-f94b7cf6d326 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:46.011780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3da0c354-cb12-4518-8622-f94b7cf6d326 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:46.148352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3da0c354-cb12-4518-8622-f94b7cf6d326 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:46.155958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3da0c354-cb12-4518-8622-f94b7cf6d326 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.157180 Jul 27 22:52:46.156510 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 259/535] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:45 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:46.238356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-316bc400-d044-41e6-b0b5-699fcf76b55d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:46.239109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-316bc400-d044-41e6-b0b5-699fcf76b55d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:46.245503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-316bc400-d044-41e6-b0b5-699fcf76b55d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:46.245953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-316bc400-d044-41e6-b0b5-699fcf76b55d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:46.246727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-316bc400-d044-41e6-b0b5-699fcf76b55d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:46.247161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-316bc400-d044-41e6-b0b5-699fcf76b55d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:46.375092 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-316bc400-d044-41e6-b0b5-699fcf76b55d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:46.383417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-316bc400-d044-41e6-b0b5-699fcf76b55d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:46.384940 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-316bc400-d044-41e6-b0b5-699fcf76b55d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:46.386093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-316bc400-d044-41e6-b0b5-699fcf76b55d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.152587 Jul 27 22:52:46.386647 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 277/536] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:46.784120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4a503cea-3516-4ede-a709-8c3dfa63c364 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:46.784743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4a503cea-3516-4ede-a709-8c3dfa63c364 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:46.790866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4a503cea-3516-4ede-a709-8c3dfa63c364 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:46.791300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4a503cea-3516-4ede-a709-8c3dfa63c364 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:46.792044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4a503cea-3516-4ede-a709-8c3dfa63c364 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:46.792463 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4a503cea-3516-4ede-a709-8c3dfa63c364 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:46.928812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4a503cea-3516-4ede-a709-8c3dfa63c364 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:46.937181 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4a503cea-3516-4ede-a709-8c3dfa63c364 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.157139 Jul 27 22:52:46.937772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 260/537] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:46 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:47.177685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ab042644-5528-4d38-ac20-9dfe06cc69c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:47.178304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ab042644-5528-4d38-ac20-9dfe06cc69c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:47.184864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab042644-5528-4d38-ac20-9dfe06cc69c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:47.185310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab042644-5528-4d38-ac20-9dfe06cc69c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:47.186060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab042644-5528-4d38-ac20-9dfe06cc69c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:47.186489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab042644-5528-4d38-ac20-9dfe06cc69c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:47.322146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ab042644-5528-4d38-ac20-9dfe06cc69c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:47.329545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ab042644-5528-4d38-ac20-9dfe06cc69c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.155714 Jul 27 22:52:47.330114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 278/538] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:47 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:47.410209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d3a3eee7-4e86-4660-b69e-4ef4bfa5bc25 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:47.410755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d3a3eee7-4e86-4660-b69e-4ef4bfa5bc25 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:47.417811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d3a3eee7-4e86-4660-b69e-4ef4bfa5bc25 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:47.418262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d3a3eee7-4e86-4660-b69e-4ef4bfa5bc25 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:47.419022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d3a3eee7-4e86-4660-b69e-4ef4bfa5bc25 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:47.419453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d3a3eee7-4e86-4660-b69e-4ef4bfa5bc25 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:47.554050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d3a3eee7-4e86-4660-b69e-4ef4bfa5bc25 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:47.562686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d3a3eee7-4e86-4660-b69e-4ef4bfa5bc25 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:47.564508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d3a3eee7-4e86-4660-b69e-4ef4bfa5bc25 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:47.566167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d3a3eee7-4e86-4660-b69e-4ef4bfa5bc25 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.160867 Jul 27 22:52:47.567036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 261/539] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:47.959889 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-61be464f-f8c4-4697-83c4-bd3ab051b055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:47.960532 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-61be464f-f8c4-4697-83c4-bd3ab051b055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:47.969918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-61be464f-f8c4-4697-83c4-bd3ab051b055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:47.970353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-61be464f-f8c4-4697-83c4-bd3ab051b055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:47.971114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-61be464f-f8c4-4697-83c4-bd3ab051b055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:47.971539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-61be464f-f8c4-4697-83c4-bd3ab051b055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:48.113124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-61be464f-f8c4-4697-83c4-bd3ab051b055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:48.120402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-61be464f-f8c4-4697-83c4-bd3ab051b055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.165739 Jul 27 22:52:48.120976 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 279/540] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:47 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:48.352147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ef4b1f34-7afd-4f51-9e08-ee02f0c9259f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:48.352788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ef4b1f34-7afd-4f51-9e08-ee02f0c9259f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:48.358855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef4b1f34-7afd-4f51-9e08-ee02f0c9259f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:48.359298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef4b1f34-7afd-4f51-9e08-ee02f0c9259f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:48.360057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef4b1f34-7afd-4f51-9e08-ee02f0c9259f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:48.360488 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef4b1f34-7afd-4f51-9e08-ee02f0c9259f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:48.490205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ef4b1f34-7afd-4f51-9e08-ee02f0c9259f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:48.497820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ef4b1f34-7afd-4f51-9e08-ee02f0c9259f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.149742 Jul 27 22:52:48.498300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 262/541] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:48 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:48.590164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6fc6aefa-ef50-4306-bc92-d92c98fb8708 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:48.590786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6fc6aefa-ef50-4306-bc92-d92c98fb8708 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:48.597427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6fc6aefa-ef50-4306-bc92-d92c98fb8708 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:48.598108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6fc6aefa-ef50-4306-bc92-d92c98fb8708 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:48.598877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6fc6aefa-ef50-4306-bc92-d92c98fb8708 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:48.599310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6fc6aefa-ef50-4306-bc92-d92c98fb8708 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:48.644583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-b1749aac-51cd-4519-9f96-835f5263b9c2 req-23f51bc8-7b5f-4dcc-b0da-602ab511a934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a6fc53-bd93-47c4-9413-39ba0e1b6068", "name": "network-vif-plugged", "status": "completed", "tag": "ea3daece-2ad0-4979-adb0-cba646786ccc"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:48.654048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-b1749aac-51cd-4519-9f96-835f5263b9c2 req-23f51bc8-7b5f-4dcc-b0da-602ab511a934 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:48.654604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-b1749aac-51cd-4519-9f96-835f5263b9c2 req-23f51bc8-7b5f-4dcc-b0da-602ab511a934 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:48.666370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-b1749aac-51cd-4519-9f96-835f5263b9c2 req-23f51bc8-7b5f-4dcc-b0da-602ab511a934 service nova] Creating event network-vif-plugged:ea3daece-2ad0-4979-adb0-cba646786ccc for instance 69a6fc53-bd93-47c4-9413-39ba0e1b6068 on hv-cinder-85124 Jul 27 22:52:48.671312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-b1749aac-51cd-4519-9f96-835f5263b9c2 req-23f51bc8-7b5f-4dcc-b0da-602ab511a934 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030999 Jul 27 22:52:48.672075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 263/542] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:52:48.746337 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6fc6aefa-ef50-4306-bc92-d92c98fb8708 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:48.755465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6fc6aefa-ef50-4306-bc92-d92c98fb8708 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:48.757104 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6fc6aefa-ef50-4306-bc92-d92c98fb8708 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:48.758333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6fc6aefa-ef50-4306-bc92-d92c98fb8708 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.172180 Jul 27 22:52:48.758967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 280/543] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:48 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:49.140976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1c23130c-d62c-45fa-add5-6814b6eb0fac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:49.141684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1c23130c-d62c-45fa-add5-6814b6eb0fac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:49.148630 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c23130c-d62c-45fa-add5-6814b6eb0fac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:49.149346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c23130c-d62c-45fa-add5-6814b6eb0fac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:49.150178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c23130c-d62c-45fa-add5-6814b6eb0fac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:49.150609 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c23130c-d62c-45fa-add5-6814b6eb0fac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:49.295156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1c23130c-d62c-45fa-add5-6814b6eb0fac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:49.299113 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:49.304440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1c23130c-d62c-45fa-add5-6814b6eb0fac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1358 microversion: 2.1 time: 0.167995 Jul 27 22:52:49.305040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 264/544] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:49 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:49.519175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b63e6ea3-b5e4-45f9-9a6f-92544b1db412 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:49.519840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b63e6ea3-b5e4-45f9-9a6f-92544b1db412 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:49.526168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b63e6ea3-b5e4-45f9-9a6f-92544b1db412 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:49.526819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b63e6ea3-b5e4-45f9-9a6f-92544b1db412 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:49.527582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b63e6ea3-b5e4-45f9-9a6f-92544b1db412 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:49.528234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b63e6ea3-b5e4-45f9-9a6f-92544b1db412 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:49.677279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b63e6ea3-b5e4-45f9-9a6f-92544b1db412 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:49.684816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b63e6ea3-b5e4-45f9-9a6f-92544b1db412 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.169652 Jul 27 22:52:49.685389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 281/545] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:49 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:49.783248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2965e5d1-e01f-47e6-9983-e435d3edc106 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:49.783853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2965e5d1-e01f-47e6-9983-e435d3edc106 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:49.790755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2965e5d1-e01f-47e6-9983-e435d3edc106 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:49.791198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2965e5d1-e01f-47e6-9983-e435d3edc106 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:49.791959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2965e5d1-e01f-47e6-9983-e435d3edc106 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:49.792395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2965e5d1-e01f-47e6-9983-e435d3edc106 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:49.926044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2965e5d1-e01f-47e6-9983-e435d3edc106 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:49.940414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2965e5d1-e01f-47e6-9983-e435d3edc106 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:49.942888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2965e5d1-e01f-47e6-9983-e435d3edc106 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:49.944364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2965e5d1-e01f-47e6-9983-e435d3edc106 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1807 microversion: 2.20 time: 0.165817 Jul 27 22:52:49.945046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 265/546] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:49 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 22:52:50.326315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-52acd822-e452-47fd-994d-15a343dc3764 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:50.326924 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-52acd822-e452-47fd-994d-15a343dc3764 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:50.333700 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52acd822-e452-47fd-994d-15a343dc3764 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:50.334145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52acd822-e452-47fd-994d-15a343dc3764 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:50.334905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52acd822-e452-47fd-994d-15a343dc3764 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:50.335333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52acd822-e452-47fd-994d-15a343dc3764 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:50.458718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-52acd822-e452-47fd-994d-15a343dc3764 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:50.466024 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-52acd822-e452-47fd-994d-15a343dc3764 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1547 microversion: 2.1 time: 0.143677 Jul 27 22:52:50.466578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 282/547] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1547 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:50.487386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0a0b6c5d-ae18-4095-a0e6-73034471bb92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:50.487927 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0a0b6c5d-ae18-4095-a0e6-73034471bb92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:50.489758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:50.494993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a0b6c5d-ae18-4095-a0e6-73034471bb92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:50.495434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a0b6c5d-ae18-4095-a0e6-73034471bb92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:50.496188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a0b6c5d-ae18-4095-a0e6-73034471bb92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:50.496669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a0b6c5d-ae18-4095-a0e6-73034471bb92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:50.623386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0a0b6c5d-ae18-4095-a0e6-73034471bb92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:50.632399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0a0b6c5d-ae18-4095-a0e6-73034471bb92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1547 microversion: 2.1 time: 0.149449 Jul 27 22:52:50.632989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 266/548] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:50.651676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-05085619-e731-4ba0-84d0-3e72bb3a162c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:50.656457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-05085619-e731-4ba0-84d0-3e72bb3a162c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:50.657276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-05085619-e731-4ba0-84d0-3e72bb3a162c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Searching by: {'deleted': False, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6'} {{(pid=129294) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 27 22:52:50.664340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05085619-e731-4ba0-84d0-3e72bb3a162c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:50.664809 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05085619-e731-4ba0-84d0-3e72bb3a162c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:50.665602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05085619-e731-4ba0-84d0-3e72bb3a162c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:50.666037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05085619-e731-4ba0-84d0-3e72bb3a162c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:50.706522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e13bcf65-33d2-4d1f-aaf6-b8114d85228f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:50.707129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e13bcf65-33d2-4d1f-aaf6-b8114d85228f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:50.713244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e13bcf65-33d2-4d1f-aaf6-b8114d85228f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:50.713690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e13bcf65-33d2-4d1f-aaf6-b8114d85228f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:50.714450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e13bcf65-33d2-4d1f-aaf6-b8114d85228f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:50.714879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e13bcf65-33d2-4d1f-aaf6-b8114d85228f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:50.760316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.multi_cell_list [None req-05085619-e731-4ba0-84d0-3e72bb3a162c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129294) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 27 22:52:50.852049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e13bcf65-33d2-4d1f-aaf6-b8114d85228f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:50.861142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e13bcf65-33d2-4d1f-aaf6-b8114d85228f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.157787 Jul 27 22:52:50.862016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 267/549] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:50 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:52:50.865624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-05085619-e731-4ba0-84d0-3e72bb3a162c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.217616 Jul 27 22:52:50.866187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 283/550] 10.222.0.47 () {58 vars in 1125 bytes} [Wed Jul 27 22:52:50 2022] GET /compute/v2.1/servers => generated 343 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:52:50.877109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-61250f1e-a773-417c-8307-5f103e6db116 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:50.877745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-61250f1e-a773-417c-8307-5f103e6db116 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:50.883710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61250f1e-a773-417c-8307-5f103e6db116 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:50.884154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61250f1e-a773-417c-8307-5f103e6db116 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:50.884941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61250f1e-a773-417c-8307-5f103e6db116 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:50.885372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61250f1e-a773-417c-8307-5f103e6db116 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:50.968194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-465ca2c5-e6cc-48af-a74a-b444e60836e1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:50.968824 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-465ca2c5-e6cc-48af-a74a-b444e60836e1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:50.975651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-465ca2c5-e6cc-48af-a74a-b444e60836e1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:50.976085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-465ca2c5-e6cc-48af-a74a-b444e60836e1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:50.976876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-465ca2c5-e6cc-48af-a74a-b444e60836e1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:50.977374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-465ca2c5-e6cc-48af-a74a-b444e60836e1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:51.026607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-61250f1e-a773-417c-8307-5f103e6db116 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:51.034629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-61250f1e-a773-417c-8307-5f103e6db116 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1547 microversion: 2.1 time: 0.161325 Jul 27 22:52:51.035196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 268/551] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:52:51.120859 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-465ca2c5-e6cc-48af-a74a-b444e60836e1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:51.136713 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-465ca2c5-e6cc-48af-a74a-b444e60836e1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:51.140126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-465ca2c5-e6cc-48af-a74a-b444e60836e1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:51.143767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-465ca2c5-e6cc-48af-a74a-b444e60836e1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1794 microversion: 2.20 time: 0.179117 Jul 27 22:52:51.144744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 284/552] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 22:52:50 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1794 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 22:52:51.882812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-40f8a199-fefa-418a-b16a-e535065ce9a2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:51.883477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-40f8a199-fefa-418a-b16a-e535065ce9a2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:51.889577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-40f8a199-fefa-418a-b16a-e535065ce9a2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:51.890025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-40f8a199-fefa-418a-b16a-e535065ce9a2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:51.890783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-40f8a199-fefa-418a-b16a-e535065ce9a2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:51.891215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-40f8a199-fefa-418a-b16a-e535065ce9a2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:52.022605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-40f8a199-fefa-418a-b16a-e535065ce9a2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:52.029995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-40f8a199-fefa-418a-b16a-e535065ce9a2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.151069 Jul 27 22:52:52.030546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 269/553] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:51 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:52.627286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-90bd528a-ab0a-4d47-b8c7-ba44596a35f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "532a5824-f1bb-4b12-a1fc-36d6c5a8edbd"}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:52.629653 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-90bd528a-ab0a-4d47-b8c7-ba44596a35f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:52.636046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-90bd528a-ab0a-4d47-b8c7-ba44596a35f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:52.636491 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-90bd528a-ab0a-4d47-b8c7-ba44596a35f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:52.637293 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-90bd528a-ab0a-4d47-b8c7-ba44596a35f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:52.637709 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-90bd528a-ab0a-4d47-b8c7-ba44596a35f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:52.879422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-90bd528a-ab0a-4d47-b8c7-ba44596a35f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "POST /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256352 Jul 27 22:52:52.880227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 285/554] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 22:52:52 2022] POST /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:52:53.051367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d837293d-a3a8-4876-bede-30f62c0266bc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:53.051971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d837293d-a3a8-4876-bede-30f62c0266bc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:53.057994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d837293d-a3a8-4876-bede-30f62c0266bc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:53.058588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d837293d-a3a8-4876-bede-30f62c0266bc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:53.059580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d837293d-a3a8-4876-bede-30f62c0266bc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:53.060010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d837293d-a3a8-4876-bede-30f62c0266bc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:53.191390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d837293d-a3a8-4876-bede-30f62c0266bc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:53.199128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d837293d-a3a8-4876-bede-30f62c0266bc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.152117 Jul 27 22:52:53.199681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 270/555] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:53 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:54.221385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-da587682-b4b3-4d1e-8349-ab4f27e8f1c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:54.222048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-da587682-b4b3-4d1e-8349-ab4f27e8f1c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:54.229156 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-da587682-b4b3-4d1e-8349-ab4f27e8f1c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:54.229599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-da587682-b4b3-4d1e-8349-ab4f27e8f1c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:54.230354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-da587682-b4b3-4d1e-8349-ab4f27e8f1c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:54.230784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-da587682-b4b3-4d1e-8349-ab4f27e8f1c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:54.359263 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-da587682-b4b3-4d1e-8349-ab4f27e8f1c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:54.367288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-da587682-b4b3-4d1e-8349-ab4f27e8f1c0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.150804 Jul 27 22:52:54.367860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 286/556] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:54 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:55.387458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-72c6b291-c66f-453b-bbeb-53a0d5b41321 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:55.388063 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-72c6b291-c66f-453b-bbeb-53a0d5b41321 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:55.394175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72c6b291-c66f-453b-bbeb-53a0d5b41321 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:55.394617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72c6b291-c66f-453b-bbeb-53a0d5b41321 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:55.395378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72c6b291-c66f-453b-bbeb-53a0d5b41321 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:55.395812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72c6b291-c66f-453b-bbeb-53a0d5b41321 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:55.528356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-72c6b291-c66f-453b-bbeb-53a0d5b41321 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:55.536887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-72c6b291-c66f-453b-bbeb-53a0d5b41321 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.153150 Jul 27 22:52:55.538113 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 271/557] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:55 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:55.678150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1106089053", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2067908588", "security_groups": [{"name": "tempest-secgroup-smoke-90518965"}], "block_device_mapping_v2": [{"uuid": "876b6be0-69dc-415c-9431-d7f00e20cba9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "85a621aa-f187-4173-8873-af5857651409"}]}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:55.791553 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.network.neutron [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] validate_networks() for [('85a621aa-f187-4173-8873-af5857651409', None, None, None, None, None)] {{(pid=129294) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 22:52:56.156759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Flavor limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 22:52:56.157179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Image limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 22:52:56.157643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Flavor pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 22:52:56.158140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Image pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 22:52:56.158552 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 22:52:56.168376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:56.168848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:56.169856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:56.170288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:56.187651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Getting quotas for project 8df7953219954eeeb7279f310cdea955. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:52:56.192063 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Getting quotas for user fa0ac767fd754bdeb5307a1a234607e7 and project 8df7953219954eeeb7279f310cdea955. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:52:56.248133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Going to run 1 instances... {{(pid=129294) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 22:52:56.250246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='876b6be0-69dc-415c-9431-d7f00e20cba9',volume_size=None,volume_type=None)] {{(pid=129294) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 22:52:56.386376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f3e1ade7-9932-470f-8b22-a1925473c310 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.712577 Jul 27 22:52:56.387004 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 287/558] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 22:52:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 22:52:56.397744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0ebb5027-08da-4c4e-b059-478a95b83a2a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:56.398346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0ebb5027-08da-4c4e-b059-478a95b83a2a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:56.456499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0ebb5027-08da-4c4e-b059-478a95b83a2a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:56.463564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0ebb5027-08da-4c4e-b059-478a95b83a2a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1095 microversion: 2.1 time: 0.069802 Jul 27 22:52:56.464138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 272/559] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:56 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:56.558813 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f933a6fb-75d6-4d37-a997-cc5b8d65f197 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:56.559419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f933a6fb-75d6-4d37-a997-cc5b8d65f197 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:56.565787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f933a6fb-75d6-4d37-a997-cc5b8d65f197 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:56.566237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f933a6fb-75d6-4d37-a997-cc5b8d65f197 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:56.567035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f933a6fb-75d6-4d37-a997-cc5b8d65f197 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:56.567476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f933a6fb-75d6-4d37-a997-cc5b8d65f197 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:56.716591 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f933a6fb-75d6-4d37-a997-cc5b8d65f197 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:56.726451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f933a6fb-75d6-4d37-a997-cc5b8d65f197 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.171390 Jul 27 22:52:56.727124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 288/560] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:56 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:57.485238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9a6346b9-427f-4c3c-b93d-7c36f4c1cf46 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:57.485995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9a6346b9-427f-4c3c-b93d-7c36f4c1cf46 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:57.492791 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a6346b9-427f-4c3c-b93d-7c36f4c1cf46 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:57.493298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a6346b9-427f-4c3c-b93d-7c36f4c1cf46 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:57.494075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a6346b9-427f-4c3c-b93d-7c36f4c1cf46 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:57.494505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a6346b9-427f-4c3c-b93d-7c36f4c1cf46 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:57.563662 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9a6346b9-427f-4c3c-b93d-7c36f4c1cf46 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:57.571665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9a6346b9-427f-4c3c-b93d-7c36f4c1cf46 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1211 microversion: 2.1 time: 0.090441 Jul 27 22:52:57.572220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 273/561] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:57 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:57.747696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8a3fd149-2d40-4d93-bbb8-70c1ffedff97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:57.748309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8a3fd149-2d40-4d93-bbb8-70c1ffedff97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:57.754651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8a3fd149-2d40-4d93-bbb8-70c1ffedff97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:57.755089 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8a3fd149-2d40-4d93-bbb8-70c1ffedff97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:57.755833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8a3fd149-2d40-4d93-bbb8-70c1ffedff97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:57.756258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8a3fd149-2d40-4d93-bbb8-70c1ffedff97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:57.892618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8a3fd149-2d40-4d93-bbb8-70c1ffedff97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:57.901905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8a3fd149-2d40-4d93-bbb8-70c1ffedff97 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.158466 Jul 27 22:52:57.909236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 289/562] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:57 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:58.592444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8b18efd4-64f4-462e-a3ca-bc1b36a022a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:58.593353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8b18efd4-64f4-462e-a3ca-bc1b36a022a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:58.600347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b18efd4-64f4-462e-a3ca-bc1b36a022a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:58.608294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b18efd4-64f4-462e-a3ca-bc1b36a022a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:58.610807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b18efd4-64f4-462e-a3ca-bc1b36a022a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:58.613247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b18efd4-64f4-462e-a3ca-bc1b36a022a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:58.764926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-98c90511-5a35-440e-9184-5d71855dc965 req-86d724d7-ce40-4e3b-ae52-44a4084e8034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13f7184-9f3c-4be1-858c-c9bae2a28713", "tag": "a0592021-f797-414d-a1b0-64ae41a96423"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:52:58.781986 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8b18efd4-64f4-462e-a3ca-bc1b36a022a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:58.787372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-98c90511-5a35-440e-9184-5d71855dc965 req-86d724d7-ce40-4e3b-ae52-44a4084e8034 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:58.788088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-98c90511-5a35-440e-9184-5d71855dc965 req-86d724d7-ce40-4e3b-ae52-44a4084e8034 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:58.795039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8b18efd4-64f4-462e-a3ca-bc1b36a022a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1277 microversion: 2.1 time: 0.206380 Jul 27 22:52:58.795612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 274/563] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:58 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1277 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:58.810760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-98c90511-5a35-440e-9184-5d71855dc965 req-86d724d7-ce40-4e3b-ae52-44a4084e8034 service nova] Creating event network-changed:a0592021-f797-414d-a1b0-64ae41a96423 for instance d13f7184-9f3c-4be1-858c-c9bae2a28713 on hv-cinder-85124 Jul 27 22:52:58.818707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-98c90511-5a35-440e-9184-5d71855dc965 req-86d724d7-ce40-4e3b-ae52-44a4084e8034 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058268 Jul 27 22:52:58.819965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 290/564] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:52:58.923365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5d87ff83-1f83-4cf6-9021-d817e736813f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:58.924694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5d87ff83-1f83-4cf6-9021-d817e736813f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:58.930928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d87ff83-1f83-4cf6-9021-d817e736813f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:58.931376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d87ff83-1f83-4cf6-9021-d817e736813f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:58.932152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d87ff83-1f83-4cf6-9021-d817e736813f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:58.932654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d87ff83-1f83-4cf6-9021-d817e736813f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:59.073319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5d87ff83-1f83-4cf6-9021-d817e736813f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:59.081572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5d87ff83-1f83-4cf6-9021-d817e736813f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.162140 Jul 27 22:52:59.082703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 275/565] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:58 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:52:59.817124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-72774b20-7b74-47bd-bb58-9e7f6d7fd2b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:52:59.818487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-72774b20-7b74-47bd-bb58-9e7f6d7fd2b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:52:59.825003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72774b20-7b74-47bd-bb58-9e7f6d7fd2b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:59.825451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72774b20-7b74-47bd-bb58-9e7f6d7fd2b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:59.826206 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72774b20-7b74-47bd-bb58-9e7f6d7fd2b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:52:59.826634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72774b20-7b74-47bd-bb58-9e7f6d7fd2b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:52:59.962986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-72774b20-7b74-47bd-bb58-9e7f6d7fd2b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:52:59.970309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-72774b20-7b74-47bd-bb58-9e7f6d7fd2b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1277 microversion: 2.1 time: 0.157909 Jul 27 22:52:59.970863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 291/566] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:52:59 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:00.103314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0db83132-37fe-443a-b9a3-ccd20b3a3675 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:00.103922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0db83132-37fe-443a-b9a3-ccd20b3a3675 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:00.110146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0db83132-37fe-443a-b9a3-ccd20b3a3675 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:00.110584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0db83132-37fe-443a-b9a3-ccd20b3a3675 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:00.111351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0db83132-37fe-443a-b9a3-ccd20b3a3675 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:00.111788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0db83132-37fe-443a-b9a3-ccd20b3a3675 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:00.244758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0db83132-37fe-443a-b9a3-ccd20b3a3675 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:00.253614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0db83132-37fe-443a-b9a3-ccd20b3a3675 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.154391 Jul 27 22:53:00.254176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 276/567] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:00 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:53:00.477534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-05e0c7b8-176e-4f56-880d-44dcf7a5e8bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:00.478142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-05e0c7b8-176e-4f56-880d-44dcf7a5e8bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:00.484047 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05e0c7b8-176e-4f56-880d-44dcf7a5e8bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:00.484477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05e0c7b8-176e-4f56-880d-44dcf7a5e8bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:00.485250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05e0c7b8-176e-4f56-880d-44dcf7a5e8bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:00.485679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05e0c7b8-176e-4f56-880d-44dcf7a5e8bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:00.489708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:00.615809 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-05e0c7b8-176e-4f56-880d-44dcf7a5e8bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:00.623725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-05e0c7b8-176e-4f56-880d-44dcf7a5e8bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1593 microversion: 2.1 time: 0.150226 Jul 27 22:53:00.624273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 292/568] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:00 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1593 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:00.992517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-06f50920-e524-4869-8f87-527c5e85f0d0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:00.993145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-06f50920-e524-4869-8f87-527c5e85f0d0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:00.999126 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06f50920-e524-4869-8f87-527c5e85f0d0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:00.999574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06f50920-e524-4869-8f87-527c5e85f0d0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:01.000335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06f50920-e524-4869-8f87-527c5e85f0d0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:01.000800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06f50920-e524-4869-8f87-527c5e85f0d0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:01.131151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-06f50920-e524-4869-8f87-527c5e85f0d0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:01.144219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-06f50920-e524-4869-8f87-527c5e85f0d0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1265 microversion: 2.1 time: 0.155573 Jul 27 22:53:01.144999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 277/569] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:00 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:01.275002 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8c516958-7eed-4d65-a49d-145c26d6ebe6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:01.275620 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8c516958-7eed-4d65-a49d-145c26d6ebe6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:01.282149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c516958-7eed-4d65-a49d-145c26d6ebe6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:01.282592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c516958-7eed-4d65-a49d-145c26d6ebe6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:01.283339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c516958-7eed-4d65-a49d-145c26d6ebe6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:01.284461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c516958-7eed-4d65-a49d-145c26d6ebe6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:01.411047 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8c516958-7eed-4d65-a49d-145c26d6ebe6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:01.418605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8c516958-7eed-4d65-a49d-145c26d6ebe6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1677 microversion: 2.1 time: 0.147435 Jul 27 22:53:01.419171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 293/570] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:01 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:53:02.165319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d986faf5-72db-4810-9ef6-dd5ea84eab4f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:02.165858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d986faf5-72db-4810-9ef6-dd5ea84eab4f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:02.171950 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d986faf5-72db-4810-9ef6-dd5ea84eab4f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:02.172397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d986faf5-72db-4810-9ef6-dd5ea84eab4f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:02.173191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d986faf5-72db-4810-9ef6-dd5ea84eab4f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:02.173625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d986faf5-72db-4810-9ef6-dd5ea84eab4f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:02.307321 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d986faf5-72db-4810-9ef6-dd5ea84eab4f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:02.314781 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d986faf5-72db-4810-9ef6-dd5ea84eab4f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1265 microversion: 2.1 time: 0.153361 Jul 27 22:53:02.315541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 278/571] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:02 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:02.439331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d2d657f5-ebd9-41de-ba8f-9612d7d34d45 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:02.439957 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d2d657f5-ebd9-41de-ba8f-9612d7d34d45 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:02.446589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d2d657f5-ebd9-41de-ba8f-9612d7d34d45 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:02.447161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d2d657f5-ebd9-41de-ba8f-9612d7d34d45 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:02.448392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d2d657f5-ebd9-41de-ba8f-9612d7d34d45 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:02.449306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d2d657f5-ebd9-41de-ba8f-9612d7d34d45 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:02.510451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-db39f4d1-53d9-45bd-aeea-1767249bb5cb req-890de0d1-cd17-486a-bf32-ef2408025d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a6fc53-bd93-47c4-9413-39ba0e1b6068", "tag": "ea3daece-2ad0-4979-adb0-cba646786ccc"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:53:02.527814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-db39f4d1-53d9-45bd-aeea-1767249bb5cb req-890de0d1-cd17-486a-bf32-ef2408025d28 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:02.528667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-db39f4d1-53d9-45bd-aeea-1767249bb5cb req-890de0d1-cd17-486a-bf32-ef2408025d28 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:02.543825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-db39f4d1-53d9-45bd-aeea-1767249bb5cb req-890de0d1-cd17-486a-bf32-ef2408025d28 service nova] Creating event network-changed:ea3daece-2ad0-4979-adb0-cba646786ccc for instance 69a6fc53-bd93-47c4-9413-39ba0e1b6068 on hv-cinder-85124 Jul 27 22:53:02.550897 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-db39f4d1-53d9-45bd-aeea-1767249bb5cb req-890de0d1-cd17-486a-bf32-ef2408025d28 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044737 Jul 27 22:53:02.551509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 279/572] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:53:02.598063 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d2d657f5-ebd9-41de-ba8f-9612d7d34d45 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:02.608778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d2d657f5-ebd9-41de-ba8f-9612d7d34d45 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1654 microversion: 2.1 time: 0.172335 Jul 27 22:53:02.624591 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 294/573] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:02 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1654 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:02.638036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5a4484d6-1b8a-4afe-8911-cbdc4544c5e0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:53:02.648164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a4484d6-1b8a-4afe-8911-cbdc4544c5e0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:02.648896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a4484d6-1b8a-4afe-8911-cbdc4544c5e0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:02.676993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5a4484d6-1b8a-4afe-8911-cbdc4544c5e0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Going to try to start instance {{(pid=129295) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 27 22:53:02.726356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5a4484d6-1b8a-4afe-8911-cbdc4544c5e0 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "POST /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/action" status: 202 len: 0 microversion: 2.1 time: 0.095443 Jul 27 22:53:02.730907 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 280/574] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 22:53:02 2022] POST /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 22:53:02.738675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f9759d1a-1edc-434b-9d22-81a6e3cc095e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:02.739291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f9759d1a-1edc-434b-9d22-81a6e3cc095e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:02.754454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9759d1a-1edc-434b-9d22-81a6e3cc095e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:02.782337 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9759d1a-1edc-434b-9d22-81a6e3cc095e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:02.783266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9759d1a-1edc-434b-9d22-81a6e3cc095e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:02.784306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9759d1a-1edc-434b-9d22-81a6e3cc095e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:03.234929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f9759d1a-1edc-434b-9d22-81a6e3cc095e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:03.243108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f9759d1a-1edc-434b-9d22-81a6e3cc095e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1663 microversion: 2.1 time: 0.510493 Jul 27 22:53:03.243998 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 295/575] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:02 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1663 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:03.337525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-eb08c6cf-0dff-48b7-8d09-f4fb276521e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:03.338880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-eb08c6cf-0dff-48b7-8d09-f4fb276521e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:03.345606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb08c6cf-0dff-48b7-8d09-f4fb276521e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:03.346345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb08c6cf-0dff-48b7-8d09-f4fb276521e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:03.347185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb08c6cf-0dff-48b7-8d09-f4fb276521e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:03.347727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb08c6cf-0dff-48b7-8d09-f4fb276521e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:03.501299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eb08c6cf-0dff-48b7-8d09-f4fb276521e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:03.510441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-eb08c6cf-0dff-48b7-8d09-f4fb276521e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1265 microversion: 2.1 time: 0.177873 Jul 27 22:53:03.526843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 281/576] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:03 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:04.090617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-51ecb5fb-2c67-4b4d-812e-2e839acea029 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "128d5bc5-a8f4-4e84-afd1-2109d321af1e", "device": "/dev/sdb"}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:53:04.093561 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-51ecb5fb-2c67-4b4d-812e-2e839acea029 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:04.100422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51ecb5fb-2c67-4b4d-812e-2e839acea029 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:04.100962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51ecb5fb-2c67-4b4d-812e-2e839acea029 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:04.101653 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51ecb5fb-2c67-4b4d-812e-2e839acea029 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:04.102083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51ecb5fb-2c67-4b4d-812e-2e839acea029 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:04.143442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-be679782-2def-45c0-928d-4eb6c63cf8d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-917796438"}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:53:04.143573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-be679782-2def-45c0-928d-4eb6c63cf8d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:04.149622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be679782-2def-45c0-928d-4eb6c63cf8d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:04.150070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be679782-2def-45c0-928d-4eb6c63cf8d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:04.150890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be679782-2def-45c0-928d-4eb6c63cf8d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:04.151323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be679782-2def-45c0-928d-4eb6c63cf8d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:04.155321 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:04.291951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.network.security_group_api [None req-be679782-2def-45c0-928d-4eb6c63cf8d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Adding security group 4d4f050d-f3b1-476a-b617-0127b6d9078e to port ea3daece-2ad0-4979-adb0-cba646786ccc Jul 27 22:53:04.702898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-be679782-2def-45c0-928d-4eb6c63cf8d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "POST /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/action" status: 202 len: 0 microversion: 2.1 time: 0.563859 Jul 27 22:53:04.703500 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 282/577] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 22:53:04 2022] POST /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 22:53:04.708090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-74162fb6-c723-4a3d-a6ab-613901c6be0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:04.708733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-74162fb6-c723-4a3d-a6ab-613901c6be0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:04.715807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-74162fb6-c723-4a3d-a6ab-613901c6be0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:04.716567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-74162fb6-c723-4a3d-a6ab-613901c6be0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:04.717621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-74162fb6-c723-4a3d-a6ab-613901c6be0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:04.718343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-74162fb6-c723-4a3d-a6ab-613901c6be0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:04.872711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-74162fb6-c723-4a3d-a6ab-613901c6be0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:04.880676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-74162fb6-c723-4a3d-a6ab-613901c6be0a tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1663 microversion: 2.1 time: 0.176080 Jul 27 22:53:04.881256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 283/578] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:04 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:04.885937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a16a9f0a-9d89-4197-8789-8bc22f32c1ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:04.886848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a16a9f0a-9d89-4197-8789-8bc22f32c1ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:04.897817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a16a9f0a-9d89-4197-8789-8bc22f32c1ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:04.898554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a16a9f0a-9d89-4197-8789-8bc22f32c1ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:04.899530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a16a9f0a-9d89-4197-8789-8bc22f32c1ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:04.899966 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a16a9f0a-9d89-4197-8789-8bc22f32c1ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:05.053258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a16a9f0a-9d89-4197-8789-8bc22f32c1ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:05.060961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a16a9f0a-9d89-4197-8789-8bc22f32c1ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1265 microversion: 2.1 time: 0.178511 Jul 27 22:53:05.074938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 284/579] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:04 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:05.080269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-715291f8-9ac6-4cd6-92eb-3f02198e042e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:05.081491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-715291f8-9ac6-4cd6-92eb-3f02198e042e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:05.088296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-715291f8-9ac6-4cd6-92eb-3f02198e042e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:05.088967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-715291f8-9ac6-4cd6-92eb-3f02198e042e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:05.089748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-715291f8-9ac6-4cd6-92eb-3f02198e042e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:05.090184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-715291f8-9ac6-4cd6-92eb-3f02198e042e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:05.112488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-51ecb5fb-2c67-4b4d-812e-2e839acea029 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "POST /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.025134 Jul 27 22:53:05.113194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 296/580] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 22:53:04 2022] POST /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments => generated 194 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:53:05.118969 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-38d4857f-a9da-49b6-969c-7df273591891 req-4ac04d66-e71e-40c3-a6ef-3f11e8d63c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a6fc53-bd93-47c4-9413-39ba0e1b6068", "tag": "ea3daece-2ad0-4979-adb0-cba646786ccc"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:53:05.133928 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-38d4857f-a9da-49b6-969c-7df273591891 req-4ac04d66-e71e-40c3-a6ef-3f11e8d63c50 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:05.134727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-38d4857f-a9da-49b6-969c-7df273591891 req-4ac04d66-e71e-40c3-a6ef-3f11e8d63c50 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:05.161313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-38d4857f-a9da-49b6-969c-7df273591891 req-4ac04d66-e71e-40c3-a6ef-3f11e8d63c50 service nova] Creating event network-changed:ea3daece-2ad0-4979-adb0-cba646786ccc for instance 69a6fc53-bd93-47c4-9413-39ba0e1b6068 on hv-cinder-85124 Jul 27 22:53:05.170514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-38d4857f-a9da-49b6-969c-7df273591891 req-4ac04d66-e71e-40c3-a6ef-3f11e8d63c50 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055230 Jul 27 22:53:05.171115 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 297/581] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:53:05.286360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-715291f8-9ac6-4cd6-92eb-3f02198e042e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:05.294571 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-715291f8-9ac6-4cd6-92eb-3f02198e042e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1757 microversion: 2.1 time: 0.218396 Jul 27 22:53:05.295129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 285/582] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:05 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1757 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:05.902381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-097de084-8509-43b9-a3b1-4a44dc28f83e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:05.903068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-097de084-8509-43b9-a3b1-4a44dc28f83e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:05.909987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-097de084-8509-43b9-a3b1-4a44dc28f83e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:05.910365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-097de084-8509-43b9-a3b1-4a44dc28f83e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:05.911150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-097de084-8509-43b9-a3b1-4a44dc28f83e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:05.911572 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-097de084-8509-43b9-a3b1-4a44dc28f83e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:06.040413 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-097de084-8509-43b9-a3b1-4a44dc28f83e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:06.047750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-097de084-8509-43b9-a3b1-4a44dc28f83e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1667 microversion: 2.1 time: 0.149413 Jul 27 22:53:06.048235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 298/583] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:05 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:06.082809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ff49ff81-a378-46e9-b56c-efe24f539165 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:06.083422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ff49ff81-a378-46e9-b56c-efe24f539165 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:06.089505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff49ff81-a378-46e9-b56c-efe24f539165 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:06.089955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff49ff81-a378-46e9-b56c-efe24f539165 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:06.090711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff49ff81-a378-46e9-b56c-efe24f539165 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:06.091146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff49ff81-a378-46e9-b56c-efe24f539165 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:06.219143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ff49ff81-a378-46e9-b56c-efe24f539165 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:06.228020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ff49ff81-a378-46e9-b56c-efe24f539165 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1265 microversion: 2.1 time: 0.149551 Jul 27 22:53:06.228625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 286/584] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:06 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:07.250317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-636953cd-17ee-4351-9d99-eca301605d01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:07.250916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-636953cd-17ee-4351-9d99-eca301605d01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:07.253317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=4 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:07.253958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=6 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:07.260049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-636953cd-17ee-4351-9d99-eca301605d01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:07.260487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-636953cd-17ee-4351-9d99-eca301605d01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:07.261257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-636953cd-17ee-4351-9d99-eca301605d01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:07.261682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-636953cd-17ee-4351-9d99-eca301605d01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:07.395712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-636953cd-17ee-4351-9d99-eca301605d01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:07.403078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-636953cd-17ee-4351-9d99-eca301605d01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1265 microversion: 2.1 time: 0.156600 Jul 27 22:53:07.403627 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 299/585] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:07 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:08.423277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-87064d48-5e3a-4a9e-8090-d6f852e0dcf6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:08.423886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-87064d48-5e3a-4a9e-8090-d6f852e0dcf6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:08.426399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:08.431860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87064d48-5e3a-4a9e-8090-d6f852e0dcf6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:08.432337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87064d48-5e3a-4a9e-8090-d6f852e0dcf6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:08.433172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87064d48-5e3a-4a9e-8090-d6f852e0dcf6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:08.433613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87064d48-5e3a-4a9e-8090-d6f852e0dcf6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:08.565583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-87064d48-5e3a-4a9e-8090-d6f852e0dcf6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:08.574826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-87064d48-5e3a-4a9e-8090-d6f852e0dcf6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1265 microversion: 2.1 time: 0.155245 Jul 27 22:53:08.575403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 287/586] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:08 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:09.184892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cb7c510c-dbb4-4617-9bd5-7e33b3a0b917 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26fffc9a-7bf7-4c29-be39-0c196ef21f92"}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:53:09.187281 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cb7c510c-dbb4-4617-9bd5-7e33b3a0b917 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:09.194266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb7c510c-dbb4-4617-9bd5-7e33b3a0b917 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:09.194701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb7c510c-dbb4-4617-9bd5-7e33b3a0b917 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:09.195454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb7c510c-dbb4-4617-9bd5-7e33b3a0b917 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:09.195874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb7c510c-dbb4-4617-9bd5-7e33b3a0b917 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:09.595633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a7c43f4d-f9a3-4c98-9b87-8a2d0762c98b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:09.596783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a7c43f4d-f9a3-4c98-9b87-8a2d0762c98b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:09.603360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a7c43f4d-f9a3-4c98-9b87-8a2d0762c98b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:09.603813 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a7c43f4d-f9a3-4c98-9b87-8a2d0762c98b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:09.604672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a7c43f4d-f9a3-4c98-9b87-8a2d0762c98b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:09.605108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a7c43f4d-f9a3-4c98-9b87-8a2d0762c98b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:09.608152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cb7c510c-dbb4-4617-9bd5-7e33b3a0b917 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "POST /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.427122 Jul 27 22:53:09.610080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 300/587] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Jul 27 22:53:09 2022] POST /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:53:09.754308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a7c43f4d-f9a3-4c98-9b87-8a2d0762c98b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:09.761731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a7c43f4d-f9a3-4c98-9b87-8a2d0762c98b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1265 microversion: 2.1 time: 0.170444 Jul 27 22:53:09.762304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 288/588] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:09 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:53:10.745467 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-784272ea-18d8-4736-94b1-74c7c1edbdc1 req-e0170b38-ef50-4d88-a60b-30242c2a9504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13f7184-9f3c-4be1-858c-c9bae2a28713", "name": "network-vif-plugged", "status": "completed", "tag": "a0592021-f797-414d-a1b0-64ae41a96423"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:53:10.757240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-784272ea-18d8-4736-94b1-74c7c1edbdc1 req-e0170b38-ef50-4d88-a60b-30242c2a9504 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:10.757760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-784272ea-18d8-4736-94b1-74c7c1edbdc1 req-e0170b38-ef50-4d88-a60b-30242c2a9504 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:10.769217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-784272ea-18d8-4736-94b1-74c7c1edbdc1 req-e0170b38-ef50-4d88-a60b-30242c2a9504 service nova] Creating event network-vif-plugged:a0592021-f797-414d-a1b0-64ae41a96423 for instance d13f7184-9f3c-4be1-858c-c9bae2a28713 on hv-cinder-85124 Jul 27 22:53:10.773959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-784272ea-18d8-4736-94b1-74c7c1edbdc1 req-e0170b38-ef50-4d88-a60b-30242c2a9504 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032464 Jul 27 22:53:10.774620 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 301/589] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:53:10.782267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-08083e43-c77e-4230-9dac-aaf1a7d36d2f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:10.782877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-08083e43-c77e-4230-9dac-aaf1a7d36d2f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:10.789152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08083e43-c77e-4230-9dac-aaf1a7d36d2f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:10.789588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08083e43-c77e-4230-9dac-aaf1a7d36d2f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:10.790623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08083e43-c77e-4230-9dac-aaf1a7d36d2f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:10.791232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08083e43-c77e-4230-9dac-aaf1a7d36d2f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:10.928042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-08083e43-c77e-4230-9dac-aaf1a7d36d2f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:10.937130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-08083e43-c77e-4230-9dac-aaf1a7d36d2f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1265 microversion: 2.1 time: 0.158211 Jul 27 22:53:10.937709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 289/590] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:10 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:11.961797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-88cf6fef-8408-4be6-b369-6e02185cb9cc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:11.962488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-88cf6fef-8408-4be6-b369-6e02185cb9cc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:11.964856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:11.970338 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88cf6fef-8408-4be6-b369-6e02185cb9cc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:11.970774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88cf6fef-8408-4be6-b369-6e02185cb9cc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:11.972031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88cf6fef-8408-4be6-b369-6e02185cb9cc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:11.972463 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88cf6fef-8408-4be6-b369-6e02185cb9cc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:12.107106 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-88cf6fef-8408-4be6-b369-6e02185cb9cc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:12.114510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-88cf6fef-8408-4be6-b369-6e02185cb9cc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1265 microversion: 2.1 time: 0.156883 Jul 27 22:53:12.115066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 302/591] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:11 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:13.135608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-35b7a325-f09c-4920-830c-b0f529da18cf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:13.136135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-35b7a325-f09c-4920-830c-b0f529da18cf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:13.142173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35b7a325-f09c-4920-830c-b0f529da18cf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:13.142616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35b7a325-f09c-4920-830c-b0f529da18cf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:13.143931 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35b7a325-f09c-4920-830c-b0f529da18cf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:13.144360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35b7a325-f09c-4920-830c-b0f529da18cf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:13.273844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-35b7a325-f09c-4920-830c-b0f529da18cf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:13.281187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-35b7a325-f09c-4920-830c-b0f529da18cf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1452 microversion: 2.1 time: 0.149510 Jul 27 22:53:13.281735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 290/592] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:13 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:13.301490 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3b8fffa7-c9b1-4c48-891c-11a2b0e1e2ec tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:13.302099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3b8fffa7-c9b1-4c48-891c-11a2b0e1e2ec tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:13.308445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b8fffa7-c9b1-4c48-891c-11a2b0e1e2ec tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:13.308920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b8fffa7-c9b1-4c48-891c-11a2b0e1e2ec tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:13.309670 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b8fffa7-c9b1-4c48-891c-11a2b0e1e2ec tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:13.310101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b8fffa7-c9b1-4c48-891c-11a2b0e1e2ec tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:13.449484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3b8fffa7-c9b1-4c48-891c-11a2b0e1e2ec tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:13.457522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3b8fffa7-c9b1-4c48-891c-11a2b0e1e2ec tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1452 microversion: 2.1 time: 0.159792 Jul 27 22:53:13.458080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 303/593] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:13 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:53:15.125131 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-c9e03913-5656-4ba9-99a6-0feb11876b82 req-1a828709-83ac-48b5-b310-c9bb2e949e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13f7184-9f3c-4be1-858c-c9bae2a28713", "tag": "a0592021-f797-414d-a1b0-64ae41a96423"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:53:15.135129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-c9e03913-5656-4ba9-99a6-0feb11876b82 req-1a828709-83ac-48b5-b310-c9bb2e949e67 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:15.136052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-c9e03913-5656-4ba9-99a6-0feb11876b82 req-1a828709-83ac-48b5-b310-c9bb2e949e67 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:15.148286 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-c9e03913-5656-4ba9-99a6-0feb11876b82 req-1a828709-83ac-48b5-b310-c9bb2e949e67 service nova] Creating event network-changed:a0592021-f797-414d-a1b0-64ae41a96423 for instance d13f7184-9f3c-4be1-858c-c9bae2a28713 on hv-cinder-85124 Jul 27 22:53:15.153644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-c9e03913-5656-4ba9-99a6-0feb11876b82 req-1a828709-83ac-48b5-b310-c9bb2e949e67 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032159 Jul 27 22:53:15.154499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 291/594] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:53:42.273252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-64a426f3-83b1-4bff-91d9-d709ac058c62 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:42.273824 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-64a426f3-83b1-4bff-91d9-d709ac058c62 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:42.276246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=3 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:42.276905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:42.282871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-64a426f3-83b1-4bff-91d9-d709ac058c62 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:42.283320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-64a426f3-83b1-4bff-91d9-d709ac058c62 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:42.284068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-64a426f3-83b1-4bff-91d9-d709ac058c62 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:42.284498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-64a426f3-83b1-4bff-91d9-d709ac058c62 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:42.315130 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-64a426f3-83b1-4bff-91d9-d709ac058c62 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments/b8d4527a-c1f8-4fc3-a5d7-4d4b6e7d043c" status: 200 len: 194 microversion: 2.20 time: 0.045882 Jul 27 22:53:42.316281 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 304/595] 10.222.0.47 () {60 vars in 1454 bytes} [Wed Jul 27 22:53:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments/b8d4527a-c1f8-4fc3-a5d7-4d4b6e7d043c => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:42.381868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-75402c11-1171-4a2d-bc0d-dda2acd2458a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:42.382435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-75402c11-1171-4a2d-bc0d-dda2acd2458a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:42.384578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=53 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:42.385198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=52 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:42.391293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75402c11-1171-4a2d-bc0d-dda2acd2458a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:42.391728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75402c11-1171-4a2d-bc0d-dda2acd2458a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:42.392481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75402c11-1171-4a2d-bc0d-dda2acd2458a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:42.392933 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75402c11-1171-4a2d-bc0d-dda2acd2458a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:42.475744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.objects.instance [None req-75402c11-1171-4a2d-bc0d-dda2acd2458a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lazy-loading 'services' on Instance uuid e457f5fc-ae83-4b88-87be-ba1007c5865e {{(pid=129295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:53:42.547846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-75402c11-1171-4a2d-bc0d-dda2acd2458a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments/b8d4527a-c1f8-4fc3-a5d7-4d4b6e7d043c" status: 202 len: 0 microversion: 2.20 time: 0.170697 Jul 27 22:53:42.548414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 292/596] 10.222.0.47 () {60 vars in 1457 bytes} [Wed Jul 27 22:53:42 2022] DELETE /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments/b8d4527a-c1f8-4fc3-a5d7-4d4b6e7d043c => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 22:53:42.557294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-06eddba6-4438-4f23-a467-932a4042ad65 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:42.559416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-06eddba6-4438-4f23-a467-932a4042ad65 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:42.565485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06eddba6-4438-4f23-a467-932a4042ad65 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:42.566044 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06eddba6-4438-4f23-a467-932a4042ad65 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:42.566801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06eddba6-4438-4f23-a467-932a4042ad65 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:42.567235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06eddba6-4438-4f23-a467-932a4042ad65 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:42.595023 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-06eddba6-4438-4f23-a467-932a4042ad65 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041683 Jul 27 22:53:42.595564 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 305/597] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:43.607752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8d990296-17d5-4e50-9ee6-8b0fa076e84a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:43.610010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8d990296-17d5-4e50-9ee6-8b0fa076e84a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:43.616845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8d990296-17d5-4e50-9ee6-8b0fa076e84a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:43.617295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8d990296-17d5-4e50-9ee6-8b0fa076e84a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:43.618045 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8d990296-17d5-4e50-9ee6-8b0fa076e84a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:43.618473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8d990296-17d5-4e50-9ee6-8b0fa076e84a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:43.646249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8d990296-17d5-4e50-9ee6-8b0fa076e84a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042864 Jul 27 22:53:43.646774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 293/598] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:44.658202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d9f45ee9-2429-48f6-ae54-c95f7f4e9a42 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:44.660357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d9f45ee9-2429-48f6-ae54-c95f7f4e9a42 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:44.666728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9f45ee9-2429-48f6-ae54-c95f7f4e9a42 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:44.667172 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9f45ee9-2429-48f6-ae54-c95f7f4e9a42 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:44.667922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9f45ee9-2429-48f6-ae54-c95f7f4e9a42 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:44.668354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9f45ee9-2429-48f6-ae54-c95f7f4e9a42 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:44.697022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d9f45ee9-2429-48f6-ae54-c95f7f4e9a42 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042724 Jul 27 22:53:44.697554 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 306/599] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:44 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:45.709810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-760f26d1-d456-4485-bff1-d144cb28d916 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:45.712018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-760f26d1-d456-4485-bff1-d144cb28d916 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:45.717956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-760f26d1-d456-4485-bff1-d144cb28d916 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:45.718401 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-760f26d1-d456-4485-bff1-d144cb28d916 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:45.719155 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-760f26d1-d456-4485-bff1-d144cb28d916 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:45.719586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-760f26d1-d456-4485-bff1-d144cb28d916 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:45.748765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-760f26d1-d456-4485-bff1-d144cb28d916 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043513 Jul 27 22:53:45.749319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 294/600] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:45 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:46.761416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ef40ad4f-c4a1-49c4-98e3-b944c66670ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:46.763495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ef40ad4f-c4a1-49c4-98e3-b944c66670ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:46.770303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ef40ad4f-c4a1-49c4-98e3-b944c66670ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:46.770740 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ef40ad4f-c4a1-49c4-98e3-b944c66670ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:46.771484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ef40ad4f-c4a1-49c4-98e3-b944c66670ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:46.771909 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ef40ad4f-c4a1-49c4-98e3-b944c66670ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:46.800333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ef40ad4f-c4a1-49c4-98e3-b944c66670ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042794 Jul 27 22:53:46.800970 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 307/601] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:47.813105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8056c39a-d88e-44f6-903a-95fdf5cd2b8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:47.815577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8056c39a-d88e-44f6-903a-95fdf5cd2b8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:47.821863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8056c39a-d88e-44f6-903a-95fdf5cd2b8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:47.822300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8056c39a-d88e-44f6-903a-95fdf5cd2b8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:47.823051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8056c39a-d88e-44f6-903a-95fdf5cd2b8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:47.823478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8056c39a-d88e-44f6-903a-95fdf5cd2b8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:47.853440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8056c39a-d88e-44f6-903a-95fdf5cd2b8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044655 Jul 27 22:53:47.853987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 295/602] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:48.176401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-89f88d37-4039-4980-9dbc-80bfde760a3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:53:48.178608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-89f88d37-4039-4980-9dbc-80bfde760a3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:48.185094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89f88d37-4039-4980-9dbc-80bfde760a3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:48.185535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89f88d37-4039-4980-9dbc-80bfde760a3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:48.186282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89f88d37-4039-4980-9dbc-80bfde760a3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:48.186711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89f88d37-4039-4980-9dbc-80bfde760a3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:48.254902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-89f88d37-4039-4980-9dbc-80bfde760a3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "POST /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/action" status: 202 len: 0 microversion: 2.1 time: 0.082208 Jul 27 22:53:48.255692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 308/603] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 22:53:48 2022] POST /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 22:53:48.263540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-33bf16ae-06d3-4431-a277-e4d5c7c5c666 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:48.264150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-33bf16ae-06d3-4431-a277-e4d5c7c5c666 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:48.270996 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33bf16ae-06d3-4431-a277-e4d5c7c5c666 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:48.271447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33bf16ae-06d3-4431-a277-e4d5c7c5c666 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:48.272212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33bf16ae-06d3-4431-a277-e4d5c7c5c666 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:48.272680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33bf16ae-06d3-4431-a277-e4d5c7c5c666 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:48.413071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-33bf16ae-06d3-4431-a277-e4d5c7c5c666 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:48.420885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-33bf16ae-06d3-4431-a277-e4d5c7c5c666 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.161181 Jul 27 22:53:48.421445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 296/604] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:48 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:48.866802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f408b808-752d-4356-87c3-5689a6690f47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:48.869018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f408b808-752d-4356-87c3-5689a6690f47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:48.875107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f408b808-752d-4356-87c3-5689a6690f47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:48.875541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f408b808-752d-4356-87c3-5689a6690f47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:48.876284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f408b808-752d-4356-87c3-5689a6690f47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:48.876748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f408b808-752d-4356-87c3-5689a6690f47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:48.905191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f408b808-752d-4356-87c3-5689a6690f47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043355 Jul 27 22:53:48.905722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 309/605] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:48 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:49.442238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5abd932a-3a38-4c33-b40f-a53248915b1e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:49.442795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5abd932a-3a38-4c33-b40f-a53248915b1e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:49.449369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5abd932a-3a38-4c33-b40f-a53248915b1e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:49.449883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5abd932a-3a38-4c33-b40f-a53248915b1e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:49.450964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5abd932a-3a38-4c33-b40f-a53248915b1e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:49.451400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5abd932a-3a38-4c33-b40f-a53248915b1e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:49.593624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5abd932a-3a38-4c33-b40f-a53248915b1e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:49.602202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5abd932a-3a38-4c33-b40f-a53248915b1e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.163919 Jul 27 22:53:49.602751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 297/606] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:49 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:49.918208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3a7c9ac5-ba33-4a76-b3dd-a9be1f03e56a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:49.920402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3a7c9ac5-ba33-4a76-b3dd-a9be1f03e56a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:49.926799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3a7c9ac5-ba33-4a76-b3dd-a9be1f03e56a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:49.927240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3a7c9ac5-ba33-4a76-b3dd-a9be1f03e56a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:49.927996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3a7c9ac5-ba33-4a76-b3dd-a9be1f03e56a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:49.928428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3a7c9ac5-ba33-4a76-b3dd-a9be1f03e56a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:49.955898 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3a7c9ac5-ba33-4a76-b3dd-a9be1f03e56a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042526 Jul 27 22:53:49.956438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 310/607] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:49 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:50.623981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-29d93b07-9aa1-4a66-85ef-ab6eecfae2bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:50.624597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-29d93b07-9aa1-4a66-85ef-ab6eecfae2bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:50.631134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29d93b07-9aa1-4a66-85ef-ab6eecfae2bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:50.631575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29d93b07-9aa1-4a66-85ef-ab6eecfae2bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:50.632318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29d93b07-9aa1-4a66-85ef-ab6eecfae2bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:50.632768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29d93b07-9aa1-4a66-85ef-ab6eecfae2bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:50.769774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-29d93b07-9aa1-4a66-85ef-ab6eecfae2bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:50.777847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-29d93b07-9aa1-4a66-85ef-ab6eecfae2bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.157690 Jul 27 22:53:50.778412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 298/608] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:50.968391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f73f0a1d-210e-4646-9359-7b7d1415e819 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:50.970521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f73f0a1d-210e-4646-9359-7b7d1415e819 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:50.977157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f73f0a1d-210e-4646-9359-7b7d1415e819 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:50.977600 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f73f0a1d-210e-4646-9359-7b7d1415e819 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:50.978379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f73f0a1d-210e-4646-9359-7b7d1415e819 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:50.978810 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f73f0a1d-210e-4646-9359-7b7d1415e819 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:51.008357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f73f0a1d-210e-4646-9359-7b7d1415e819 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043833 Jul 27 22:53:51.008929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 311/609] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:50 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:51.799472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-eb70d3b1-b1a9-4de6-bbce-bebe18e1ae48 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:51.800086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-eb70d3b1-b1a9-4de6-bbce-bebe18e1ae48 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:51.806646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb70d3b1-b1a9-4de6-bbce-bebe18e1ae48 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:51.807085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb70d3b1-b1a9-4de6-bbce-bebe18e1ae48 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:51.807842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb70d3b1-b1a9-4de6-bbce-bebe18e1ae48 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:51.808272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb70d3b1-b1a9-4de6-bbce-bebe18e1ae48 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:51.949526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eb70d3b1-b1a9-4de6-bbce-bebe18e1ae48 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:51.957938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-eb70d3b1-b1a9-4de6-bbce-bebe18e1ae48 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.162290 Jul 27 22:53:51.958583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 299/610] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:51 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:52.021254 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8b34a83f-ecc6-4f62-aff8-94ebe3c2e9eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:52.023374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8b34a83f-ecc6-4f62-aff8-94ebe3c2e9eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:52.029762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8b34a83f-ecc6-4f62-aff8-94ebe3c2e9eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:52.030208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8b34a83f-ecc6-4f62-aff8-94ebe3c2e9eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:52.030964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8b34a83f-ecc6-4f62-aff8-94ebe3c2e9eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:52.031396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8b34a83f-ecc6-4f62-aff8-94ebe3c2e9eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:52.059785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8b34a83f-ecc6-4f62-aff8-94ebe3c2e9eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042956 Jul 27 22:53:52.060262 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 312/611] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:52 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:52.979111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ee4d7d66-479c-4b3b-b43b-e23d1a7efde3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:52.979756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ee4d7d66-479c-4b3b-b43b-e23d1a7efde3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:52.986717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ee4d7d66-479c-4b3b-b43b-e23d1a7efde3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:52.987103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ee4d7d66-479c-4b3b-b43b-e23d1a7efde3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:52.987865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ee4d7d66-479c-4b3b-b43b-e23d1a7efde3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:52.988901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ee4d7d66-479c-4b3b-b43b-e23d1a7efde3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:53.073915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dbcdffda-7261-4594-88b4-0cf4264dd759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:53.076278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dbcdffda-7261-4594-88b4-0cf4264dd759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:53.083810 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dbcdffda-7261-4594-88b4-0cf4264dd759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:53.084283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dbcdffda-7261-4594-88b4-0cf4264dd759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:53.085087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dbcdffda-7261-4594-88b4-0cf4264dd759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:53.085512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dbcdffda-7261-4594-88b4-0cf4264dd759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:53.119294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dbcdffda-7261-4594-88b4-0cf4264dd759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051820 Jul 27 22:53:53.120210 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 313/612] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:53 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:53:53.134170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ee4d7d66-479c-4b3b-b43b-e23d1a7efde3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:53.142143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ee4d7d66-479c-4b3b-b43b-e23d1a7efde3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.167096 Jul 27 22:53:53.142694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 300/613] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:52 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:53.793531 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b339af41-768d-44b6-ac35-dc46c49f10db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:53.795719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b339af41-768d-44b6-ac35-dc46c49f10db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:53.801857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b339af41-768d-44b6-ac35-dc46c49f10db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:53.802299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b339af41-768d-44b6-ac35-dc46c49f10db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:53.803063 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b339af41-768d-44b6-ac35-dc46c49f10db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:53.803495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b339af41-768d-44b6-ac35-dc46c49f10db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:53.832747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b339af41-768d-44b6-ac35-dc46c49f10db tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042345 Jul 27 22:53:53.833402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 314/614] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:53:53 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 22:53:53.897971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a0357f72-43f8-4a0c-b492-423e795c2c28 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:53.898465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a0357f72-43f8-4a0c-b492-423e795c2c28 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:53.904820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0357f72-43f8-4a0c-b492-423e795c2c28 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:53.905280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0357f72-43f8-4a0c-b492-423e795c2c28 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:53.906080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0357f72-43f8-4a0c-b492-423e795c2c28 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:53.906516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0357f72-43f8-4a0c-b492-423e795c2c28 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:53.931780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a0357f72-43f8-4a0c-b492-423e795c2c28 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Going to try to terminate instance {{(pid=129295) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 22:53:54.003379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a0357f72-43f8-4a0c-b492-423e795c2c28 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 204 len: 0 microversion: 2.1 time: 0.109554 Jul 27 22:53:54.004614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 301/615] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 22:53:53 2022] DELETE /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 22:53:54.012680 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fcf38149-3a1d-4b30-bb5f-47198c8843fb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:54.013289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fcf38149-3a1d-4b30-bb5f-47198c8843fb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:54.019795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fcf38149-3a1d-4b30-bb5f-47198c8843fb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:54.020247 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fcf38149-3a1d-4b30-bb5f-47198c8843fb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:54.021036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fcf38149-3a1d-4b30-bb5f-47198c8843fb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:54.021468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fcf38149-3a1d-4b30-bb5f-47198c8843fb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:54.134124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a8d55124-9b46-4802-ae45-6041c8f8b624 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:54.137614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a8d55124-9b46-4802-ae45-6041c8f8b624 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:54.143396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a8d55124-9b46-4802-ae45-6041c8f8b624 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:54.143848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a8d55124-9b46-4802-ae45-6041c8f8b624 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:54.144758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a8d55124-9b46-4802-ae45-6041c8f8b624 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:54.145196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a8d55124-9b46-4802-ae45-6041c8f8b624 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:54.152769 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fcf38149-3a1d-4b30-bb5f-47198c8843fb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:54.159636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fcf38149-3a1d-4b30-bb5f-47198c8843fb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.150777 Jul 27 22:53:54.160206 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 315/616] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:54 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:54.168794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8047babe-97b5-4997-800f-ade5c63b79c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:54.168794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8047babe-97b5-4997-800f-ade5c63b79c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:54.171136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8047babe-97b5-4997-800f-ade5c63b79c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:54.171590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8047babe-97b5-4997-800f-ade5c63b79c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:54.172344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8047babe-97b5-4997-800f-ade5c63b79c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:54.172854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8047babe-97b5-4997-800f-ade5c63b79c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:54.175287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a8d55124-9b46-4802-ae45-6041c8f8b624 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047466 Jul 27 22:53:54.176483 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 302/617] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:54 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:54.317547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8047babe-97b5-4997-800f-ade5c63b79c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:54.325331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8047babe-97b5-4997-800f-ade5c63b79c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.164111 Jul 27 22:53:54.325880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 316/618] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:54 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:55.181101 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3e332b19-c21b-4839-96e5-bc1fd8faa8bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:55.181798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3e332b19-c21b-4839-96e5-bc1fd8faa8bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:55.187143 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fc198fb3-960e-4aee-bf66-698a34dee17f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:55.188000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e332b19-c21b-4839-96e5-bc1fd8faa8bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:55.188448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e332b19-c21b-4839-96e5-bc1fd8faa8bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:55.189241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e332b19-c21b-4839-96e5-bc1fd8faa8bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:55.189354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fc198fb3-960e-4aee-bf66-698a34dee17f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:55.189673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e332b19-c21b-4839-96e5-bc1fd8faa8bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:55.195632 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc198fb3-960e-4aee-bf66-698a34dee17f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:55.196070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc198fb3-960e-4aee-bf66-698a34dee17f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:55.196838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc198fb3-960e-4aee-bf66-698a34dee17f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:55.197264 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc198fb3-960e-4aee-bf66-698a34dee17f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:55.227485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fc198fb3-960e-4aee-bf66-698a34dee17f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044143 Jul 27 22:53:55.228046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 317/619] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:55 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:53:55.317959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3e332b19-c21b-4839-96e5-bc1fd8faa8bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:55.325270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3e332b19-c21b-4839-96e5-bc1fd8faa8bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.147954 Jul 27 22:53:55.325826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 303/620] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:55 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:55.346113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1d44702b-e4a2-41c2-b5aa-0e48edae3bff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:55.346651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1d44702b-e4a2-41c2-b5aa-0e48edae3bff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:55.353331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1d44702b-e4a2-41c2-b5aa-0e48edae3bff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:55.353770 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1d44702b-e4a2-41c2-b5aa-0e48edae3bff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:55.354515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1d44702b-e4a2-41c2-b5aa-0e48edae3bff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:55.354942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1d44702b-e4a2-41c2-b5aa-0e48edae3bff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:55.680692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1d44702b-e4a2-41c2-b5aa-0e48edae3bff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:55.688580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1d44702b-e4a2-41c2-b5aa-0e48edae3bff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.346290 Jul 27 22:53:55.689135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 318/621] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:55 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:56.239530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e7e8cd2c-f22e-43ee-b590-c0f4cfe40372 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:56.241711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e7e8cd2c-f22e-43ee-b590-c0f4cfe40372 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:56.247727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e7e8cd2c-f22e-43ee-b590-c0f4cfe40372 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:56.248169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e7e8cd2c-f22e-43ee-b590-c0f4cfe40372 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:56.248942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e7e8cd2c-f22e-43ee-b590-c0f4cfe40372 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:56.249369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e7e8cd2c-f22e-43ee-b590-c0f4cfe40372 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:56.280721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e7e8cd2c-f22e-43ee-b590-c0f4cfe40372 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045096 Jul 27 22:53:56.281263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 304/622] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:56.346052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5c8fe4ad-d518-4f2d-a987-9950205bdd4f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:56.346652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5c8fe4ad-d518-4f2d-a987-9950205bdd4f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:56.353357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5c8fe4ad-d518-4f2d-a987-9950205bdd4f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:56.353795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5c8fe4ad-d518-4f2d-a987-9950205bdd4f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:56.354539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5c8fe4ad-d518-4f2d-a987-9950205bdd4f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:56.354965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5c8fe4ad-d518-4f2d-a987-9950205bdd4f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:56.372820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:56.482237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5c8fe4ad-d518-4f2d-a987-9950205bdd4f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:56.490509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5c8fe4ad-d518-4f2d-a987-9950205bdd4f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.148209 Jul 27 22:53:56.491006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 319/623] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:56 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:56.708465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-734c5f96-a67a-4b99-8a12-22098ff54fdb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:56.709125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-734c5f96-a67a-4b99-8a12-22098ff54fdb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:56.715051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-734c5f96-a67a-4b99-8a12-22098ff54fdb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:56.715494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-734c5f96-a67a-4b99-8a12-22098ff54fdb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:56.716247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-734c5f96-a67a-4b99-8a12-22098ff54fdb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:56.716717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-734c5f96-a67a-4b99-8a12-22098ff54fdb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:56.857111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-734c5f96-a67a-4b99-8a12-22098ff54fdb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:56.865557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-734c5f96-a67a-4b99-8a12-22098ff54fdb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.160915 Jul 27 22:53:56.866110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 305/624] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:56 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:57.292770 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0dd4e63a-c6c9-4a09-a829-f6dcc59ac656 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:57.295021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0dd4e63a-c6c9-4a09-a829-f6dcc59ac656 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:57.301078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0dd4e63a-c6c9-4a09-a829-f6dcc59ac656 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:57.301656 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0dd4e63a-c6c9-4a09-a829-f6dcc59ac656 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:57.302412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0dd4e63a-c6c9-4a09-a829-f6dcc59ac656 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:57.302836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0dd4e63a-c6c9-4a09-a829-f6dcc59ac656 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:57.330199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0dd4e63a-c6c9-4a09-a829-f6dcc59ac656 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041336 Jul 27 22:53:57.330732 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 320/625] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:57 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:57.511217 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-349b1596-47a0-413c-8737-21bc39eb71c2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:57.511765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-349b1596-47a0-413c-8737-21bc39eb71c2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:57.517765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-349b1596-47a0-413c-8737-21bc39eb71c2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:57.518214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-349b1596-47a0-413c-8737-21bc39eb71c2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:57.518968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-349b1596-47a0-413c-8737-21bc39eb71c2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:57.520051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-349b1596-47a0-413c-8737-21bc39eb71c2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:57.524091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:57.647171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-349b1596-47a0-413c-8737-21bc39eb71c2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:57.654475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-349b1596-47a0-413c-8737-21bc39eb71c2 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.147197 Jul 27 22:53:57.655026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 306/626] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:57 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:57.886629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d596cb9d-4845-4c66-947e-c14ff0e5ec31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:57.887229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d596cb9d-4845-4c66-947e-c14ff0e5ec31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:57.893691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d596cb9d-4845-4c66-947e-c14ff0e5ec31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:57.894136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d596cb9d-4845-4c66-947e-c14ff0e5ec31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:57.894882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d596cb9d-4845-4c66-947e-c14ff0e5ec31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:57.895304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d596cb9d-4845-4c66-947e-c14ff0e5ec31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:58.035242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d596cb9d-4845-4c66-947e-c14ff0e5ec31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:58.043115 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d596cb9d-4845-4c66-947e-c14ff0e5ec31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.160386 Jul 27 22:53:58.043675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 321/627] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:57 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:58.343267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-35d7a946-448a-40c5-9190-48fa04ad586b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:58.345516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-35d7a946-448a-40c5-9190-48fa04ad586b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:58.352289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d7a946-448a-40c5-9190-48fa04ad586b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:58.352851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d7a946-448a-40c5-9190-48fa04ad586b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:58.353617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d7a946-448a-40c5-9190-48fa04ad586b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:58.354050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d7a946-448a-40c5-9190-48fa04ad586b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:58.381980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-35d7a946-448a-40c5-9190-48fa04ad586b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042660 Jul 27 22:53:58.382521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 307/628] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:58.675374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5bdad22d-677e-4133-b05b-7d53ccff8031 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:58.676009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5bdad22d-677e-4133-b05b-7d53ccff8031 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:58.682066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5bdad22d-677e-4133-b05b-7d53ccff8031 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:58.682511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5bdad22d-677e-4133-b05b-7d53ccff8031 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:58.683270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5bdad22d-677e-4133-b05b-7d53ccff8031 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:58.683704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5bdad22d-677e-4133-b05b-7d53ccff8031 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:58.811169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5bdad22d-677e-4133-b05b-7d53ccff8031 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:58.818510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5bdad22d-677e-4133-b05b-7d53ccff8031 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.147026 Jul 27 22:53:58.819053 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 322/629] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:58 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:59.064994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1a13cfab-43e9-45c4-bd99-9e99f0ba2004 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:59.065602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1a13cfab-43e9-45c4-bd99-9e99f0ba2004 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:59.072006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1a13cfab-43e9-45c4-bd99-9e99f0ba2004 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:59.072451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1a13cfab-43e9-45c4-bd99-9e99f0ba2004 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:59.073851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1a13cfab-43e9-45c4-bd99-9e99f0ba2004 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:59.074283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1a13cfab-43e9-45c4-bd99-9e99f0ba2004 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:59.212713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1a13cfab-43e9-45c4-bd99-9e99f0ba2004 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:59.220643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1a13cfab-43e9-45c4-bd99-9e99f0ba2004 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.159481 Jul 27 22:53:59.221206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 308/630] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:59 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:53:59.394087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-761b6d03-261d-4c1a-acc6-0a2fbdac349f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:59.396376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-761b6d03-261d-4c1a-acc6-0a2fbdac349f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:59.402984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-761b6d03-261d-4c1a-acc6-0a2fbdac349f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:59.403517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-761b6d03-261d-4c1a-acc6-0a2fbdac349f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:59.404281 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-761b6d03-261d-4c1a-acc6-0a2fbdac349f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:59.404754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-761b6d03-261d-4c1a-acc6-0a2fbdac349f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:59.433061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-761b6d03-261d-4c1a-acc6-0a2fbdac349f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042933 Jul 27 22:53:59.433601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 323/631] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:53:59 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:53:59.839133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0fa19c5b-31a8-48eb-919e-d93dc659a6c6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:53:59.839744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0fa19c5b-31a8-48eb-919e-d93dc659a6c6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:53:59.845773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0fa19c5b-31a8-48eb-919e-d93dc659a6c6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:59.846211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0fa19c5b-31a8-48eb-919e-d93dc659a6c6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:59.846960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0fa19c5b-31a8-48eb-919e-d93dc659a6c6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:53:59.847890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0fa19c5b-31a8-48eb-919e-d93dc659a6c6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:53:59.979453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0fa19c5b-31a8-48eb-919e-d93dc659a6c6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:53:59.987319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0fa19c5b-31a8-48eb-919e-d93dc659a6c6 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.152008 Jul 27 22:53:59.987879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 309/632] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:53:59 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:00.241820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7261df6d-1907-4a13-89cd-7d3778ea60a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:00.242429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7261df6d-1907-4a13-89cd-7d3778ea60a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:00.248421 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7261df6d-1907-4a13-89cd-7d3778ea60a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:00.248893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7261df6d-1907-4a13-89cd-7d3778ea60a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:00.249646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7261df6d-1907-4a13-89cd-7d3778ea60a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:00.250077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7261df6d-1907-4a13-89cd-7d3778ea60a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:00.395394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7261df6d-1907-4a13-89cd-7d3778ea60a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:00.403451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7261df6d-1907-4a13-89cd-7d3778ea60a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.165428 Jul 27 22:54:00.404075 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 324/633] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:00 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:00.445081 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-90eb363e-defb-45a8-b26b-2403c3d0a863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:00.447288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-90eb363e-defb-45a8-b26b-2403c3d0a863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:00.453225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90eb363e-defb-45a8-b26b-2403c3d0a863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:00.453665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90eb363e-defb-45a8-b26b-2403c3d0a863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:00.454409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90eb363e-defb-45a8-b26b-2403c3d0a863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:00.454837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90eb363e-defb-45a8-b26b-2403c3d0a863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:00.483680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-90eb363e-defb-45a8-b26b-2403c3d0a863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042479 Jul 27 22:54:00.484249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 310/634] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:00 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:01.009748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-593d60c9-420d-4876-8c57-9343c92438ac tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:01.010355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-593d60c9-420d-4876-8c57-9343c92438ac tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:01.016428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-593d60c9-420d-4876-8c57-9343c92438ac tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:01.016898 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-593d60c9-420d-4876-8c57-9343c92438ac tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:01.017649 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-593d60c9-420d-4876-8c57-9343c92438ac tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:01.018080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-593d60c9-420d-4876-8c57-9343c92438ac tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:01.146315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-593d60c9-420d-4876-8c57-9343c92438ac tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:01.153751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-593d60c9-420d-4876-8c57-9343c92438ac tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.147823 Jul 27 22:54:01.154525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 325/635] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:01 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:01.425274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c513e8b0-6289-4706-a045-b06831bc9306 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:01.426846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c513e8b0-6289-4706-a045-b06831bc9306 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:01.432688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c513e8b0-6289-4706-a045-b06831bc9306 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:01.433139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c513e8b0-6289-4706-a045-b06831bc9306 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:01.433898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c513e8b0-6289-4706-a045-b06831bc9306 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:01.434352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c513e8b0-6289-4706-a045-b06831bc9306 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:01.495652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-91e614d0-012b-4c2a-a191-00e0c2f0ba43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:01.497945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-91e614d0-012b-4c2a-a191-00e0c2f0ba43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:01.504321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91e614d0-012b-4c2a-a191-00e0c2f0ba43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:01.504801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91e614d0-012b-4c2a-a191-00e0c2f0ba43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:01.505570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91e614d0-012b-4c2a-a191-00e0c2f0ba43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:01.505998 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91e614d0-012b-4c2a-a191-00e0c2f0ba43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:01.538282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-91e614d0-012b-4c2a-a191-00e0c2f0ba43 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046729 Jul 27 22:54:01.538852 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 326/636] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:01 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:54:01.575711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c513e8b0-6289-4706-a045-b06831bc9306 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:01.584126 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c513e8b0-6289-4706-a045-b06831bc9306 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.162956 Jul 27 22:54:01.584703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 311/637] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:01 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:02.174598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-13768331-785c-4a1e-9c92-3984665c0d13 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:02.175198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-13768331-785c-4a1e-9c92-3984665c0d13 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:02.181141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-13768331-785c-4a1e-9c92-3984665c0d13 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:02.181575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-13768331-785c-4a1e-9c92-3984665c0d13 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:02.182319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-13768331-785c-4a1e-9c92-3984665c0d13 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:02.182744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-13768331-785c-4a1e-9c92-3984665c0d13 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:02.311013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-13768331-785c-4a1e-9c92-3984665c0d13 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:02.318747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-13768331-785c-4a1e-9c92-3984665c0d13 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.147984 Jul 27 22:54:02.319298 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 327/638] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:02 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:02.550390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cca0f17d-2cf3-496a-a33e-b6795020d57b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:02.553072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cca0f17d-2cf3-496a-a33e-b6795020d57b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:02.558987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cca0f17d-2cf3-496a-a33e-b6795020d57b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:02.559431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cca0f17d-2cf3-496a-a33e-b6795020d57b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:02.560183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cca0f17d-2cf3-496a-a33e-b6795020d57b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:02.560641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cca0f17d-2cf3-496a-a33e-b6795020d57b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:02.588760 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cca0f17d-2cf3-496a-a33e-b6795020d57b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042268 Jul 27 22:54:02.589338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 312/639] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:02 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:02.605244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a547391f-74e5-4601-9662-11ee2a362289 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:02.605855 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a547391f-74e5-4601-9662-11ee2a362289 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:02.612292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a547391f-74e5-4601-9662-11ee2a362289 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:02.612776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a547391f-74e5-4601-9662-11ee2a362289 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:02.614032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a547391f-74e5-4601-9662-11ee2a362289 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:02.614461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a547391f-74e5-4601-9662-11ee2a362289 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:02.752266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a547391f-74e5-4601-9662-11ee2a362289 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:02.760174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a547391f-74e5-4601-9662-11ee2a362289 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.158682 Jul 27 22:54:02.760942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 328/640] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:02 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:03.339565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d154a650-77ef-4fa1-8dde-42abdfbaa960 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:03.340161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d154a650-77ef-4fa1-8dde-42abdfbaa960 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:03.346213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d154a650-77ef-4fa1-8dde-42abdfbaa960 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:03.346652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d154a650-77ef-4fa1-8dde-42abdfbaa960 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:03.347404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d154a650-77ef-4fa1-8dde-42abdfbaa960 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:03.348435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d154a650-77ef-4fa1-8dde-42abdfbaa960 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:03.476997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d154a650-77ef-4fa1-8dde-42abdfbaa960 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:03.484381 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d154a650-77ef-4fa1-8dde-42abdfbaa960 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.148659 Jul 27 22:54:03.484962 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 313/641] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:03 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:03.600794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dc2b8396-6c5d-44ad-bc61-b98e5007799e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:03.603035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dc2b8396-6c5d-44ad-bc61-b98e5007799e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:03.609562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc2b8396-6c5d-44ad-bc61-b98e5007799e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:03.610128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc2b8396-6c5d-44ad-bc61-b98e5007799e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:03.610751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc2b8396-6c5d-44ad-bc61-b98e5007799e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:03.611187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc2b8396-6c5d-44ad-bc61-b98e5007799e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:03.639389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dc2b8396-6c5d-44ad-bc61-b98e5007799e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042934 Jul 27 22:54:03.639915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 329/642] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:03.781825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c2b37b4b-77b7-4abd-a598-23132e47f48b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:03.782461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c2b37b4b-77b7-4abd-a598-23132e47f48b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:03.788376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c2b37b4b-77b7-4abd-a598-23132e47f48b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:03.788842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c2b37b4b-77b7-4abd-a598-23132e47f48b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:03.789596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c2b37b4b-77b7-4abd-a598-23132e47f48b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:03.790026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c2b37b4b-77b7-4abd-a598-23132e47f48b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:03.933507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c2b37b4b-77b7-4abd-a598-23132e47f48b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:03.941938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c2b37b4b-77b7-4abd-a598-23132e47f48b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.163481 Jul 27 22:54:03.942591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 314/643] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:03 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:04.505528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7fcb4670-46bc-4b93-ba1a-5a3ba421ea10 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:04.506137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7fcb4670-46bc-4b93-ba1a-5a3ba421ea10 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:04.512862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7fcb4670-46bc-4b93-ba1a-5a3ba421ea10 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:04.513299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7fcb4670-46bc-4b93-ba1a-5a3ba421ea10 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:04.514055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7fcb4670-46bc-4b93-ba1a-5a3ba421ea10 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:04.514481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7fcb4670-46bc-4b93-ba1a-5a3ba421ea10 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:04.651729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-613cbe7f-8704-4b31-99b2-c041c031e1d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:04.654020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-613cbe7f-8704-4b31-99b2-c041c031e1d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:04.659967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-613cbe7f-8704-4b31-99b2-c041c031e1d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:04.661056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-613cbe7f-8704-4b31-99b2-c041c031e1d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:04.661812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-613cbe7f-8704-4b31-99b2-c041c031e1d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:04.662235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-613cbe7f-8704-4b31-99b2-c041c031e1d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:04.691666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-613cbe7f-8704-4b31-99b2-c041c031e1d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043796 Jul 27 22:54:04.692230 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 315/644] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:04 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:04.703728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7fcb4670-46bc-4b93-ba1a-5a3ba421ea10 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:04.711749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7fcb4670-46bc-4b93-ba1a-5a3ba421ea10 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.210227 Jul 27 22:54:04.712296 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 330/645] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:04 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:04.963760 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-15674c3a-18b1-476a-a5f7-e6a11c0c5f80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:04.964372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-15674c3a-18b1-476a-a5f7-e6a11c0c5f80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:04.970356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15674c3a-18b1-476a-a5f7-e6a11c0c5f80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:04.970808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15674c3a-18b1-476a-a5f7-e6a11c0c5f80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:04.971570 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15674c3a-18b1-476a-a5f7-e6a11c0c5f80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:04.972006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15674c3a-18b1-476a-a5f7-e6a11c0c5f80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:05.113587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-15674c3a-18b1-476a-a5f7-e6a11c0c5f80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:05.122157 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-15674c3a-18b1-476a-a5f7-e6a11c0c5f80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.162314 Jul 27 22:54:05.122720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 316/646] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:04 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:05.703299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-36bb74c9-3140-4d57-951c-e1673a2b464d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:05.705600 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-36bb74c9-3140-4d57-951c-e1673a2b464d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:05.712168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36bb74c9-3140-4d57-951c-e1673a2b464d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:05.712646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36bb74c9-3140-4d57-951c-e1673a2b464d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:05.713405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36bb74c9-3140-4d57-951c-e1673a2b464d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:05.713842 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36bb74c9-3140-4d57-951c-e1673a2b464d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:05.734695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bb9f18a1-c7eb-4fd4-98d4-c8ca5b171c3f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:05.734695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bb9f18a1-c7eb-4fd4-98d4-c8ca5b171c3f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:05.741093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb9f18a1-c7eb-4fd4-98d4-c8ca5b171c3f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:05.741532 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb9f18a1-c7eb-4fd4-98d4-c8ca5b171c3f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:05.742295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb9f18a1-c7eb-4fd4-98d4-c8ca5b171c3f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:05.742726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb9f18a1-c7eb-4fd4-98d4-c8ca5b171c3f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:05.749407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-36bb74c9-3140-4d57-951c-e1673a2b464d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049967 Jul 27 22:54:05.750128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 331/647] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:05 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:05.868165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bb9f18a1-c7eb-4fd4-98d4-c8ca5b171c3f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:05.875489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bb9f18a1-c7eb-4fd4-98d4-c8ca5b171c3f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.145841 Jul 27 22:54:05.876048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 317/648] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:05 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:54:06.143210 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-07f8b650-94e7-4980-8ead-df954e71666d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:06.143823 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-07f8b650-94e7-4980-8ead-df954e71666d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:06.150424 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07f8b650-94e7-4980-8ead-df954e71666d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:06.150879 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07f8b650-94e7-4980-8ead-df954e71666d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:06.151646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07f8b650-94e7-4980-8ead-df954e71666d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:06.152084 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07f8b650-94e7-4980-8ead-df954e71666d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:06.289640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-07f8b650-94e7-4980-8ead-df954e71666d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:06.297619 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-07f8b650-94e7-4980-8ead-df954e71666d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.158236 Jul 27 22:54:06.298178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 332/649] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:06 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:06.762463 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-61bba37d-3245-4b00-b1a2-6437c59daca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:06.765287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-61bba37d-3245-4b00-b1a2-6437c59daca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:06.773623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61bba37d-3245-4b00-b1a2-6437c59daca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:06.774078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61bba37d-3245-4b00-b1a2-6437c59daca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:06.774838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61bba37d-3245-4b00-b1a2-6437c59daca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:06.775269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61bba37d-3245-4b00-b1a2-6437c59daca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:06.805885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-61bba37d-3245-4b00-b1a2-6437c59daca9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048098 Jul 27 22:54:06.806442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 318/650] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:06.896210 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9effb47f-8f9b-4fb5-b3b1-2f33c31a613f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:06.896866 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9effb47f-8f9b-4fb5-b3b1-2f33c31a613f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:06.903307 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9effb47f-8f9b-4fb5-b3b1-2f33c31a613f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:06.903750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9effb47f-8f9b-4fb5-b3b1-2f33c31a613f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:06.904502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9effb47f-8f9b-4fb5-b3b1-2f33c31a613f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:06.904960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9effb47f-8f9b-4fb5-b3b1-2f33c31a613f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:07.038364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9effb47f-8f9b-4fb5-b3b1-2f33c31a613f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:07.045756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9effb47f-8f9b-4fb5-b3b1-2f33c31a613f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.153353 Jul 27 22:54:07.046306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 333/651] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:06 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:07.319120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e8b0a96a-e6b6-4100-8db9-61e2394fbb61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:07.319762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e8b0a96a-e6b6-4100-8db9-61e2394fbb61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:07.325780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8b0a96a-e6b6-4100-8db9-61e2394fbb61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:07.326233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8b0a96a-e6b6-4100-8db9-61e2394fbb61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:07.326987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8b0a96a-e6b6-4100-8db9-61e2394fbb61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:07.327425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8b0a96a-e6b6-4100-8db9-61e2394fbb61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:07.465475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e8b0a96a-e6b6-4100-8db9-61e2394fbb61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:07.473400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e8b0a96a-e6b6-4100-8db9-61e2394fbb61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.158604 Jul 27 22:54:07.473960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 319/652] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:07 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:07.818758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7fa91d66-dbcf-42ad-a625-6d44fa995c90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:07.820973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7fa91d66-dbcf-42ad-a625-6d44fa995c90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:07.826856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7fa91d66-dbcf-42ad-a625-6d44fa995c90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:07.827301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7fa91d66-dbcf-42ad-a625-6d44fa995c90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:07.828047 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7fa91d66-dbcf-42ad-a625-6d44fa995c90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:07.828472 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7fa91d66-dbcf-42ad-a625-6d44fa995c90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:07.855910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7fa91d66-dbcf-42ad-a625-6d44fa995c90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041712 Jul 27 22:54:07.856438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 334/653] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:07 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:08.067299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3bdd82eb-1f73-4d97-b411-c1c4ddfb3397 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:08.067942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3bdd82eb-1f73-4d97-b411-c1c4ddfb3397 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:08.075049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bdd82eb-1f73-4d97-b411-c1c4ddfb3397 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:08.075501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bdd82eb-1f73-4d97-b411-c1c4ddfb3397 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:08.076312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bdd82eb-1f73-4d97-b411-c1c4ddfb3397 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:08.076856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bdd82eb-1f73-4d97-b411-c1c4ddfb3397 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:08.258068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3bdd82eb-1f73-4d97-b411-c1c4ddfb3397 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:08.265527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3bdd82eb-1f73-4d97-b411-c1c4ddfb3397 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.202084 Jul 27 22:54:08.266095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 320/654] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:08 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:08.495168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8c34d130-286c-4023-862c-61267cf9aa88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:08.495690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8c34d130-286c-4023-862c-61267cf9aa88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:08.502243 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c34d130-286c-4023-862c-61267cf9aa88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:08.502685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c34d130-286c-4023-862c-61267cf9aa88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:08.503442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c34d130-286c-4023-862c-61267cf9aa88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:08.503895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c34d130-286c-4023-862c-61267cf9aa88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:08.645805 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8c34d130-286c-4023-862c-61267cf9aa88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:08.653985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8c34d130-286c-4023-862c-61267cf9aa88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.162715 Jul 27 22:54:08.654542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 335/655] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:08 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:08.867276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-de97bf0f-08e9-4da0-81cb-87baffe6570c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:08.869520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-de97bf0f-08e9-4da0-81cb-87baffe6570c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:08.875491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de97bf0f-08e9-4da0-81cb-87baffe6570c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:08.875923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de97bf0f-08e9-4da0-81cb-87baffe6570c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:08.876714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de97bf0f-08e9-4da0-81cb-87baffe6570c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:08.877151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de97bf0f-08e9-4da0-81cb-87baffe6570c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:08.906064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-de97bf0f-08e9-4da0-81cb-87baffe6570c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042764 Jul 27 22:54:08.906604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 321/656] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:08 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:09.286116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9ef75328-9dfc-42cd-b34a-dd787ebb322f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:09.286759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9ef75328-9dfc-42cd-b34a-dd787ebb322f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:09.292933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9ef75328-9dfc-42cd-b34a-dd787ebb322f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:09.293374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9ef75328-9dfc-42cd-b34a-dd787ebb322f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:09.294127 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9ef75328-9dfc-42cd-b34a-dd787ebb322f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:09.294559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9ef75328-9dfc-42cd-b34a-dd787ebb322f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:09.298461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:09.446332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9ef75328-9dfc-42cd-b34a-dd787ebb322f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:09.454467 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9ef75328-9dfc-42cd-b34a-dd787ebb322f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.172139 Jul 27 22:54:09.455383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 336/657] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:09 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:09.675524 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-577ffc83-624f-42a6-b961-7c2b89394055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:09.676690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-577ffc83-624f-42a6-b961-7c2b89394055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:09.682679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-577ffc83-624f-42a6-b961-7c2b89394055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:09.683122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-577ffc83-624f-42a6-b961-7c2b89394055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:09.683874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-577ffc83-624f-42a6-b961-7c2b89394055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:09.684304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-577ffc83-624f-42a6-b961-7c2b89394055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:09.827799 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-577ffc83-624f-42a6-b961-7c2b89394055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:09.831223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:09.836825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-577ffc83-624f-42a6-b961-7c2b89394055 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.165218 Jul 27 22:54:09.837578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 322/658] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:09 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:09.931744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2aaa6327-c383-4302-899e-745861be04d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:09.935034 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2aaa6327-c383-4302-899e-745861be04d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:09.942436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2aaa6327-c383-4302-899e-745861be04d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:09.942881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2aaa6327-c383-4302-899e-745861be04d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:09.943644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2aaa6327-c383-4302-899e-745861be04d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:09.944817 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2aaa6327-c383-4302-899e-745861be04d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:09.978544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2aaa6327-c383-4302-899e-745861be04d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063521 Jul 27 22:54:09.979732 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 337/659] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:09 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:10.475907 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-92d85bb6-86e4-466d-a002-4f135c411e60 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:10.476520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-92d85bb6-86e4-466d-a002-4f135c411e60 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:10.482738 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-92d85bb6-86e4-466d-a002-4f135c411e60 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:10.483185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-92d85bb6-86e4-466d-a002-4f135c411e60 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:10.483955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-92d85bb6-86e4-466d-a002-4f135c411e60 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:10.484428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-92d85bb6-86e4-466d-a002-4f135c411e60 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:10.627633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-92d85bb6-86e4-466d-a002-4f135c411e60 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:10.636092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-92d85bb6-86e4-466d-a002-4f135c411e60 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.164329 Jul 27 22:54:10.636700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 323/660] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:10 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:10.859181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e12c751a-5628-4d33-b621-f2220d940be6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:10.859788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e12c751a-5628-4d33-b621-f2220d940be6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:10.866313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e12c751a-5628-4d33-b621-f2220d940be6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:10.866755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e12c751a-5628-4d33-b621-f2220d940be6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:10.867513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e12c751a-5628-4d33-b621-f2220d940be6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:10.867947 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e12c751a-5628-4d33-b621-f2220d940be6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:11.001115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ae77f8bd-7eb5-4e50-990d-00386837a09a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:11.006956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ae77f8bd-7eb5-4e50-990d-00386837a09a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:11.017321 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae77f8bd-7eb5-4e50-990d-00386837a09a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:11.019051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae77f8bd-7eb5-4e50-990d-00386837a09a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:11.020074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae77f8bd-7eb5-4e50-990d-00386837a09a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:11.020775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae77f8bd-7eb5-4e50-990d-00386837a09a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:11.024363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e12c751a-5628-4d33-b621-f2220d940be6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:11.034994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e12c751a-5628-4d33-b621-f2220d940be6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1749 microversion: 2.1 time: 0.179566 Jul 27 22:54:11.048582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 338/661] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:10 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1749 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:11.072355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ae77f8bd-7eb5-4e50-990d-00386837a09a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082768 Jul 27 22:54:11.073161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 324/662] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:10 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:54:11.093956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-18640139-fcfd-4a89-bec4-9724fb19bc8f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:54:11.096542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-18640139-fcfd-4a89-bec4-9724fb19bc8f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:11.103473 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-18640139-fcfd-4a89-bec4-9724fb19bc8f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:11.103990 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-18640139-fcfd-4a89-bec4-9724fb19bc8f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:11.104848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-18640139-fcfd-4a89-bec4-9724fb19bc8f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:11.105342 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-18640139-fcfd-4a89-bec4-9724fb19bc8f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:11.129938 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.objects.instance [None req-18640139-fcfd-4a89-bec4-9724fb19bc8f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lazy-loading 'flavor' on Instance uuid 9a5ccc96-6331-4ef5-a712-a72739545469 {{(pid=129294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:54:11.260345 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-18640139-fcfd-4a89-bec4-9724fb19bc8f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "POST /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/action" status: 200 len: 32 microversion: 2.1 time: 0.170260 Jul 27 22:54:11.261061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 339/663] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 22:54:11 2022] POST /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 22:54:11.275198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c1c0e7be-c070-45a6-be41-a6c13e91fcd9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:11.275806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c1c0e7be-c070-45a6-be41-a6c13e91fcd9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:11.286853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1c0e7be-c070-45a6-be41-a6c13e91fcd9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:11.287303 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1c0e7be-c070-45a6-be41-a6c13e91fcd9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:11.288170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1c0e7be-c070-45a6-be41-a6c13e91fcd9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:11.288955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1c0e7be-c070-45a6-be41-a6c13e91fcd9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:11.433311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c1c0e7be-c070-45a6-be41-a6c13e91fcd9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:11.441739 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c1c0e7be-c070-45a6-be41-a6c13e91fcd9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.170290 Jul 27 22:54:11.442407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 325/664] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:11 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:11.658022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e04cfbcd-3fa8-4344-b359-153e5eeffd0f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:11.658624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e04cfbcd-3fa8-4344-b359-153e5eeffd0f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:11.664853 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e04cfbcd-3fa8-4344-b359-153e5eeffd0f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:11.665306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e04cfbcd-3fa8-4344-b359-153e5eeffd0f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:11.666070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e04cfbcd-3fa8-4344-b359-153e5eeffd0f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:11.666503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e04cfbcd-3fa8-4344-b359-153e5eeffd0f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:11.803446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e04cfbcd-3fa8-4344-b359-153e5eeffd0f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:11.810892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e04cfbcd-3fa8-4344-b359-153e5eeffd0f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1673 microversion: 2.1 time: 0.157262 Jul 27 22:54:11.811459 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 340/665] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:11 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:12.059096 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-afd3adeb-160d-4e53-8c12-82aedcffed6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:12.059719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-afd3adeb-160d-4e53-8c12-82aedcffed6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:12.066078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afd3adeb-160d-4e53-8c12-82aedcffed6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:12.066757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afd3adeb-160d-4e53-8c12-82aedcffed6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:12.067549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afd3adeb-160d-4e53-8c12-82aedcffed6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:12.068110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afd3adeb-160d-4e53-8c12-82aedcffed6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:12.085303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9583600d-5c51-43af-a029-d257ec343e33 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:12.087621 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9583600d-5c51-43af-a029-d257ec343e33 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:12.094894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9583600d-5c51-43af-a029-d257ec343e33 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:12.095546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9583600d-5c51-43af-a029-d257ec343e33 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:12.096821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9583600d-5c51-43af-a029-d257ec343e33 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:12.097420 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9583600d-5c51-43af-a029-d257ec343e33 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:12.151920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9583600d-5c51-43af-a029-d257ec343e33 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066660 Jul 27 22:54:12.151920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 341/666] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:12.243564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-afd3adeb-160d-4e53-8c12-82aedcffed6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:12.251654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-afd3adeb-160d-4e53-8c12-82aedcffed6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.196455 Jul 27 22:54:12.252214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 326/667] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:12 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:12.463829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-445a557c-744a-4709-b30b-a7005898806f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:12.464685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-445a557c-744a-4709-b30b-a7005898806f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:12.465928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-f0235e1a-4267-4b32-9436-5ef2a3ec99fe req-6be6a315-c1f8-4083-afa5-8be0341285d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61a77c9-764c-4eca-a654-dabb4c208454", "name": "network-vif-deleted", "tag": "7bf42a6f-daff-4fc8-9bfb-ebb04957bcc1"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:54:12.469839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=77 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:12.471982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-445a557c-744a-4709-b30b-a7005898806f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:12.472678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-445a557c-744a-4709-b30b-a7005898806f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:12.473777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-445a557c-744a-4709-b30b-a7005898806f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:12.474011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:12.474211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-445a557c-744a-4709-b30b-a7005898806f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:12.476511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-f0235e1a-4267-4b32-9436-5ef2a3ec99fe req-6be6a315-c1f8-4083-afa5-8be0341285d0 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:12.476995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-f0235e1a-4267-4b32-9436-5ef2a3ec99fe req-6be6a315-c1f8-4083-afa5-8be0341285d0 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:12.524470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-f0235e1a-4267-4b32-9436-5ef2a3ec99fe req-6be6a315-c1f8-4083-afa5-8be0341285d0 service nova] Creating event network-vif-deleted:7bf42a6f-daff-4fc8-9bfb-ebb04957bcc1 for instance f61a77c9-764c-4eca-a654-dabb4c208454 on hv-cinder-85124 Jul 27 22:54:12.538388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-f0235e1a-4267-4b32-9436-5ef2a3ec99fe req-6be6a315-c1f8-4083-afa5-8be0341285d0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075951 Jul 27 22:54:12.542423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 327/668] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:54:12.647890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-445a557c-744a-4709-b30b-a7005898806f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:12.657153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-445a557c-744a-4709-b30b-a7005898806f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.197141 Jul 27 22:54:12.657735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 342/669] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:12 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:12.832602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-11fa4ee6-86e2-4ed3-9d30-fc1503829a31 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:12.834029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-11fa4ee6-86e2-4ed3-9d30-fc1503829a31 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:12.840373 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11fa4ee6-86e2-4ed3-9d30-fc1503829a31 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:12.841069 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11fa4ee6-86e2-4ed3-9d30-fc1503829a31 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:12.841845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11fa4ee6-86e2-4ed3-9d30-fc1503829a31 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:12.842277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11fa4ee6-86e2-4ed3-9d30-fc1503829a31 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:12.873769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11fa4ee6-86e2-4ed3-9d30-fc1503829a31 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:12.874213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11fa4ee6-86e2-4ed3-9d30-fc1503829a31 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:12.874656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.objects.instance [None req-11fa4ee6-86e2-4ed3-9d30-fc1503829a31 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lazy-loading 'fault' on Instance uuid f61a77c9-764c-4eca-a654-dabb4c208454 {{(pid=129295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:54:12.920277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-11fa4ee6-86e2-4ed3-9d30-fc1503829a31 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:12.928011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-11fa4ee6-86e2-4ed3-9d30-fc1503829a31 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 200 len: 1328 microversion: 2.1 time: 0.099876 Jul 27 22:54:12.928591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 328/670] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:12 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:13.159662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4739ef79-683f-4d46-9f37-a99dea8acbc8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:13.162435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4739ef79-683f-4d46-9f37-a99dea8acbc8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:13.168893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4739ef79-683f-4d46-9f37-a99dea8acbc8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:13.169330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4739ef79-683f-4d46-9f37-a99dea8acbc8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:13.170120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4739ef79-683f-4d46-9f37-a99dea8acbc8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:13.170544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4739ef79-683f-4d46-9f37-a99dea8acbc8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:13.201214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4739ef79-683f-4d46-9f37-a99dea8acbc8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045340 Jul 27 22:54:13.201679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 343/671] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:13.273823 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8b65b53e-0b5e-4af7-b526-d1359f821f3d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:13.274435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8b65b53e-0b5e-4af7-b526-d1359f821f3d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:13.281061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b65b53e-0b5e-4af7-b526-d1359f821f3d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:13.281541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b65b53e-0b5e-4af7-b526-d1359f821f3d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:13.282315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b65b53e-0b5e-4af7-b526-d1359f821f3d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:13.282776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b65b53e-0b5e-4af7-b526-d1359f821f3d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:13.430152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8b65b53e-0b5e-4af7-b526-d1359f821f3d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:13.440112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8b65b53e-0b5e-4af7-b526-d1359f821f3d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.170658 Jul 27 22:54:13.440734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 329/672] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:13 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:13.679065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e794615a-881f-44da-86b9-4ad484f45161 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:13.679666 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e794615a-881f-44da-86b9-4ad484f45161 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:13.685791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e794615a-881f-44da-86b9-4ad484f45161 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:13.686230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e794615a-881f-44da-86b9-4ad484f45161 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:13.686975 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e794615a-881f-44da-86b9-4ad484f45161 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:13.687401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e794615a-881f-44da-86b9-4ad484f45161 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:13.821011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e794615a-881f-44da-86b9-4ad484f45161 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:13.828937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e794615a-881f-44da-86b9-4ad484f45161 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.154191 Jul 27 22:54:13.829489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 344/673] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:13 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:13.949335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-98ae7c6e-58d7-4ae7-81e0-c5a16de2b2bd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:13.949930 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-98ae7c6e-58d7-4ae7-81e0-c5a16de2b2bd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:13.957018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98ae7c6e-58d7-4ae7-81e0-c5a16de2b2bd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:13.957819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98ae7c6e-58d7-4ae7-81e0-c5a16de2b2bd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:13.958747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98ae7c6e-58d7-4ae7-81e0-c5a16de2b2bd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:13.959308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98ae7c6e-58d7-4ae7-81e0-c5a16de2b2bd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:13.972736 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-98ae7c6e-58d7-4ae7-81e0-c5a16de2b2bd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] HTTP exception thrown: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-98ae7c6e-58d7-4ae7-81e0-c5a16de2b2bd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Request method failure captured: Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 HTTP/1.1 Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cDt2jGYGP9avBKREaegGHX8ZTy2kz44enKKjyjO-15MlSubsYLgwLY9qqYsI5NH_p5bx2zZngNKDjFWu0Fetl0ijXLpmmj1jX_OleBvu1IrRI0woihJrHbEuWy7JlTiK66lBuoyBitOum2D6pploo6gdYnfSGwxZ7CPjAJ7dAswEvg Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 22:54:13.975766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 22:54:13.977238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_161af2d8dc8f4aa99d4cc112a89ff674", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:54:13.977238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-AttachVolumeTestJSON-1470603407 Jul 27 22:54:13.977238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 22:54:13.977238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 22:54:13.977238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 22:54:13.977238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 22:54:13.977238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 22:54:13.977238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 3aa05eaf07f14de6b6ef97f08e6e5123 Jul 27 22:54:13.977238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 22:54:13.977238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 22:54:13.977238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 22:54:13.977238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': 'f61a77c9-764c-4eca-a654-dabb4c208454'} Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:54:13.978088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 22:54:13.979262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 22:54:13.980351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-98ae7c6e-58d7-4ae7-81e0-c5a16de2b2bd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Returning 404 to user: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:54:13.980351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-98ae7c6e-58d7-4ae7-81e0-c5a16de2b2bd tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 404 len: 111 microversion: 2.1 time: 0.031784 Jul 27 22:54:13.980351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 330/674] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:13 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 22:54:13.986694 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5dd7c7b9-74b0-40ac-ae9e-3394d3a759b3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '.version_select at 0x7f696a024820>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:14.007024 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5dd7c7b9-74b0-40ac-ae9e-3394d3a759b3 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171337682" status: 202 len: 0 microversion: 2.1 time: 0.024570 Jul 27 22:54:14.007578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 345/675] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Jul 27 22:54:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171337682 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 22:54:14.213078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-90ac34c5-7021-4ceb-b783-c0d0f464714b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:14.215693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-90ac34c5-7021-4ceb-b783-c0d0f464714b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:14.222230 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90ac34c5-7021-4ceb-b783-c0d0f464714b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:14.222674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90ac34c5-7021-4ceb-b783-c0d0f464714b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:14.223936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90ac34c5-7021-4ceb-b783-c0d0f464714b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:14.224545 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90ac34c5-7021-4ceb-b783-c0d0f464714b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:14.254156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-90ac34c5-7021-4ceb-b783-c0d0f464714b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044998 Jul 27 22:54:14.255339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 331/676] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:14 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:14.464912 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-658f8427-6d93-4274-bb36-8d700f29ecb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:14.466216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-658f8427-6d93-4274-bb36-8d700f29ecb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:14.480306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-658f8427-6d93-4274-bb36-8d700f29ecb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:14.480798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-658f8427-6d93-4274-bb36-8d700f29ecb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:14.481613 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-658f8427-6d93-4274-bb36-8d700f29ecb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:14.482047 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-658f8427-6d93-4274-bb36-8d700f29ecb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:14.647569 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-658f8427-6d93-4274-bb36-8d700f29ecb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:14.650808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b0d6af82-28f0-49a3-8212-596b55e029ed tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Action: 'create', calling method: .version_select at 0x7f696a1d2430>, body: {"keypair": {"name": "tempest-keypair-1965918664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNshred5KCJwJava68KE9oYJPsr2oSJR0SZeKqv956f+TRUiuEq4TyDKywdzWQFMOeUq+IoUZM3//CkCBOnB7w+nCCe18CRZSi/sEn7PlCYN9Ke5LE7FDp3uqFFkUC0DUQ=="}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:54:14.655734 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-658f8427-6d93-4274-bb36-8d700f29ecb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.196297 Jul 27 22:54:14.656415 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 346/677] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:14 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:14.668748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-b0d6af82-28f0-49a3-8212-596b55e029ed tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Getting quotas for project 161af2d8dc8f4aa99d4cc112a89ff674. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:54:14.672483 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-b0d6af82-28f0-49a3-8212-596b55e029ed tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Getting quotas for user 3aa05eaf07f14de6b6ef97f08e6e5123 and project 161af2d8dc8f4aa99d4cc112a89ff674. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:54:14.696178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b0d6af82-28f0-49a3-8212-596b55e029ed tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050735 Jul 27 22:54:14.696827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 332/678] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 22:54:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:54:14.854116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8933adde-a5f4-4fc3-a5ab-18cfae8a1db9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:14.854849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8933adde-a5f4-4fc3-a5ab-18cfae8a1db9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:14.861024 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8933adde-a5f4-4fc3-a5ab-18cfae8a1db9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:14.861476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8933adde-a5f4-4fc3-a5ab-18cfae8a1db9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:14.862246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8933adde-a5f4-4fc3-a5ab-18cfae8a1db9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:14.862684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8933adde-a5f4-4fc3-a5ab-18cfae8a1db9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:14.992937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8933adde-a5f4-4fc3-a5ab-18cfae8a1db9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:15.001587 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8933adde-a5f4-4fc3-a5ab-18cfae8a1db9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.151666 Jul 27 22:54:15.011819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 347/679] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:14 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:15.266726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b95fc342-8a97-41b1-9c9d-d76f965805b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:15.268817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b95fc342-8a97-41b1-9c9d-d76f965805b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:15.274712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b95fc342-8a97-41b1-9c9d-d76f965805b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:15.275152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b95fc342-8a97-41b1-9c9d-d76f965805b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:15.275916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b95fc342-8a97-41b1-9c9d-d76f965805b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:15.276347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b95fc342-8a97-41b1-9c9d-d76f965805b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:15.305542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b95fc342-8a97-41b1-9c9d-d76f965805b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042939 Jul 27 22:54:15.306344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 333/680] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:15 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:15.678089 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d3a44b50-0eff-4e2d-9cf6-72de41f76532 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:15.678775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d3a44b50-0eff-4e2d-9cf6-72de41f76532 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:15.685561 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3a44b50-0eff-4e2d-9cf6-72de41f76532 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:15.686007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3a44b50-0eff-4e2d-9cf6-72de41f76532 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:15.686822 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3a44b50-0eff-4e2d-9cf6-72de41f76532 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:15.687262 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3a44b50-0eff-4e2d-9cf6-72de41f76532 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:15.847124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d3a44b50-0eff-4e2d-9cf6-72de41f76532 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:15.855987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d3a44b50-0eff-4e2d-9cf6-72de41f76532 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.182470 Jul 27 22:54:15.856614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 348/681] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:15 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:16.024639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2afcb98b-2670-499b-bc0c-883ad005d6ae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:16.025328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2afcb98b-2670-499b-bc0c-883ad005d6ae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:16.031231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2afcb98b-2670-499b-bc0c-883ad005d6ae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:16.031674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2afcb98b-2670-499b-bc0c-883ad005d6ae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:16.032439 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2afcb98b-2670-499b-bc0c-883ad005d6ae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:16.032892 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2afcb98b-2670-499b-bc0c-883ad005d6ae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:16.155651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1882950863", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23355fc2-605c-41a1-9f14-303ff46ef32c"}], "security_groups": [{"name": "tempest-securitygroup--282364075"}], "key_name": "tempest-keypair-1965918664", "user_data": "}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:54:16.171188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2afcb98b-2670-499b-bc0c-883ad005d6ae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:16.179828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2afcb98b-2670-499b-bc0c-883ad005d6ae tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.160458 Jul 27 22:54:16.180395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 334/682] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:16 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:16.258119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.network.neutron [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] validate_networks() for [('23355fc2-605c-41a1-9f14-303ff46ef32c', None, None, None, None, None)] {{(pid=129294) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 22:54:16.318436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-00e1fe47-afdc-420b-882c-872af6327ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:16.320754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-00e1fe47-afdc-420b-882c-872af6327ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:16.327129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-00e1fe47-afdc-420b-882c-872af6327ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:16.327673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-00e1fe47-afdc-420b-882c-872af6327ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:16.328439 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-00e1fe47-afdc-420b-882c-872af6327ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:16.328900 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-00e1fe47-afdc-420b-882c-872af6327ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:16.358204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-00e1fe47-afdc-420b-882c-872af6327ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044248 Jul 27 22:54:16.358769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 335/683] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:16 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:54:16.621016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Flavor limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 22:54:16.621438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Image limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 22:54:16.621906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Flavor pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 22:54:16.622310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Image pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 22:54:16.622717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 22:54:16.633844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:16.634288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:16.635076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:16.635503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:16.651609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Getting quotas for project 161af2d8dc8f4aa99d4cc112a89ff674. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 22:54:16.655489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Getting quotas for user 3aa05eaf07f14de6b6ef97f08e6e5123 and project 161af2d8dc8f4aa99d4cc112a89ff674. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 22:54:16.666144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Going to run 1 instances... {{(pid=129294) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 22:54:16.668317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129294) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 22:54:16.713414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2bad4a66-2eed-42db-b0bd-a07a72f1f4cc tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.563744 Jul 27 22:54:16.714368 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 349/684] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 22:54:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 22:54:16.724826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-db1252b8-4558-414c-a96e-8094d13c244b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:16.725432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-db1252b8-4558-414c-a96e-8094d13c244b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:16.781244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-db1252b8-4558-414c-a96e-8094d13c244b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:16.788803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-db1252b8-4558-414c-a96e-8094d13c244b tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 200 len: 1238 microversion: 2.1 time: 0.067768 Jul 27 22:54:16.789359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 336/685] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:16 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:16.877093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9fb12fb5-1b2c-4226-9b7c-20226097ef5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:16.877724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9fb12fb5-1b2c-4226-9b7c-20226097ef5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:16.884449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9fb12fb5-1b2c-4226-9b7c-20226097ef5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:16.884924 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9fb12fb5-1b2c-4226-9b7c-20226097ef5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:16.885685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9fb12fb5-1b2c-4226-9b7c-20226097ef5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:16.886118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9fb12fb5-1b2c-4226-9b7c-20226097ef5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:17.034413 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9fb12fb5-1b2c-4226-9b7c-20226097ef5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:17.043102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9fb12fb5-1b2c-4226-9b7c-20226097ef5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.169766 Jul 27 22:54:17.043787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 350/686] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:16 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:17.202029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6c989876-a8c0-4c3c-999e-178e9e5ef4d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:17.202675 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6c989876-a8c0-4c3c-999e-178e9e5ef4d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:17.208955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c989876-a8c0-4c3c-999e-178e9e5ef4d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:17.209524 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c989876-a8c0-4c3c-999e-178e9e5ef4d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:17.210293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c989876-a8c0-4c3c-999e-178e9e5ef4d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:17.210728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c989876-a8c0-4c3c-999e-178e9e5ef4d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:17.342242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6c989876-a8c0-4c3c-999e-178e9e5ef4d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:17.351534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6c989876-a8c0-4c3c-999e-178e9e5ef4d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.153398 Jul 27 22:54:17.352200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 337/687] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:17 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:17.369682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-71581596-94c6-447f-8758-06d179277aea tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:17.371930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-71581596-94c6-447f-8758-06d179277aea tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:17.377948 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-71581596-94c6-447f-8758-06d179277aea tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:17.378399 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-71581596-94c6-447f-8758-06d179277aea tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:17.379186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-71581596-94c6-447f-8758-06d179277aea tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:17.379648 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-71581596-94c6-447f-8758-06d179277aea tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:17.407904 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-71581596-94c6-447f-8758-06d179277aea tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042063 Jul 27 22:54:17.408384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 351/688] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:17 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:17.809440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1bf93c3a-0a56-45e9-a331-713b62ce0522 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:17.810038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1bf93c3a-0a56-45e9-a331-713b62ce0522 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:17.816343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1bf93c3a-0a56-45e9-a331-713b62ce0522 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:17.816807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1bf93c3a-0a56-45e9-a331-713b62ce0522 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:17.818069 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1bf93c3a-0a56-45e9-a331-713b62ce0522 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:17.818545 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1bf93c3a-0a56-45e9-a331-713b62ce0522 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:17.893043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1bf93c3a-0a56-45e9-a331-713b62ce0522 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:17.901328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1bf93c3a-0a56-45e9-a331-713b62ce0522 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 200 len: 1308 microversion: 2.1 time: 0.096022 Jul 27 22:54:17.901889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 338/689] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:17 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:18.066597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1774f071-5020-4de4-a48d-fafd763346a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:18.067785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1774f071-5020-4de4-a48d-fafd763346a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:18.083676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1774f071-5020-4de4-a48d-fafd763346a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:18.084443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1774f071-5020-4de4-a48d-fafd763346a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:18.085359 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1774f071-5020-4de4-a48d-fafd763346a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:18.085954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1774f071-5020-4de4-a48d-fafd763346a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:18.105846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:18.235382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1774f071-5020-4de4-a48d-fafd763346a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:18.244247 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1774f071-5020-4de4-a48d-fafd763346a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.181918 Jul 27 22:54:18.244928 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 352/690] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:18 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:18.422603 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fb1de6a1-bcf6-4f2a-8adb-8976250150d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:18.425068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fb1de6a1-bcf6-4f2a-8adb-8976250150d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:18.434897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb1de6a1-bcf6-4f2a-8adb-8976250150d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:18.435942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb1de6a1-bcf6-4f2a-8adb-8976250150d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:18.437497 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb1de6a1-bcf6-4f2a-8adb-8976250150d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:18.438037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb1de6a1-bcf6-4f2a-8adb-8976250150d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:18.471311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fb1de6a1-bcf6-4f2a-8adb-8976250150d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054416 Jul 27 22:54:18.472533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 353/691] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:54:18.502331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7ff69346-e6da-40c2-a684-5bc5e927613b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:18.503055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7ff69346-e6da-40c2-a684-5bc5e927613b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:18.509699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7ff69346-e6da-40c2-a684-5bc5e927613b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:18.510142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7ff69346-e6da-40c2-a684-5bc5e927613b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:18.511345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7ff69346-e6da-40c2-a684-5bc5e927613b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:18.512212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7ff69346-e6da-40c2-a684-5bc5e927613b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:18.656667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7ff69346-e6da-40c2-a684-5bc5e927613b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:18.665645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7ff69346-e6da-40c2-a684-5bc5e927613b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.295871 Jul 27 22:54:18.672618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 339/692] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:18 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:18.996283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f0ed96b2-11e9-4442-985a-c6aefd05b1eb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:18.997120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f0ed96b2-11e9-4442-985a-c6aefd05b1eb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:19.004148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f0ed96b2-11e9-4442-985a-c6aefd05b1eb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:19.005706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f0ed96b2-11e9-4442-985a-c6aefd05b1eb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:19.006506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f0ed96b2-11e9-4442-985a-c6aefd05b1eb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:19.006944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f0ed96b2-11e9-4442-985a-c6aefd05b1eb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:19.124972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-3cf1f373-2d43-4ca8-9305-680da2f6f8e1 req-c2a08cdb-0e86-4a7c-a35d-8f9835cb02f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f087841-5ab3-42d6-ace3-9288c1ff0059", "tag": "dbb4d703-735b-47ff-a087-f879be275b30"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:54:19.155273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-3cf1f373-2d43-4ca8-9305-680da2f6f8e1 req-c2a08cdb-0e86-4a7c-a35d-8f9835cb02f8 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:19.156135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-3cf1f373-2d43-4ca8-9305-680da2f6f8e1 req-c2a08cdb-0e86-4a7c-a35d-8f9835cb02f8 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:19.172012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-3cf1f373-2d43-4ca8-9305-680da2f6f8e1 req-c2a08cdb-0e86-4a7c-a35d-8f9835cb02f8 service nova] Creating event network-changed:dbb4d703-735b-47ff-a087-f879be275b30 for instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 on hv-cinder-85124 Jul 27 22:54:19.178936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-3cf1f373-2d43-4ca8-9305-680da2f6f8e1 req-c2a08cdb-0e86-4a7c-a35d-8f9835cb02f8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057414 Jul 27 22:54:19.179844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 340/693] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:54:19.188914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f0ed96b2-11e9-4442-985a-c6aefd05b1eb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:19.197692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f0ed96b2-11e9-4442-985a-c6aefd05b1eb tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 200 len: 1363 microversion: 2.1 time: 0.280002 Jul 27 22:54:19.198505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 354/694] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:18 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:19.267676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b8e240b9-0cf2-4181-95eb-b0a997b0bf03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:19.268573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b8e240b9-0cf2-4181-95eb-b0a997b0bf03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:19.278293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b8e240b9-0cf2-4181-95eb-b0a997b0bf03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:19.278746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b8e240b9-0cf2-4181-95eb-b0a997b0bf03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:19.279521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b8e240b9-0cf2-4181-95eb-b0a997b0bf03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:19.279953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b8e240b9-0cf2-4181-95eb-b0a997b0bf03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:19.424541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b8e240b9-0cf2-4181-95eb-b0a997b0bf03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:19.432512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b8e240b9-0cf2-4181-95eb-b0a997b0bf03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.169760 Jul 27 22:54:19.433096 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 341/695] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:19 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:19.485727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6eb1a16f-7b71-4729-9406-afd867823142 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:19.488221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6eb1a16f-7b71-4729-9406-afd867823142 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:19.495037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6eb1a16f-7b71-4729-9406-afd867823142 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:19.495477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6eb1a16f-7b71-4729-9406-afd867823142 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:19.496263 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6eb1a16f-7b71-4729-9406-afd867823142 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:19.496725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6eb1a16f-7b71-4729-9406-afd867823142 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:19.526459 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6eb1a16f-7b71-4729-9406-afd867823142 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044559 Jul 27 22:54:19.527814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 355/696] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:19 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:19.686846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0713fdbc-fb3f-4353-967b-3f9ae2fe666a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:19.687384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0713fdbc-fb3f-4353-967b-3f9ae2fe666a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:19.693989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0713fdbc-fb3f-4353-967b-3f9ae2fe666a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:19.694439 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0713fdbc-fb3f-4353-967b-3f9ae2fe666a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:19.695222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0713fdbc-fb3f-4353-967b-3f9ae2fe666a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:19.695650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0713fdbc-fb3f-4353-967b-3f9ae2fe666a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:19.824342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0713fdbc-fb3f-4353-967b-3f9ae2fe666a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:19.832253 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0713fdbc-fb3f-4353-967b-3f9ae2fe666a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.149296 Jul 27 22:54:19.832844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 342/697] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:19 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:20.219884 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bd19fb5b-ddf2-4cc8-b39c-4c92381b9235 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:20.220443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bd19fb5b-ddf2-4cc8-b39c-4c92381b9235 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:20.227207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bd19fb5b-ddf2-4cc8-b39c-4c92381b9235 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:20.227668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bd19fb5b-ddf2-4cc8-b39c-4c92381b9235 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:20.228405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bd19fb5b-ddf2-4cc8-b39c-4c92381b9235 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:20.228871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bd19fb5b-ddf2-4cc8-b39c-4c92381b9235 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:20.353554 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bd19fb5b-ddf2-4cc8-b39c-4c92381b9235 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:20.360810 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bd19fb5b-ddf2-4cc8-b39c-4c92381b9235 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 200 len: 1363 microversion: 2.1 time: 0.144751 Jul 27 22:54:20.361376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 356/698] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:20 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:20.453591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-31f61014-f2ad-4486-94b3-c3ca2e404543 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:20.454190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-31f61014-f2ad-4486-94b3-c3ca2e404543 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:20.460742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31f61014-f2ad-4486-94b3-c3ca2e404543 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:20.461186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31f61014-f2ad-4486-94b3-c3ca2e404543 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:20.461928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31f61014-f2ad-4486-94b3-c3ca2e404543 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:20.462410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31f61014-f2ad-4486-94b3-c3ca2e404543 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:20.467291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:20.539982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6010ac48-4ffb-4af6-99ed-f25c482728a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:20.542206 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6010ac48-4ffb-4af6-99ed-f25c482728a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:20.548783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6010ac48-4ffb-4af6-99ed-f25c482728a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:20.549234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6010ac48-4ffb-4af6-99ed-f25c482728a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:20.550012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6010ac48-4ffb-4af6-99ed-f25c482728a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:20.550443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6010ac48-4ffb-4af6-99ed-f25c482728a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:20.586467 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6010ac48-4ffb-4af6-99ed-f25c482728a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050973 Jul 27 22:54:20.587041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 357/699] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:54:20.610687 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-31f61014-f2ad-4486-94b3-c3ca2e404543 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:20.618939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-31f61014-f2ad-4486-94b3-c3ca2e404543 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.169299 Jul 27 22:54:20.619619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 343/700] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:20 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:20.854692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c502854f-5ddf-4830-9fb9-3bedc445c7ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:20.855679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c502854f-5ddf-4830-9fb9-3bedc445c7ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:20.862144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c502854f-5ddf-4830-9fb9-3bedc445c7ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:20.862662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c502854f-5ddf-4830-9fb9-3bedc445c7ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:20.863501 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c502854f-5ddf-4830-9fb9-3bedc445c7ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:20.864002 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c502854f-5ddf-4830-9fb9-3bedc445c7ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:21.002095 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c502854f-5ddf-4830-9fb9-3bedc445c7ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:21.011340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c502854f-5ddf-4830-9fb9-3bedc445c7ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.161659 Jul 27 22:54:21.012186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 358/701] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:20 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:21.381214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-25305484-899b-421f-9265-001a065ab49d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:21.381848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-25305484-899b-421f-9265-001a065ab49d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:21.387796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25305484-899b-421f-9265-001a065ab49d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:21.388244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25305484-899b-421f-9265-001a065ab49d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:21.389059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25305484-899b-421f-9265-001a065ab49d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:21.389491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25305484-899b-421f-9265-001a065ab49d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:21.517433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-25305484-899b-421f-9265-001a065ab49d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:21.525525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-25305484-899b-421f-9265-001a065ab49d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 200 len: 1363 microversion: 2.1 time: 0.148083 Jul 27 22:54:21.526082 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 344/702] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:21 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:21.640437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5bb80576-afa9-4056-8469-fb68ce15a6b8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:21.641165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5bb80576-afa9-4056-8469-fb68ce15a6b8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:21.647689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bb80576-afa9-4056-8469-fb68ce15a6b8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:21.648137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bb80576-afa9-4056-8469-fb68ce15a6b8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:21.648938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bb80576-afa9-4056-8469-fb68ce15a6b8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:21.649368 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bb80576-afa9-4056-8469-fb68ce15a6b8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:21.695751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-48543ff2-5d59-49bc-bf66-6b144fa1775c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:21.697978 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-48543ff2-5d59-49bc-bf66-6b144fa1775c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:21.704002 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48543ff2-5d59-49bc-bf66-6b144fa1775c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:21.704450 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48543ff2-5d59-49bc-bf66-6b144fa1775c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:21.705254 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48543ff2-5d59-49bc-bf66-6b144fa1775c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:21.705688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48543ff2-5d59-49bc-bf66-6b144fa1775c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:21.735369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-48543ff2-5d59-49bc-bf66-6b144fa1775c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.141419 Jul 27 22:54:21.736087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 359/703] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:21 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:21.794358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5bb80576-afa9-4056-8469-fb68ce15a6b8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:21.802219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5bb80576-afa9-4056-8469-fb68ce15a6b8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.165604 Jul 27 22:54:21.803314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 345/704] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:21 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:54:22.031616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-626d3ed6-abf1-4105-a0bc-719bbcfb0a06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:22.032215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-626d3ed6-abf1-4105-a0bc-719bbcfb0a06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:22.038095 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-626d3ed6-abf1-4105-a0bc-719bbcfb0a06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:22.038533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-626d3ed6-abf1-4105-a0bc-719bbcfb0a06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:22.039273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-626d3ed6-abf1-4105-a0bc-719bbcfb0a06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:22.039697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-626d3ed6-abf1-4105-a0bc-719bbcfb0a06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:22.172020 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-626d3ed6-abf1-4105-a0bc-719bbcfb0a06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:22.180544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-626d3ed6-abf1-4105-a0bc-719bbcfb0a06 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.152646 Jul 27 22:54:22.181116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 360/705] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:22 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:22.546128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3bdbea50-f5d4-4463-9ed5-24b955042d9f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:22.546793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3bdbea50-f5d4-4463-9ed5-24b955042d9f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:22.553532 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bdbea50-f5d4-4463-9ed5-24b955042d9f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:22.553980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bdbea50-f5d4-4463-9ed5-24b955042d9f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:22.554737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bdbea50-f5d4-4463-9ed5-24b955042d9f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:22.555173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bdbea50-f5d4-4463-9ed5-24b955042d9f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:22.682224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3bdbea50-f5d4-4463-9ed5-24b955042d9f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:22.689607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3bdbea50-f5d4-4463-9ed5-24b955042d9f tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 200 len: 1363 microversion: 2.1 time: 0.147344 Jul 27 22:54:22.690171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 346/706] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:22 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:22.747462 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-858c5997-5963-49f0-8672-fef17b8e0f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:22.749683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-858c5997-5963-49f0-8672-fef17b8e0f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:22.756125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-858c5997-5963-49f0-8672-fef17b8e0f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:22.756598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-858c5997-5963-49f0-8672-fef17b8e0f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:22.757363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-858c5997-5963-49f0-8672-fef17b8e0f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:22.757797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-858c5997-5963-49f0-8672-fef17b8e0f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:22.786105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-858c5997-5963-49f0-8672-fef17b8e0f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042571 Jul 27 22:54:22.786639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 361/707] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:22 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:22.824035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a3116050-86f0-40f1-922e-121b30530d54 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:22.824600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a3116050-86f0-40f1-922e-121b30530d54 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:22.830576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a3116050-86f0-40f1-922e-121b30530d54 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:22.831028 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a3116050-86f0-40f1-922e-121b30530d54 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:22.831793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a3116050-86f0-40f1-922e-121b30530d54 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:22.832220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a3116050-86f0-40f1-922e-121b30530d54 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:22.975190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a3116050-86f0-40f1-922e-121b30530d54 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:22.983729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a3116050-86f0-40f1-922e-121b30530d54 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.163507 Jul 27 22:54:22.997908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 347/708] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:22 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:23.117452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-296b34c6-7f89-440d-9564-4893a3e1079a req-2ef454d3-edb4-42dd-ba06-c330ca1225b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f087841-5ab3-42d6-ace3-9288c1ff0059", "name": "network-vif-plugged", "status": "completed", "tag": "dbb4d703-735b-47ff-a087-f879be275b30"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:54:23.128095 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-296b34c6-7f89-440d-9564-4893a3e1079a req-2ef454d3-edb4-42dd-ba06-c330ca1225b4 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:23.129415 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-296b34c6-7f89-440d-9564-4893a3e1079a req-2ef454d3-edb4-42dd-ba06-c330ca1225b4 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:23.141584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-296b34c6-7f89-440d-9564-4893a3e1079a req-2ef454d3-edb4-42dd-ba06-c330ca1225b4 service nova] Creating event network-vif-plugged:dbb4d703-735b-47ff-a087-f879be275b30 for instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 on hv-cinder-85124 Jul 27 22:54:23.147515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-296b34c6-7f89-440d-9564-4893a3e1079a req-2ef454d3-edb4-42dd-ba06-c330ca1225b4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033787 Jul 27 22:54:23.148426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 362/709] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:54:23.201128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-69b7d963-4cd7-4ea7-a5c1-fd1ac9285f29 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:23.201743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-69b7d963-4cd7-4ea7-a5c1-fd1ac9285f29 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:23.208079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-69b7d963-4cd7-4ea7-a5c1-fd1ac9285f29 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:23.208535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-69b7d963-4cd7-4ea7-a5c1-fd1ac9285f29 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:23.209904 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-69b7d963-4cd7-4ea7-a5c1-fd1ac9285f29 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:23.210339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-69b7d963-4cd7-4ea7-a5c1-fd1ac9285f29 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:23.343218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-69b7d963-4cd7-4ea7-a5c1-fd1ac9285f29 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:23.351479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-69b7d963-4cd7-4ea7-a5c1-fd1ac9285f29 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.154187 Jul 27 22:54:23.352035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 348/710] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:23 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:23.711678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5567fe72-8369-4264-89b3-1d51c5906ba9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:23.712297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5567fe72-8369-4264-89b3-1d51c5906ba9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:23.718790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5567fe72-8369-4264-89b3-1d51c5906ba9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:23.719224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5567fe72-8369-4264-89b3-1d51c5906ba9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:23.720188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5567fe72-8369-4264-89b3-1d51c5906ba9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:23.720640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5567fe72-8369-4264-89b3-1d51c5906ba9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:23.799525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-299e911d-a64c-42ce-a111-c81af868d1fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:23.801680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-299e911d-a64c-42ce-a111-c81af868d1fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:23.808399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-299e911d-a64c-42ce-a111-c81af868d1fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:23.808877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-299e911d-a64c-42ce-a111-c81af868d1fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:23.809637 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-299e911d-a64c-42ce-a111-c81af868d1fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:23.810071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-299e911d-a64c-42ce-a111-c81af868d1fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:23.838769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-299e911d-a64c-42ce-a111-c81af868d1fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043394 Jul 27 22:54:23.839361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 349/711] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:23 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:54:23.850223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5567fe72-8369-4264-89b3-1d51c5906ba9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:23.857774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5567fe72-8369-4264-89b3-1d51c5906ba9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 200 len: 1363 microversion: 2.1 time: 0.150604 Jul 27 22:54:23.858316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 363/712] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:23 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:24.006110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-44a9325a-01c2-4612-bd24-19a937982c58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:24.006626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-44a9325a-01c2-4612-bd24-19a937982c58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:24.012884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44a9325a-01c2-4612-bd24-19a937982c58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:24.013331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44a9325a-01c2-4612-bd24-19a937982c58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:24.014078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44a9325a-01c2-4612-bd24-19a937982c58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:24.014509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44a9325a-01c2-4612-bd24-19a937982c58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:24.166560 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-44a9325a-01c2-4612-bd24-19a937982c58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:24.174460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-44a9325a-01c2-4612-bd24-19a937982c58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.172794 Jul 27 22:54:24.175012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 350/713] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:24 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:24.373228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-85251ff0-e1c7-4726-8aaf-ae9b6fb7988e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:24.373854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-85251ff0-e1c7-4726-8aaf-ae9b6fb7988e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:24.379832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-85251ff0-e1c7-4726-8aaf-ae9b6fb7988e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:24.380277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-85251ff0-e1c7-4726-8aaf-ae9b6fb7988e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:24.381063 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-85251ff0-e1c7-4726-8aaf-ae9b6fb7988e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:24.381500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-85251ff0-e1c7-4726-8aaf-ae9b6fb7988e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:24.536504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-85251ff0-e1c7-4726-8aaf-ae9b6fb7988e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:24.544662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-85251ff0-e1c7-4726-8aaf-ae9b6fb7988e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.175222 Jul 27 22:54:24.545324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 364/714] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:24 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:24.850377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-71ef1e94-ad22-49b7-b62d-be1504f85696 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:24.852866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-71ef1e94-ad22-49b7-b62d-be1504f85696 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:24.858824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-71ef1e94-ad22-49b7-b62d-be1504f85696 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:24.859344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-71ef1e94-ad22-49b7-b62d-be1504f85696 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:24.860116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-71ef1e94-ad22-49b7-b62d-be1504f85696 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:24.860568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-71ef1e94-ad22-49b7-b62d-be1504f85696 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:24.878737 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e0ba1481-ec9e-4a82-b3ed-97711dd4f313 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:24.879431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e0ba1481-ec9e-4a82-b3ed-97711dd4f313 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:24.886664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e0ba1481-ec9e-4a82-b3ed-97711dd4f313 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:24.887102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e0ba1481-ec9e-4a82-b3ed-97711dd4f313 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:24.887860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e0ba1481-ec9e-4a82-b3ed-97711dd4f313 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:24.888288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e0ba1481-ec9e-4a82-b3ed-97711dd4f313 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:24.890403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-71ef1e94-ad22-49b7-b62d-be1504f85696 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043899 Jul 27 22:54:24.891125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 351/715] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:24 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:25.015753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e0ba1481-ec9e-4a82-b3ed-97711dd4f313 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:25.023043 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e0ba1481-ec9e-4a82-b3ed-97711dd4f313 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 200 len: 1363 microversion: 2.1 time: 0.148185 Jul 27 22:54:25.023596 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 365/716] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:24 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:54:25.195745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8758a6c9-ea57-4253-8330-88edc87048a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:25.196358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8758a6c9-ea57-4253-8330-88edc87048a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:25.202424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8758a6c9-ea57-4253-8330-88edc87048a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:25.202874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8758a6c9-ea57-4253-8330-88edc87048a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:25.203635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8758a6c9-ea57-4253-8330-88edc87048a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:25.204066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8758a6c9-ea57-4253-8330-88edc87048a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:25.341892 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8758a6c9-ea57-4253-8330-88edc87048a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:25.350226 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8758a6c9-ea57-4253-8330-88edc87048a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.157858 Jul 27 22:54:25.351046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 352/717] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:25.566098 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dfb74234-54f1-4e8b-b35b-0d885d0830af tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:25.566699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dfb74234-54f1-4e8b-b35b-0d885d0830af tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:25.572671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfb74234-54f1-4e8b-b35b-0d885d0830af tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:25.573110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfb74234-54f1-4e8b-b35b-0d885d0830af tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:25.573858 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfb74234-54f1-4e8b-b35b-0d885d0830af tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:25.574282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfb74234-54f1-4e8b-b35b-0d885d0830af tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:25.698130 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-dfb74234-54f1-4e8b-b35b-0d885d0830af tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:25.705960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dfb74234-54f1-4e8b-b35b-0d885d0830af tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.143687 Jul 27 22:54:25.706522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 366/718] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:25 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:25.903619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-51d7dc5e-3e19-4609-8b7a-5e8f0dc8c649 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:25.905730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-51d7dc5e-3e19-4609-8b7a-5e8f0dc8c649 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:25.912503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51d7dc5e-3e19-4609-8b7a-5e8f0dc8c649 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:25.912982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51d7dc5e-3e19-4609-8b7a-5e8f0dc8c649 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:25.913769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51d7dc5e-3e19-4609-8b7a-5e8f0dc8c649 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:25.914201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51d7dc5e-3e19-4609-8b7a-5e8f0dc8c649 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:25.942614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-51d7dc5e-3e19-4609-8b7a-5e8f0dc8c649 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042987 Jul 27 22:54:25.943676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 353/719] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:25 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:26.043101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-924588c1-f15a-4246-bab1-7d8a7857afe8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:26.043765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-924588c1-f15a-4246-bab1-7d8a7857afe8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:26.050220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-924588c1-f15a-4246-bab1-7d8a7857afe8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:26.050684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-924588c1-f15a-4246-bab1-7d8a7857afe8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:26.051426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-924588c1-f15a-4246-bab1-7d8a7857afe8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:26.051857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-924588c1-f15a-4246-bab1-7d8a7857afe8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:26.179074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-924588c1-f15a-4246-bab1-7d8a7857afe8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:26.186624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-924588c1-f15a-4246-bab1-7d8a7857afe8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 200 len: 1548 microversion: 2.1 time: 0.147292 Jul 27 22:54:26.187180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 367/720] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:26 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:26.206956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-96277cc0-3c81-41f1-a07b-b06601996990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:26.207445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-96277cc0-3c81-41f1-a07b-b06601996990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:26.214080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96277cc0-3c81-41f1-a07b-b06601996990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:26.214532 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96277cc0-3c81-41f1-a07b-b06601996990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:26.215284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96277cc0-3c81-41f1-a07b-b06601996990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:26.215745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96277cc0-3c81-41f1-a07b-b06601996990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:26.293941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-96277cc0-3c81-41f1-a07b-b06601996990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090443 Jul 27 22:54:26.294536 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 354/721] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 22:54:26 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:54:26.371671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-62dd47dc-19bb-49f3-9b4f-8013114085f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:26.372283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-62dd47dc-19bb-49f3-9b4f-8013114085f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:26.378223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-62dd47dc-19bb-49f3-9b4f-8013114085f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:26.378670 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-62dd47dc-19bb-49f3-9b4f-8013114085f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:26.379441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-62dd47dc-19bb-49f3-9b4f-8013114085f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:26.379876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-62dd47dc-19bb-49f3-9b4f-8013114085f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:26.634598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-62dd47dc-19bb-49f3-9b4f-8013114085f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:26.642447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-62dd47dc-19bb-49f3-9b4f-8013114085f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.274666 Jul 27 22:54:26.643014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 368/722] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:26 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:26.728137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bb50348e-2b74-493c-a128-b4bb13b335c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:26.728791 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bb50348e-2b74-493c-a128-b4bb13b335c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:26.734826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb50348e-2b74-493c-a128-b4bb13b335c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:26.735282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb50348e-2b74-493c-a128-b4bb13b335c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:26.736041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb50348e-2b74-493c-a128-b4bb13b335c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:26.736475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb50348e-2b74-493c-a128-b4bb13b335c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:26.786696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=6 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:26.959482 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5dc32c38-9f2b-458a-8122-0d389cc49e18 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:26.961758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5dc32c38-9f2b-458a-8122-0d389cc49e18 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:26.964760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=2 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:26.965549 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=6 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:26.969933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5dc32c38-9f2b-458a-8122-0d389cc49e18 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:26.970381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5dc32c38-9f2b-458a-8122-0d389cc49e18 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:26.971154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5dc32c38-9f2b-458a-8122-0d389cc49e18 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:26.971588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5dc32c38-9f2b-458a-8122-0d389cc49e18 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:26.998496 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:27.003520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5dc32c38-9f2b-458a-8122-0d389cc49e18 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051885 Jul 27 22:54:27.008176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 369/723] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:26 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:27.114231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bb50348e-2b74-493c-a128-b4bb13b335c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:27.122157 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bb50348e-2b74-493c-a128-b4bb13b335c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1714 microversion: 2.1 time: 0.398710 Jul 27 22:54:27.122725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 355/724] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:26 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1714 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:27.189486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f9c5932c-78d4-43a0-aeeb-ad1e287d3f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:27.190083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f9c5932c-78d4-43a0-aeeb-ad1e287d3f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:27.196835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9c5932c-78d4-43a0-aeeb-ad1e287d3f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:27.197342 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9c5932c-78d4-43a0-aeeb-ad1e287d3f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:27.198111 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9c5932c-78d4-43a0-aeeb-ad1e287d3f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:27.198543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9c5932c-78d4-43a0-aeeb-ad1e287d3f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:27.318664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-f9c5932c-78d4-43a0-aeeb-ad1e287d3f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] HTTP exception thrown: Cannot 'detach_volume' instance 9a5ccc96-6331-4ef5-a712-a72739545469 while it is in vm_state rescued Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f9c5932c-78d4-43a0-aeeb-ad1e287d3f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Request method failure captured: Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: DELETE /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments/26fffc9a-7bf7-4c29-be39-0c196ef21f92 HTTP/1.1 Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cDsRp2x8UpNMJ6HnBL-04WjUw31hp5CQUUOuE9hX6DL43I06gDHp83bInXEQLrb4zFa-kZlcoaFH3UrxhEO0ftl3Kz56nR7Tj73l4oReVlfBtLEtyl0TNrPvrewHdkBZTsrykZJENrf-93DZvOEzTZW--OfosHDvz7hDCnuewnIq_c Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: fc02f444ea474300a879336c8b122303 Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1076644021 Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 22:54:27.320257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 22:54:27.321885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fc02f444ea474300a879336c8b122303"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fc02f444ea474300a879336c8b122303", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fc02f444ea474300a879336c8b122303"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fc02f444ea474300a879336c8b122303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 22:54:27.321885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1076644021 Jul 27 22:54:27.321885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: fc02f444ea474300a879336c8b122303 Jul 27 22:54:27.321885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1076644021 Jul 27 22:54:27.321885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-ServerRescueNegativeTestJSON-1076644021-project Jul 27 22:54:27.321885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 22:54:27.321885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 22:54:27.321885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: a5c5f856a38849a39d84b6cd0706da4e Jul 27 22:54:27.321885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1076644021-project Jul 27 22:54:27.321885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 22:54:27.321885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Cannot 'detach_volume' instance 9a5ccc96-6331-4ef5-a712-a72739545469 while it is in vm_state rescued Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'server_id': '9a5ccc96-6331-4ef5-a712-a72739545469', 'id': '26fffc9a-7bf7-4c29-be39-0c196ef21f92'} Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9a5ccc96-6331-4ef5-a712-a72739545469 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 22:54:27.322557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9a5ccc96-6331-4ef5-a712-a72739545469 while it is in vm_state rescued Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9a5ccc96-6331-4ef5-a712-a72739545469 while it is in vm_state rescued Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 22:54:27.323939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f9c5932c-78d4-43a0-aeeb-ad1e287d3f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Returning 409 to user: Cannot 'detach_volume' instance 9a5ccc96-6331-4ef5-a712-a72739545469 while it is in vm_state rescued {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 22:54:27.325132 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f9c5932c-78d4-43a0-aeeb-ad1e287d3f86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments/26fffc9a-7bf7-4c29-be39-0c196ef21f92" status: 409 len: 152 microversion: 2.1 time: 0.136598 Jul 27 22:54:27.325132 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 370/725] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 22:54:27 2022] DELETE /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments/26fffc9a-7bf7-4c29-be39-0c196ef21f92 => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 27 22:54:27.330640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1ddee860-6f51-4bae-9c5f-95d0b56fd8fe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:54:27.331173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1ddee860-6f51-4bae-9c5f-95d0b56fd8fe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:27.337980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ddee860-6f51-4bae-9c5f-95d0b56fd8fe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:27.338499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ddee860-6f51-4bae-9c5f-95d0b56fd8fe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:27.339328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ddee860-6f51-4bae-9c5f-95d0b56fd8fe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:27.339826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ddee860-6f51-4bae-9c5f-95d0b56fd8fe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:27.405800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1ddee860-6f51-4bae-9c5f-95d0b56fd8fe tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "POST /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/action" status: 202 len: 0 microversion: 2.1 time: 0.078754 Jul 27 22:54:27.406551 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 356/726] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 22:54:27 2022] POST /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 22:54:27.415477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2ef0d8a7-b86d-48de-93bf-c787306b45df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:27.416505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2ef0d8a7-b86d-48de-93bf-c787306b45df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:27.425931 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ef0d8a7-b86d-48de-93bf-c787306b45df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:27.426733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ef0d8a7-b86d-48de-93bf-c787306b45df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:27.427552 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ef0d8a7-b86d-48de-93bf-c787306b45df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:27.427978 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ef0d8a7-b86d-48de-93bf-c787306b45df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:27.655294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2ef0d8a7-b86d-48de-93bf-c787306b45df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:27.663611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2ef0d8a7-b86d-48de-93bf-c787306b45df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1722 microversion: 2.1 time: 0.252556 Jul 27 22:54:27.664706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 371/727] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:27 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:27.667705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-44928a48-7fd3-4917-9f4e-b5c160523f8e req-2b5fa7b9-76c6-442c-97ce-1cd60959e42e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f087841-5ab3-42d6-ace3-9288c1ff0059", "tag": "dbb4d703-735b-47ff-a087-f879be275b30"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:54:27.669616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-86e83514-6c3b-4567-b153-7a6339295298 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:27.670532 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-86e83514-6c3b-4567-b153-7a6339295298 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:27.676467 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86e83514-6c3b-4567-b153-7a6339295298 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:27.677117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86e83514-6c3b-4567-b153-7a6339295298 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:27.678083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86e83514-6c3b-4567-b153-7a6339295298 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:27.678258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-44928a48-7fd3-4917-9f4e-b5c160523f8e req-2b5fa7b9-76c6-442c-97ce-1cd60959e42e service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:27.678713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-44928a48-7fd3-4917-9f4e-b5c160523f8e req-2b5fa7b9-76c6-442c-97ce-1cd60959e42e service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:27.678844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86e83514-6c3b-4567-b153-7a6339295298 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:27.690060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-44928a48-7fd3-4917-9f4e-b5c160523f8e req-2b5fa7b9-76c6-442c-97ce-1cd60959e42e service nova] Creating event network-changed:dbb4d703-735b-47ff-a087-f879be275b30 for instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 on hv-cinder-85124 Jul 27 22:54:27.695395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-44928a48-7fd3-4917-9f4e-b5c160523f8e req-2b5fa7b9-76c6-442c-97ce-1cd60959e42e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037004 Jul 27 22:54:27.699073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 357/728] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:54:27.841271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-86e83514-6c3b-4567-b153-7a6339295298 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:27.850417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-86e83514-6c3b-4567-b153-7a6339295298 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.184579 Jul 27 22:54:27.851435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 372/729] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:27 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:28.017261 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f598c14f-0210-41da-a929-833c4454355a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:28.019868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f598c14f-0210-41da-a929-833c4454355a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:28.026269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f598c14f-0210-41da-a929-833c4454355a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:28.026846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f598c14f-0210-41da-a929-833c4454355a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:28.027754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f598c14f-0210-41da-a929-833c4454355a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:28.028290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f598c14f-0210-41da-a929-833c4454355a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:28.063180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f598c14f-0210-41da-a929-833c4454355a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050906 Jul 27 22:54:28.063549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 358/730] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:28 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:28.685755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8bcb2701-eeab-4e50-84ae-4ad46a695d34 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:28.686371 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8bcb2701-eeab-4e50-84ae-4ad46a695d34 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:28.693752 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8bcb2701-eeab-4e50-84ae-4ad46a695d34 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:28.694218 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8bcb2701-eeab-4e50-84ae-4ad46a695d34 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:28.694977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8bcb2701-eeab-4e50-84ae-4ad46a695d34 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:28.695412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8bcb2701-eeab-4e50-84ae-4ad46a695d34 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:28.827589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8bcb2701-eeab-4e50-84ae-4ad46a695d34 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:28.835480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8bcb2701-eeab-4e50-84ae-4ad46a695d34 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1722 microversion: 2.1 time: 0.153599 Jul 27 22:54:28.836034 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 373/731] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:28 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:28.871903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f1a830d2-2430-4d86-aa4b-6ec8c04b236f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:28.872511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f1a830d2-2430-4d86-aa4b-6ec8c04b236f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:28.878455 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f1a830d2-2430-4d86-aa4b-6ec8c04b236f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:28.878895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f1a830d2-2430-4d86-aa4b-6ec8c04b236f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:28.879647 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f1a830d2-2430-4d86-aa4b-6ec8c04b236f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:28.880076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f1a830d2-2430-4d86-aa4b-6ec8c04b236f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:29.020394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f1a830d2-2430-4d86-aa4b-6ec8c04b236f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:29.023888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:29.029320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f1a830d2-2430-4d86-aa4b-6ec8c04b236f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.161227 Jul 27 22:54:29.029885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 359/732] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:28 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:29.074683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fec541ef-f59f-432a-a856-bbab079581cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:29.076986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fec541ef-f59f-432a-a856-bbab079581cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:29.083154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fec541ef-f59f-432a-a856-bbab079581cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:29.083603 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fec541ef-f59f-432a-a856-bbab079581cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:29.084389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fec541ef-f59f-432a-a856-bbab079581cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:29.084853 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fec541ef-f59f-432a-a856-bbab079581cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:29.113757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fec541ef-f59f-432a-a856-bbab079581cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042957 Jul 27 22:54:29.114293 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 374/733] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:29 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:29.856430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3bbb8015-50b3-4f31-a4e6-4052ef87a8f7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:29.856984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3bbb8015-50b3-4f31-a4e6-4052ef87a8f7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:29.864504 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bbb8015-50b3-4f31-a4e6-4052ef87a8f7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:29.864973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bbb8015-50b3-4f31-a4e6-4052ef87a8f7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:29.865724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bbb8015-50b3-4f31-a4e6-4052ef87a8f7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:29.866156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bbb8015-50b3-4f31-a4e6-4052ef87a8f7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:30.002411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3bbb8015-50b3-4f31-a4e6-4052ef87a8f7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:30.010942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3bbb8015-50b3-4f31-a4e6-4052ef87a8f7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1722 microversion: 2.1 time: 0.158389 Jul 27 22:54:30.011510 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 360/734] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:29 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:30.050506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7c2927fb-5565-443f-8e5a-cecbf2c49874 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:30.051157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7c2927fb-5565-443f-8e5a-cecbf2c49874 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:30.058068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7c2927fb-5565-443f-8e5a-cecbf2c49874 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:30.058519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7c2927fb-5565-443f-8e5a-cecbf2c49874 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:30.059276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7c2927fb-5565-443f-8e5a-cecbf2c49874 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:30.059708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7c2927fb-5565-443f-8e5a-cecbf2c49874 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:30.127205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-25986865-62ec-4a1f-a7a2-bf961bda3ddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:30.129309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-25986865-62ec-4a1f-a7a2-bf961bda3ddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:30.137657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25986865-62ec-4a1f-a7a2-bf961bda3ddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:30.138480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25986865-62ec-4a1f-a7a2-bf961bda3ddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:30.139551 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25986865-62ec-4a1f-a7a2-bf961bda3ddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:30.139993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25986865-62ec-4a1f-a7a2-bf961bda3ddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:30.171204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-25986865-62ec-4a1f-a7a2-bf961bda3ddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048222 Jul 27 22:54:30.171885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 361/735] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:54:30.213966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7c2927fb-5565-443f-8e5a-cecbf2c49874 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:30.221899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7c2927fb-5565-443f-8e5a-cecbf2c49874 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.175242 Jul 27 22:54:30.222480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 375/736] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:30 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:31.032433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ce32d03f-9f6d-42d7-a6cf-22c59e1108fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:31.033106 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ce32d03f-9f6d-42d7-a6cf-22c59e1108fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:31.039146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce32d03f-9f6d-42d7-a6cf-22c59e1108fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:31.039593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce32d03f-9f6d-42d7-a6cf-22c59e1108fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:31.040353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce32d03f-9f6d-42d7-a6cf-22c59e1108fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:31.040816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce32d03f-9f6d-42d7-a6cf-22c59e1108fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:31.171804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ce32d03f-9f6d-42d7-a6cf-22c59e1108fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:31.179692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ce32d03f-9f6d-42d7-a6cf-22c59e1108fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1728 microversion: 2.1 time: 0.151090 Jul 27 22:54:31.180816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 362/737] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:31 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:31.184200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-82c2b61c-18e0-4d38-a0e1-2a2a5be138cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:31.186556 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-82c2b61c-18e0-4d38-a0e1-2a2a5be138cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:31.193093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82c2b61c-18e0-4d38-a0e1-2a2a5be138cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:31.193536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82c2b61c-18e0-4d38-a0e1-2a2a5be138cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:31.194301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82c2b61c-18e0-4d38-a0e1-2a2a5be138cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:31.194729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82c2b61c-18e0-4d38-a0e1-2a2a5be138cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:31.200121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2b7439c5-d63e-4f76-98ef-34c3251444d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:31.200700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2b7439c5-d63e-4f76-98ef-34c3251444d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:31.206563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b7439c5-d63e-4f76-98ef-34c3251444d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:31.207002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b7439c5-d63e-4f76-98ef-34c3251444d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:31.207757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b7439c5-d63e-4f76-98ef-34c3251444d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:31.208182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b7439c5-d63e-4f76-98ef-34c3251444d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:31.223336 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-82c2b61c-18e0-4d38-a0e1-2a2a5be138cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044018 Jul 27 22:54:31.224255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 376/738] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:31 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:54:31.243513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-355579e4-d0ed-488f-a9d1-2739f99f3dc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:31.244113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-355579e4-d0ed-488f-a9d1-2739f99f3dc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:31.250204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-355579e4-d0ed-488f-a9d1-2739f99f3dc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:31.250650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-355579e4-d0ed-488f-a9d1-2739f99f3dc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:31.251404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-355579e4-d0ed-488f-a9d1-2739f99f3dc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:31.251829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-355579e4-d0ed-488f-a9d1-2739f99f3dc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:31.288857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2b7439c5-d63e-4f76-98ef-34c3251444d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092403 Jul 27 22:54:31.289982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 363/739] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 22:54:31 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:54:31.397787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-355579e4-d0ed-488f-a9d1-2739f99f3dc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:31.405707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-355579e4-d0ed-488f-a9d1-2739f99f3dc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.166429 Jul 27 22:54:31.406266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 377/740] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:31 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:54:32.235528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-510d4e23-a10c-4236-b000-cecc972246bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:32.237846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-510d4e23-a10c-4236-b000-cecc972246bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:32.244911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-510d4e23-a10c-4236-b000-cecc972246bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:32.245356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-510d4e23-a10c-4236-b000-cecc972246bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:32.246156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-510d4e23-a10c-4236-b000-cecc972246bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:32.246765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-510d4e23-a10c-4236-b000-cecc972246bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:32.279390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-510d4e23-a10c-4236-b000-cecc972246bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047792 Jul 27 22:54:32.284503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 364/741] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:32 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:32.411448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-12ff98cc-efed-4cce-9ac2-4bedee20f148 req-283d56bb-ab6f-49b2-b1f2-82d4a5f22b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a5ccc96-6331-4ef5-a712-a72739545469", "tag": "e522cce6-f90b-46c9-abd8-23ce56eaac03"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:54:32.423092 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-12ff98cc-efed-4cce-9ac2-4bedee20f148 req-283d56bb-ab6f-49b2-b1f2-82d4a5f22b1d service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:32.423527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-12ff98cc-efed-4cce-9ac2-4bedee20f148 req-283d56bb-ab6f-49b2-b1f2-82d4a5f22b1d service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:32.429071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-35dec13b-1445-4e1c-879f-b3eb6cda7334 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:32.430283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-35dec13b-1445-4e1c-879f-b3eb6cda7334 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:32.437503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35dec13b-1445-4e1c-879f-b3eb6cda7334 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:32.438423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35dec13b-1445-4e1c-879f-b3eb6cda7334 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:32.439106 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35dec13b-1445-4e1c-879f-b3eb6cda7334 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:32.439541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35dec13b-1445-4e1c-879f-b3eb6cda7334 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:32.442847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-12ff98cc-efed-4cce-9ac2-4bedee20f148 req-283d56bb-ab6f-49b2-b1f2-82d4a5f22b1d service nova] Creating event network-changed:e522cce6-f90b-46c9-abd8-23ce56eaac03 for instance 9a5ccc96-6331-4ef5-a712-a72739545469 on hv-cinder-85124 Jul 27 22:54:32.448543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-12ff98cc-efed-4cce-9ac2-4bedee20f148 req-283d56bb-ab6f-49b2-b1f2-82d4a5f22b1d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040690 Jul 27 22:54:32.449431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 378/742] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:54:32.599975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-35dec13b-1445-4e1c-879f-b3eb6cda7334 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:32.609251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-35dec13b-1445-4e1c-879f-b3eb6cda7334 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1754 microversion: 2.1 time: 0.185899 Jul 27 22:54:32.609960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 365/743] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:32 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1754 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:33.292651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3053a0be-3516-4a12-a094-2013abf865e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:33.294966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3053a0be-3516-4a12-a094-2013abf865e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:33.301196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3053a0be-3516-4a12-a094-2013abf865e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:33.301645 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3053a0be-3516-4a12-a094-2013abf865e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:33.302407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3053a0be-3516-4a12-a094-2013abf865e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:33.302843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3053a0be-3516-4a12-a094-2013abf865e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:33.331877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3053a0be-3516-4a12-a094-2013abf865e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044226 Jul 27 22:54:33.332611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 379/744] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:33.630988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0008430f-de65-4c6d-91ff-c367eda2ffd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:33.631636 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0008430f-de65-4c6d-91ff-c367eda2ffd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:33.638272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0008430f-de65-4c6d-91ff-c367eda2ffd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:33.638714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0008430f-de65-4c6d-91ff-c367eda2ffd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:33.639467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0008430f-de65-4c6d-91ff-c367eda2ffd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:33.639901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0008430f-de65-4c6d-91ff-c367eda2ffd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:33.778663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0008430f-de65-4c6d-91ff-c367eda2ffd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:54:33.786569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0008430f-de65-4c6d-91ff-c367eda2ffd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1757 microversion: 2.1 time: 0.159447 Jul 27 22:54:33.787128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 366/745] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:54:33 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:54:34.344369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4f37a9a7-1675-47ba-9f09-1b1009eaae99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:34.346549 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4f37a9a7-1675-47ba-9f09-1b1009eaae99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:34.353635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4f37a9a7-1675-47ba-9f09-1b1009eaae99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:34.354113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4f37a9a7-1675-47ba-9f09-1b1009eaae99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:34.354814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4f37a9a7-1675-47ba-9f09-1b1009eaae99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:34.355240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4f37a9a7-1675-47ba-9f09-1b1009eaae99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:34.383356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4f37a9a7-1675-47ba-9f09-1b1009eaae99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042851 Jul 27 22:54:34.383890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 380/746] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:34 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:34.464287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-332856d5-2aee-4298-aa94-b2333a729fd1 req-700af8f2-a803-40ea-95d9-b434c98b7bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a5ccc96-6331-4ef5-a712-a72739545469", "tag": "e522cce6-f90b-46c9-abd8-23ce56eaac03"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:54:34.473521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-332856d5-2aee-4298-aa94-b2333a729fd1 req-700af8f2-a803-40ea-95d9-b434c98b7bc5 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:34.473951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-332856d5-2aee-4298-aa94-b2333a729fd1 req-700af8f2-a803-40ea-95d9-b434c98b7bc5 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:34.485896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-332856d5-2aee-4298-aa94-b2333a729fd1 req-700af8f2-a803-40ea-95d9-b434c98b7bc5 service nova] Creating event network-changed:e522cce6-f90b-46c9-abd8-23ce56eaac03 for instance 9a5ccc96-6331-4ef5-a712-a72739545469 on hv-cinder-85124 Jul 27 22:54:34.490793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-332856d5-2aee-4298-aa94-b2333a729fd1 req-700af8f2-a803-40ea-95d9-b434c98b7bc5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030474 Jul 27 22:54:34.491754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 367/747] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:54:35.395163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b7c33019-f691-4795-9af4-0267f99533dc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:35.397303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b7c33019-f691-4795-9af4-0267f99533dc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:35.404186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7c33019-f691-4795-9af4-0267f99533dc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:35.404672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7c33019-f691-4795-9af4-0267f99533dc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:35.405443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7c33019-f691-4795-9af4-0267f99533dc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:35.405878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7c33019-f691-4795-9af4-0267f99533dc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:35.434276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b7c33019-f691-4795-9af4-0267f99533dc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043061 Jul 27 22:54:35.434817 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 381/748] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:36.447284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bc05fad4-d269-48da-b710-c92dc6c6a834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:36.449578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bc05fad4-d269-48da-b710-c92dc6c6a834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:36.455690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bc05fad4-d269-48da-b710-c92dc6c6a834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:36.456132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bc05fad4-d269-48da-b710-c92dc6c6a834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:36.456915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bc05fad4-d269-48da-b710-c92dc6c6a834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:36.457335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bc05fad4-d269-48da-b710-c92dc6c6a834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:36.485441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bc05fad4-d269-48da-b710-c92dc6c6a834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042914 Jul 27 22:54:36.485967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 368/749] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:37.498034 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a73e3784-36d1-48f7-96e3-424d667d0ca3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:37.500356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a73e3784-36d1-48f7-96e3-424d667d0ca3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:37.507105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a73e3784-36d1-48f7-96e3-424d667d0ca3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:37.507542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a73e3784-36d1-48f7-96e3-424d667d0ca3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:37.508320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a73e3784-36d1-48f7-96e3-424d667d0ca3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:37.508772 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a73e3784-36d1-48f7-96e3-424d667d0ca3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:37.536810 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a73e3784-36d1-48f7-96e3-424d667d0ca3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043184 Jul 27 22:54:37.537342 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 382/750] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:38.549337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b2fdd635-0307-4079-9213-7ac6ff0d89b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:38.551517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b2fdd635-0307-4079-9213-7ac6ff0d89b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:38.557648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2fdd635-0307-4079-9213-7ac6ff0d89b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:38.558093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2fdd635-0307-4079-9213-7ac6ff0d89b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:38.558849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2fdd635-0307-4079-9213-7ac6ff0d89b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:38.559280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2fdd635-0307-4079-9213-7ac6ff0d89b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:38.588354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b2fdd635-0307-4079-9213-7ac6ff0d89b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042949 Jul 27 22:54:38.588925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 369/751] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:38 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:39.600530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5f1c3078-d9b4-4324-b8f3-d0c683318c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:39.603044 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5f1c3078-d9b4-4324-b8f3-d0c683318c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:39.605491 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:39.611025 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f1c3078-d9b4-4324-b8f3-d0c683318c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:39.611565 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f1c3078-d9b4-4324-b8f3-d0c683318c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:39.612214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f1c3078-d9b4-4324-b8f3-d0c683318c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:39.612672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f1c3078-d9b4-4324-b8f3-d0c683318c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:39.641239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5f1c3078-d9b4-4324-b8f3-d0c683318c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044658 Jul 27 22:54:39.641775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 383/752] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:40.652521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-55baa55a-2e07-40c8-99c5-cbfb9d09be6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:40.654654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-55baa55a-2e07-40c8-99c5-cbfb9d09be6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:40.656708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:40.662002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55baa55a-2e07-40c8-99c5-cbfb9d09be6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:40.662445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55baa55a-2e07-40c8-99c5-cbfb9d09be6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:40.663193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55baa55a-2e07-40c8-99c5-cbfb9d09be6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:40.663621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55baa55a-2e07-40c8-99c5-cbfb9d09be6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:40.692338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-55baa55a-2e07-40c8-99c5-cbfb9d09be6f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043725 Jul 27 22:54:40.692902 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 370/753] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:41.705162 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-677595c2-3f17-4878-9eda-71a7778b2e3b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:41.707259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-677595c2-3f17-4878-9eda-71a7778b2e3b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:41.714325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-677595c2-3f17-4878-9eda-71a7778b2e3b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:41.714768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-677595c2-3f17-4878-9eda-71a7778b2e3b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:41.715527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-677595c2-3f17-4878-9eda-71a7778b2e3b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:41.715959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-677595c2-3f17-4878-9eda-71a7778b2e3b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:41.744112 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-677595c2-3f17-4878-9eda-71a7778b2e3b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042892 Jul 27 22:54:41.744742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 384/754] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:42.755620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c50f8d1a-6fd7-458b-b3b9-bc5f44ad8118 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:42.757789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c50f8d1a-6fd7-458b-b3b9-bc5f44ad8118 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:42.763924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c50f8d1a-6fd7-458b-b3b9-bc5f44ad8118 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:42.764364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c50f8d1a-6fd7-458b-b3b9-bc5f44ad8118 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:42.765146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c50f8d1a-6fd7-458b-b3b9-bc5f44ad8118 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:42.765571 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c50f8d1a-6fd7-458b-b3b9-bc5f44ad8118 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:42.794574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c50f8d1a-6fd7-458b-b3b9-bc5f44ad8118 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042953 Jul 27 22:54:42.795112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 371/755] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:43.806921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ce88d67f-ebcf-4859-82ec-a3dc77cafc50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:43.809093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ce88d67f-ebcf-4859-82ec-a3dc77cafc50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:43.815513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce88d67f-ebcf-4859-82ec-a3dc77cafc50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:43.815955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce88d67f-ebcf-4859-82ec-a3dc77cafc50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:43.816742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce88d67f-ebcf-4859-82ec-a3dc77cafc50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:43.817173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce88d67f-ebcf-4859-82ec-a3dc77cafc50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:43.845953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ce88d67f-ebcf-4859-82ec-a3dc77cafc50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043006 Jul 27 22:54:43.846488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 385/756] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:44.858452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-088b59c3-ebd3-4eed-b4a7-b0e1daad10cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:44.860577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-088b59c3-ebd3-4eed-b4a7-b0e1daad10cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:44.866622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-088b59c3-ebd3-4eed-b4a7-b0e1daad10cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:44.867061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-088b59c3-ebd3-4eed-b4a7-b0e1daad10cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:44.867827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-088b59c3-ebd3-4eed-b4a7-b0e1daad10cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:44.868235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-088b59c3-ebd3-4eed-b4a7-b0e1daad10cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:44.896792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-088b59c3-ebd3-4eed-b4a7-b0e1daad10cc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042311 Jul 27 22:54:44.897257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 372/757] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:44 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:45.909601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-23f60dc8-7890-44f5-8937-4353ec2b62fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:45.911701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-23f60dc8-7890-44f5-8937-4353ec2b62fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:45.918728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23f60dc8-7890-44f5-8937-4353ec2b62fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:45.919181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23f60dc8-7890-44f5-8937-4353ec2b62fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:45.919941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23f60dc8-7890-44f5-8937-4353ec2b62fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:45.920377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23f60dc8-7890-44f5-8937-4353ec2b62fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:45.948074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-23f60dc8-7890-44f5-8937-4353ec2b62fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042531 Jul 27 22:54:45.948634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 386/758] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:45 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:46.960517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e697fa33-a34c-4315-8ffb-c2acb33ba359 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:46.962602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e697fa33-a34c-4315-8ffb-c2acb33ba359 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:46.968618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e697fa33-a34c-4315-8ffb-c2acb33ba359 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:46.969061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e697fa33-a34c-4315-8ffb-c2acb33ba359 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:46.969824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e697fa33-a34c-4315-8ffb-c2acb33ba359 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:46.970259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e697fa33-a34c-4315-8ffb-c2acb33ba359 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:46.999677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e697fa33-a34c-4315-8ffb-c2acb33ba359 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043179 Jul 27 22:54:47.000220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 373/759] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:48.012651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b0e9b1d6-2bfd-4627-9a26-e5f9bd11b4f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:48.014733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b0e9b1d6-2bfd-4627-9a26-e5f9bd11b4f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:48.021316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b0e9b1d6-2bfd-4627-9a26-e5f9bd11b4f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:48.021760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b0e9b1d6-2bfd-4627-9a26-e5f9bd11b4f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:48.022515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b0e9b1d6-2bfd-4627-9a26-e5f9bd11b4f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:48.022948 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b0e9b1d6-2bfd-4627-9a26-e5f9bd11b4f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:48.026536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:48.052283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b0e9b1d6-2bfd-4627-9a26-e5f9bd11b4f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044292 Jul 27 22:54:48.052867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 387/760] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:48 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:49.065301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7a4a64db-5164-4906-9e6c-673aec2018d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:49.067454 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7a4a64db-5164-4906-9e6c-673aec2018d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:49.074122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a4a64db-5164-4906-9e6c-673aec2018d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:49.074565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a4a64db-5164-4906-9e6c-673aec2018d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:49.075319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a4a64db-5164-4906-9e6c-673aec2018d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:49.075750 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a4a64db-5164-4906-9e6c-673aec2018d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:49.104041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7a4a64db-5164-4906-9e6c-673aec2018d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042717 Jul 27 22:54:49.104594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 374/761] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:49 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:50.115799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-47829cba-23ac-4969-857f-6c21fe851c68 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:50.117885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-47829cba-23ac-4969-857f-6c21fe851c68 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:50.124019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-47829cba-23ac-4969-857f-6c21fe851c68 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:50.124459 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-47829cba-23ac-4969-857f-6c21fe851c68 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:50.125241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-47829cba-23ac-4969-857f-6c21fe851c68 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:50.125669 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-47829cba-23ac-4969-857f-6c21fe851c68 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:50.159438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-47829cba-23ac-4969-857f-6c21fe851c68 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047611 Jul 27 22:54:50.159999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 388/762] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:50 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:51.171453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c872d998-ab68-4823-92de-56ed1b9c8c8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:51.173648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c872d998-ab68-4823-92de-56ed1b9c8c8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:51.179705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c872d998-ab68-4823-92de-56ed1b9c8c8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:51.180148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c872d998-ab68-4823-92de-56ed1b9c8c8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:51.181444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c872d998-ab68-4823-92de-56ed1b9c8c8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:51.181881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c872d998-ab68-4823-92de-56ed1b9c8c8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:51.210499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c872d998-ab68-4823-92de-56ed1b9c8c8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043027 Jul 27 22:54:51.211048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 375/763] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:51 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:52.222862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-01034673-a8ae-461f-86a8-d1727a6cca69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:52.225099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-01034673-a8ae-461f-86a8-d1727a6cca69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:52.232245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01034673-a8ae-461f-86a8-d1727a6cca69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:52.232727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01034673-a8ae-461f-86a8-d1727a6cca69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:52.233483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01034673-a8ae-461f-86a8-d1727a6cca69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:52.233915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01034673-a8ae-461f-86a8-d1727a6cca69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:52.263190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-01034673-a8ae-461f-86a8-d1727a6cca69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044306 Jul 27 22:54:52.263733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 389/764] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:52 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:53.275786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-14befff4-035d-4e1f-8010-c2367d3fd450 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:53.277865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-14befff4-035d-4e1f-8010-c2367d3fd450 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:53.283834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14befff4-035d-4e1f-8010-c2367d3fd450 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:53.284278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14befff4-035d-4e1f-8010-c2367d3fd450 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:53.285060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14befff4-035d-4e1f-8010-c2367d3fd450 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:53.285492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14befff4-035d-4e1f-8010-c2367d3fd450 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:53.313606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-14befff4-035d-4e1f-8010-c2367d3fd450 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042130 Jul 27 22:54:53.314160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 376/765] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:53 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:54.326559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-392c310e-025c-4c73-9eda-f4b468a2017d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:54.328729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-392c310e-025c-4c73-9eda-f4b468a2017d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:54.335223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-392c310e-025c-4c73-9eda-f4b468a2017d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:54.335669 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-392c310e-025c-4c73-9eda-f4b468a2017d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:54.336468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-392c310e-025c-4c73-9eda-f4b468a2017d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:54.336932 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-392c310e-025c-4c73-9eda-f4b468a2017d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:54.365624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-392c310e-025c-4c73-9eda-f4b468a2017d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043661 Jul 27 22:54:54.366174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 390/766] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:54 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:55.378327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e52a9766-6e1e-4403-b06f-fbd04324ed9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:55.380419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e52a9766-6e1e-4403-b06f-fbd04324ed9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:55.386436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e52a9766-6e1e-4403-b06f-fbd04324ed9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:55.386874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e52a9766-6e1e-4403-b06f-fbd04324ed9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:55.387621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e52a9766-6e1e-4403-b06f-fbd04324ed9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:55.388048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e52a9766-6e1e-4403-b06f-fbd04324ed9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:55.403785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:55.417038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e52a9766-6e1e-4403-b06f-fbd04324ed9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042618 Jul 27 22:54:55.417515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 377/767] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:55 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:56.428854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ecda8704-596f-4d12-b8aa-cd835296e2eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:56.430986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ecda8704-596f-4d12-b8aa-cd835296e2eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:56.437393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ecda8704-596f-4d12-b8aa-cd835296e2eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:56.437837 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ecda8704-596f-4d12-b8aa-cd835296e2eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:56.438594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ecda8704-596f-4d12-b8aa-cd835296e2eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:56.439022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ecda8704-596f-4d12-b8aa-cd835296e2eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:56.467743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ecda8704-596f-4d12-b8aa-cd835296e2eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042964 Jul 27 22:54:56.468289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 391/768] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:57.480193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4073564e-5de1-4c6b-a6bc-a15279e1628e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:57.482341 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4073564e-5de1-4c6b-a6bc-a15279e1628e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:57.488394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4073564e-5de1-4c6b-a6bc-a15279e1628e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:57.488882 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4073564e-5de1-4c6b-a6bc-a15279e1628e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:57.489636 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4073564e-5de1-4c6b-a6bc-a15279e1628e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:57.490045 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4073564e-5de1-4c6b-a6bc-a15279e1628e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:57.518360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4073564e-5de1-4c6b-a6bc-a15279e1628e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042888 Jul 27 22:54:57.518831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 378/769] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:57 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:58.530772 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-50132474-1b41-449b-a38f-f8d6c8919d54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:58.532921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-50132474-1b41-449b-a38f-f8d6c8919d54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:58.539751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50132474-1b41-449b-a38f-f8d6c8919d54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:58.540197 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50132474-1b41-449b-a38f-f8d6c8919d54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:58.540990 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50132474-1b41-449b-a38f-f8d6c8919d54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:58.541447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50132474-1b41-449b-a38f-f8d6c8919d54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:58.569697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-50132474-1b41-449b-a38f-f8d6c8919d54 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042904 Jul 27 22:54:58.570229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 392/770] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:54:59.582016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c82f972e-e15e-4058-9eec-3a8a86d19496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:54:59.584154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c82f972e-e15e-4058-9eec-3a8a86d19496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:54:59.590212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c82f972e-e15e-4058-9eec-3a8a86d19496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:59.590656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c82f972e-e15e-4058-9eec-3a8a86d19496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:59.591408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c82f972e-e15e-4058-9eec-3a8a86d19496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:54:59.591843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c82f972e-e15e-4058-9eec-3a8a86d19496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:54:59.621102 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c82f972e-e15e-4058-9eec-3a8a86d19496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043077 Jul 27 22:54:59.621631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 379/771] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:54:59 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:00.632758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-724404f3-e436-48df-9e01-b268c9d878ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:00.634905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-724404f3-e436-48df-9e01-b268c9d878ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:00.641846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-724404f3-e436-48df-9e01-b268c9d878ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:00.642272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-724404f3-e436-48df-9e01-b268c9d878ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:00.643027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-724404f3-e436-48df-9e01-b268c9d878ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:00.643457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-724404f3-e436-48df-9e01-b268c9d878ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:00.671662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-724404f3-e436-48df-9e01-b268c9d878ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042913 Jul 27 22:55:00.672205 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 393/772] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:00 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:01.683818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5f998811-2d62-4853-be6f-fedc18487a6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:01.685967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5f998811-2d62-4853-be6f-fedc18487a6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:01.691918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f998811-2d62-4853-be6f-fedc18487a6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:01.692354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f998811-2d62-4853-be6f-fedc18487a6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:01.693125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f998811-2d62-4853-be6f-fedc18487a6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:01.693553 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f998811-2d62-4853-be6f-fedc18487a6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:01.721654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5f998811-2d62-4853-be6f-fedc18487a6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041783 Jul 27 22:55:01.722188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 380/773] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:01 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:02.734708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d7ae095e-bcb9-47fd-a7d4-6274b737a6af tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:02.736887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d7ae095e-bcb9-47fd-a7d4-6274b737a6af tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:02.743294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7ae095e-bcb9-47fd-a7d4-6274b737a6af tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:02.743732 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7ae095e-bcb9-47fd-a7d4-6274b737a6af tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:02.745142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7ae095e-bcb9-47fd-a7d4-6274b737a6af tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:02.745599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7ae095e-bcb9-47fd-a7d4-6274b737a6af tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:02.774919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d7ae095e-bcb9-47fd-a7d4-6274b737a6af tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044113 Jul 27 22:55:02.775464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 394/774] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:02 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:03.658776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b4937429-8a98-434e-bd5a-69727c94852e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:03.659256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b4937429-8a98-434e-bd5a-69727c94852e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:03.665183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b4937429-8a98-434e-bd5a-69727c94852e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:03.665629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b4937429-8a98-434e-bd5a-69727c94852e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:03.666404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b4937429-8a98-434e-bd5a-69727c94852e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:03.666838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b4937429-8a98-434e-bd5a-69727c94852e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:03.689196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b4937429-8a98-434e-bd5a-69727c94852e tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059/ips" status: 200 len: 145 microversion: 2.1 time: 0.034228 Jul 27 22:55:03.689733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 381/775] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 22:55:03 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059/ips => generated 145 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:03.787089 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5602af36-2dc7-41cd-a198-b7fd055ce804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:03.789398 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5602af36-2dc7-41cd-a198-b7fd055ce804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:03.796004 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5602af36-2dc7-41cd-a198-b7fd055ce804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:03.796452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5602af36-2dc7-41cd-a198-b7fd055ce804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:03.797245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5602af36-2dc7-41cd-a198-b7fd055ce804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:03.797675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5602af36-2dc7-41cd-a198-b7fd055ce804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:03.828944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5602af36-2dc7-41cd-a198-b7fd055ce804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045611 Jul 27 22:55:03.829441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 395/776] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:04.841846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3f951eec-8cf9-4b23-8e72-2601c493c1d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:04.843964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3f951eec-8cf9-4b23-8e72-2601c493c1d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:04.849927 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f951eec-8cf9-4b23-8e72-2601c493c1d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:04.850402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f951eec-8cf9-4b23-8e72-2601c493c1d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:04.851400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f951eec-8cf9-4b23-8e72-2601c493c1d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:04.851826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f951eec-8cf9-4b23-8e72-2601c493c1d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:04.880787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3f951eec-8cf9-4b23-8e72-2601c493c1d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043329 Jul 27 22:55:04.881340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 382/777] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:04 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:05.893398 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0738e4fb-b4d7-4eeb-908e-781a4f90ee10 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:05.895422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0738e4fb-b4d7-4eeb-908e-781a4f90ee10 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:05.902274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0738e4fb-b4d7-4eeb-908e-781a4f90ee10 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:05.902711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0738e4fb-b4d7-4eeb-908e-781a4f90ee10 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:05.903458 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0738e4fb-b4d7-4eeb-908e-781a4f90ee10 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:05.903891 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0738e4fb-b4d7-4eeb-908e-781a4f90ee10 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:05.931752 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0738e4fb-b4d7-4eeb-908e-781a4f90ee10 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042519 Jul 27 22:55:05.932282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 396/778] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:05 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:06.944042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6bce3c1d-2ff5-4307-bc8b-dbc8c080def9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:06.946205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6bce3c1d-2ff5-4307-bc8b-dbc8c080def9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:06.952841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bce3c1d-2ff5-4307-bc8b-dbc8c080def9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:06.953276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bce3c1d-2ff5-4307-bc8b-dbc8c080def9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:06.954019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bce3c1d-2ff5-4307-bc8b-dbc8c080def9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:06.954445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bce3c1d-2ff5-4307-bc8b-dbc8c080def9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:06.982849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6bce3c1d-2ff5-4307-bc8b-dbc8c080def9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042746 Jul 27 22:55:06.983385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 383/779] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:07.995835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f9c821e0-353f-4528-beca-4c918efd1969 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:07.997988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f9c821e0-353f-4528-beca-4c918efd1969 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:08.004402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9c821e0-353f-4528-beca-4c918efd1969 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:08.004880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9c821e0-353f-4528-beca-4c918efd1969 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:08.005666 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9c821e0-353f-4528-beca-4c918efd1969 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:08.006099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9c821e0-353f-4528-beca-4c918efd1969 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:08.034454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f9c821e0-353f-4528-beca-4c918efd1969 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043446 Jul 27 22:55:08.035006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 397/780] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:07 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:09.048398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e3c68e56-d112-4486-85c2-e60aaf95c1cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:09.050592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e3c68e56-d112-4486-85c2-e60aaf95c1cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:09.056693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3c68e56-d112-4486-85c2-e60aaf95c1cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:09.057649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3c68e56-d112-4486-85c2-e60aaf95c1cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:09.058410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3c68e56-d112-4486-85c2-e60aaf95c1cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:09.058845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3c68e56-d112-4486-85c2-e60aaf95c1cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:09.087468 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e3c68e56-d112-4486-85c2-e60aaf95c1cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044792 Jul 27 22:55:09.088009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 384/781] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:09 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:10.099624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-89cf0cff-8c93-4530-b8c0-7dfbd5836851 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:10.102370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-89cf0cff-8c93-4530-b8c0-7dfbd5836851 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:10.104851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=30 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:10.110035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89cf0cff-8c93-4530-b8c0-7dfbd5836851 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:10.110473 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89cf0cff-8c93-4530-b8c0-7dfbd5836851 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:10.111346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89cf0cff-8c93-4530-b8c0-7dfbd5836851 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:10.111773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89cf0cff-8c93-4530-b8c0-7dfbd5836851 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:10.140838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-89cf0cff-8c93-4530-b8c0-7dfbd5836851 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045169 Jul 27 22:55:10.141384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 398/782] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:10 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:10.233715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fdc4c8aa-1978-4273-8a6b-d2e199c37ef0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:10.234246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fdc4c8aa-1978-4273-8a6b-d2e199c37ef0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:10.243799 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fdc4c8aa-1978-4273-8a6b-d2e199c37ef0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:10.244637 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fdc4c8aa-1978-4273-8a6b-d2e199c37ef0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:10.245932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fdc4c8aa-1978-4273-8a6b-d2e199c37ef0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:10.246379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fdc4c8aa-1978-4273-8a6b-d2e199c37ef0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:10.324412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.objects.instance [None req-fdc4c8aa-1978-4273-8a6b-d2e199c37ef0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lazy-loading 'services' on Instance uuid 9a5ccc96-6331-4ef5-a712-a72739545469 {{(pid=129295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:55:10.393815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fdc4c8aa-1978-4273-8a6b-d2e199c37ef0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments/26fffc9a-7bf7-4c29-be39-0c196ef21f92" status: 202 len: 0 microversion: 2.1 time: 0.163786 Jul 27 22:55:10.394385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 385/783] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 22:55:10 2022] DELETE /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments/26fffc9a-7bf7-4c29-be39-0c196ef21f92 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 22:55:10.404026 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bc5a70ef-66b2-4f4e-a082-bbf594497902 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:10.406230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bc5a70ef-66b2-4f4e-a082-bbf594497902 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:10.412711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bc5a70ef-66b2-4f4e-a082-bbf594497902 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:10.413236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bc5a70ef-66b2-4f4e-a082-bbf594497902 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:10.414133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bc5a70ef-66b2-4f4e-a082-bbf594497902 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:10.415179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bc5a70ef-66b2-4f4e-a082-bbf594497902 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:10.445445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bc5a70ef-66b2-4f4e-a082-bbf594497902 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046541 Jul 27 22:55:10.446051 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 399/784] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:10 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:11.154251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cd7b67b2-1802-4a80-9125-8412e040f591 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:11.156687 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cd7b67b2-1802-4a80-9125-8412e040f591 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:11.158752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=32 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:11.164571 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd7b67b2-1802-4a80-9125-8412e040f591 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:11.169111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd7b67b2-1802-4a80-9125-8412e040f591 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:11.169111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd7b67b2-1802-4a80-9125-8412e040f591 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:11.169111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd7b67b2-1802-4a80-9125-8412e040f591 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:11.196322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cd7b67b2-1802-4a80-9125-8412e040f591 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047034 Jul 27 22:55:11.196908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 386/785] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:11 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:11.460678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2a8cd98d-b8fa-49c3-b8ae-b6138704d142 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:11.462806 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2a8cd98d-b8fa-49c3-b8ae-b6138704d142 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:11.469404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a8cd98d-b8fa-49c3-b8ae-b6138704d142 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:11.469846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a8cd98d-b8fa-49c3-b8ae-b6138704d142 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:11.470599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a8cd98d-b8fa-49c3-b8ae-b6138704d142 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:11.471023 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a8cd98d-b8fa-49c3-b8ae-b6138704d142 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:11.502343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2a8cd98d-b8fa-49c3-b8ae-b6138704d142 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047644 Jul 27 22:55:11.502894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 400/786] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:11 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:12.209170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-268e52fe-941f-4b35-ae5c-b0670ec408ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:12.211338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-268e52fe-941f-4b35-ae5c-b0670ec408ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:12.217316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-268e52fe-941f-4b35-ae5c-b0670ec408ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:12.217761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-268e52fe-941f-4b35-ae5c-b0670ec408ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:12.218513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-268e52fe-941f-4b35-ae5c-b0670ec408ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:12.218951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-268e52fe-941f-4b35-ae5c-b0670ec408ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:12.247389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-268e52fe-941f-4b35-ae5c-b0670ec408ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042246 Jul 27 22:55:12.247934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 387/787] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:12.515227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b434adaf-14bb-482f-a8d4-5e724267fbec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:12.517461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b434adaf-14bb-482f-a8d4-5e724267fbec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:12.523833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b434adaf-14bb-482f-a8d4-5e724267fbec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:12.524280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b434adaf-14bb-482f-a8d4-5e724267fbec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:12.525076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b434adaf-14bb-482f-a8d4-5e724267fbec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:12.525510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b434adaf-14bb-482f-a8d4-5e724267fbec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:12.554372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b434adaf-14bb-482f-a8d4-5e724267fbec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043079 Jul 27 22:55:12.554931 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 401/788] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:12 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:12.845900 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f0b64db7-daef-4442-a1ce-83962c65e1b9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-917796438"}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:55:12.846433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f0b64db7-daef-4442-a1ce-83962c65e1b9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:12.852764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f0b64db7-daef-4442-a1ce-83962c65e1b9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:12.853211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f0b64db7-daef-4442-a1ce-83962c65e1b9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:12.854620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f0b64db7-daef-4442-a1ce-83962c65e1b9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:12.855050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f0b64db7-daef-4442-a1ce-83962c65e1b9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:12.977834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.network.security_group_api [None req-f0b64db7-daef-4442-a1ce-83962c65e1b9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Removing security group 4d4f050d-f3b1-476a-b617-0127b6d9078e from port ea3daece-2ad0-4979-adb0-cba646786ccc Jul 27 22:55:13.259470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-721f7916-029f-4ce4-b46e-46ca20f7d045 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:13.262095 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-721f7916-029f-4ce4-b46e-46ca20f7d045 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:13.268247 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-721f7916-029f-4ce4-b46e-46ca20f7d045 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:13.268933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-721f7916-029f-4ce4-b46e-46ca20f7d045 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:13.269838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-721f7916-029f-4ce4-b46e-46ca20f7d045 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:13.270329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-721f7916-029f-4ce4-b46e-46ca20f7d045 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:13.303555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-721f7916-029f-4ce4-b46e-46ca20f7d045 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048009 Jul 27 22:55:13.304683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 402/789] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:55:13.317666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f0b64db7-daef-4442-a1ce-83962c65e1b9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "POST /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/action" status: 202 len: 0 microversion: 2.1 time: 0.475647 Jul 27 22:55:13.318262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 388/790] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 22:55:12 2022] POST /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 22:55:13.329300 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-7df10ace-94b0-438a-91ec-f653f9f835e5 req-b4db6935-8369-4238-9c71-a4bd3d906716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a6fc53-bd93-47c4-9413-39ba0e1b6068", "tag": "ea3daece-2ad0-4979-adb0-cba646786ccc"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:55:13.341774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-7df10ace-94b0-438a-91ec-f653f9f835e5 req-b4db6935-8369-4238-9c71-a4bd3d906716 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:13.342906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-7df10ace-94b0-438a-91ec-f653f9f835e5 req-b4db6935-8369-4238-9c71-a4bd3d906716 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:13.359133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-7df10ace-94b0-438a-91ec-f653f9f835e5 req-b4db6935-8369-4238-9c71-a4bd3d906716 service nova] Creating event network-changed:ea3daece-2ad0-4979-adb0-cba646786ccc for instance 69a6fc53-bd93-47c4-9413-39ba0e1b6068 on hv-cinder-85124 Jul 27 22:55:13.364498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-7df10ace-94b0-438a-91ec-f653f9f835e5 req-b4db6935-8369-4238-9c71-a4bd3d906716 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039210 Jul 27 22:55:13.368060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 403/791] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:13.567128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-18b450f3-78df-4fda-9e15-e64129e2fe16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:13.569334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-18b450f3-78df-4fda-9e15-e64129e2fe16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:13.577251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18b450f3-78df-4fda-9e15-e64129e2fe16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:13.577950 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18b450f3-78df-4fda-9e15-e64129e2fe16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:13.579212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18b450f3-78df-4fda-9e15-e64129e2fe16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:13.579851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18b450f3-78df-4fda-9e15-e64129e2fe16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:13.614583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-18b450f3-78df-4fda-9e15-e64129e2fe16 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051176 Jul 27 22:55:13.620788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 389/792] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:13 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:14.316762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cac100cf-1d7f-4e13-bee0-74857823a8ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:14.319098 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cac100cf-1d7f-4e13-bee0-74857823a8ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:14.326191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cac100cf-1d7f-4e13-bee0-74857823a8ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:14.326641 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cac100cf-1d7f-4e13-bee0-74857823a8ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:14.327412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cac100cf-1d7f-4e13-bee0-74857823a8ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:14.327840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cac100cf-1d7f-4e13-bee0-74857823a8ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:14.345765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:14.361427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cac100cf-1d7f-4e13-bee0-74857823a8ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048942 Jul 27 22:55:14.362010 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 404/793] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:14 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:14.627496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-17164bdd-dae3-4681-bfcf-088904995ce6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:14.629615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-17164bdd-dae3-4681-bfcf-088904995ce6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:14.635935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17164bdd-dae3-4681-bfcf-088904995ce6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:14.636376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17164bdd-dae3-4681-bfcf-088904995ce6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:14.637208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17164bdd-dae3-4681-bfcf-088904995ce6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:14.637636 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17164bdd-dae3-4681-bfcf-088904995ce6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:14.675123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-17164bdd-dae3-4681-bfcf-088904995ce6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051526 Jul 27 22:55:14.675926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 390/794] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:14 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:14.697764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e76dbcf8-64b1-44c5-a74e-fa6c51550c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:14.698244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e76dbcf8-64b1-44c5-a74e-fa6c51550c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:14.704185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e76dbcf8-64b1-44c5-a74e-fa6c51550c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:14.704672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e76dbcf8-64b1-44c5-a74e-fa6c51550c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:14.705407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e76dbcf8-64b1-44c5-a74e-fa6c51550c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:14.705834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e76dbcf8-64b1-44c5-a74e-fa6c51550c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:14.785248 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.objects.instance [None req-e76dbcf8-64b1-44c5-a74e-fa6c51550c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lazy-loading 'services' on Instance uuid 69a6fc53-bd93-47c4-9413-39ba0e1b6068 {{(pid=129294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 22:55:14.897330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e76dbcf8-64b1-44c5-a74e-fa6c51550c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "DELETE /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments/532a5824-f1bb-4b12-a1fc-36d6c5a8edbd" status: 202 len: 0 microversion: 2.1 time: 0.203304 Jul 27 22:55:14.897942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 405/795] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 22:55:14 2022] DELETE /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments/532a5824-f1bb-4b12-a1fc-36d6c5a8edbd => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 22:55:14.906844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d95705db-47d7-4e90-bcfa-c7df27b49563 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:14.909002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d95705db-47d7-4e90-bcfa-c7df27b49563 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:14.915016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d95705db-47d7-4e90-bcfa-c7df27b49563 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:14.915630 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d95705db-47d7-4e90-bcfa-c7df27b49563 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:14.916859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d95705db-47d7-4e90-bcfa-c7df27b49563 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:14.917424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d95705db-47d7-4e90-bcfa-c7df27b49563 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:14.947314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d95705db-47d7-4e90-bcfa-c7df27b49563 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044309 Jul 27 22:55:14.952018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 391/796] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:14 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:55:15.375132 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5cfc54a3-a617-4732-a6a4-3d826922e9de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:15.377487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5cfc54a3-a617-4732-a6a4-3d826922e9de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:15.379633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-36cf5b39-6b46-409d-86de-69004026e02a req-62dc8dfa-fe87-4b6d-ada3-a1e05a2b18fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a6fc53-bd93-47c4-9413-39ba0e1b6068", "tag": "ea3daece-2ad0-4979-adb0-cba646786ccc"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:55:15.383844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5cfc54a3-a617-4732-a6a4-3d826922e9de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:15.384287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5cfc54a3-a617-4732-a6a4-3d826922e9de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:15.385602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5cfc54a3-a617-4732-a6a4-3d826922e9de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:15.386034 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5cfc54a3-a617-4732-a6a4-3d826922e9de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:15.391259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-36cf5b39-6b46-409d-86de-69004026e02a req-62dc8dfa-fe87-4b6d-ada3-a1e05a2b18fd service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:15.391693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-36cf5b39-6b46-409d-86de-69004026e02a req-62dc8dfa-fe87-4b6d-ada3-a1e05a2b18fd service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:15.403685 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-36cf5b39-6b46-409d-86de-69004026e02a req-62dc8dfa-fe87-4b6d-ada3-a1e05a2b18fd service nova] Creating event network-changed:ea3daece-2ad0-4979-adb0-cba646786ccc for instance 69a6fc53-bd93-47c4-9413-39ba0e1b6068 on hv-cinder-85124 Jul 27 22:55:15.408798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-36cf5b39-6b46-409d-86de-69004026e02a req-62dc8dfa-fe87-4b6d-ada3-a1e05a2b18fd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033601 Jul 27 22:55:15.409414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 392/797] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:15.416155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5cfc54a3-a617-4732-a6a4-3d826922e9de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045908 Jul 27 22:55:15.419358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 406/798] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:15 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:15.688690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-14bbe296-b5d3-49a7-b011-ec9890859a64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:15.691676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-14bbe296-b5d3-49a7-b011-ec9890859a64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:15.699127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14bbe296-b5d3-49a7-b011-ec9890859a64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:15.699581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14bbe296-b5d3-49a7-b011-ec9890859a64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:15.700362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14bbe296-b5d3-49a7-b011-ec9890859a64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:15.700825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14bbe296-b5d3-49a7-b011-ec9890859a64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:15.732049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-14bbe296-b5d3-49a7-b011-ec9890859a64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047761 Jul 27 22:55:15.732819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 393/799] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:15.959708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-83d1d605-e0c5-444d-8063-290aa0e3fc5a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:15.961783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-83d1d605-e0c5-444d-8063-290aa0e3fc5a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:15.967699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83d1d605-e0c5-444d-8063-290aa0e3fc5a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:15.968137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83d1d605-e0c5-444d-8063-290aa0e3fc5a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:15.968925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83d1d605-e0c5-444d-8063-290aa0e3fc5a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:15.969358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83d1d605-e0c5-444d-8063-290aa0e3fc5a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:15.997879 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-83d1d605-e0c5-444d-8063-290aa0e3fc5a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042385 Jul 27 22:55:15.998453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 407/800] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:15 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:16.428440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0094d6ca-c7b8-4a5b-9be2-902c128eabfb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:16.430606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0094d6ca-c7b8-4a5b-9be2-902c128eabfb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:16.436669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0094d6ca-c7b8-4a5b-9be2-902c128eabfb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:16.437122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0094d6ca-c7b8-4a5b-9be2-902c128eabfb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:16.437881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0094d6ca-c7b8-4a5b-9be2-902c128eabfb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:16.438317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0094d6ca-c7b8-4a5b-9be2-902c128eabfb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:16.462101 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:16.467587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0094d6ca-c7b8-4a5b-9be2-902c128eabfb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043108 Jul 27 22:55:16.468137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 394/801] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:16 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:16.745174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b49f3b8c-a7d9-4d39-b7de-96f963b8ea20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:16.747239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b49f3b8c-a7d9-4d39-b7de-96f963b8ea20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:16.753784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b49f3b8c-a7d9-4d39-b7de-96f963b8ea20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:16.754233 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b49f3b8c-a7d9-4d39-b7de-96f963b8ea20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:16.754987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b49f3b8c-a7d9-4d39-b7de-96f963b8ea20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:16.755419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b49f3b8c-a7d9-4d39-b7de-96f963b8ea20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:16.785635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b49f3b8c-a7d9-4d39-b7de-96f963b8ea20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044923 Jul 27 22:55:16.786169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 408/802] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:16 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:17.010934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-49f39757-dec3-4484-8d0a-afe945718d3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:17.013047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-49f39757-dec3-4484-8d0a-afe945718d3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:17.019226 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49f39757-dec3-4484-8d0a-afe945718d3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:17.019664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49f39757-dec3-4484-8d0a-afe945718d3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:17.020407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49f39757-dec3-4484-8d0a-afe945718d3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:17.020864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49f39757-dec3-4484-8d0a-afe945718d3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:17.048296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-49f39757-dec3-4484-8d0a-afe945718d3b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042141 Jul 27 22:55:17.048861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 395/803] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:17 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:17.479504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d80a42e5-031a-4b8c-8c58-61b93b996d36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:17.481636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d80a42e5-031a-4b8c-8c58-61b93b996d36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:17.488859 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d80a42e5-031a-4b8c-8c58-61b93b996d36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:17.489639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d80a42e5-031a-4b8c-8c58-61b93b996d36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:17.491019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d80a42e5-031a-4b8c-8c58-61b93b996d36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:17.491808 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d80a42e5-031a-4b8c-8c58-61b93b996d36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:17.522440 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d80a42e5-031a-4b8c-8c58-61b93b996d36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047087 Jul 27 22:55:17.522989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 409/804] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:17 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:17.797787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-30ae776b-57c1-424e-bd10-45f248e1a06b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:17.799945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-30ae776b-57c1-424e-bd10-45f248e1a06b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:17.805881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-30ae776b-57c1-424e-bd10-45f248e1a06b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:17.806334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-30ae776b-57c1-424e-bd10-45f248e1a06b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:17.807121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-30ae776b-57c1-424e-bd10-45f248e1a06b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:17.807560 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-30ae776b-57c1-424e-bd10-45f248e1a06b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:17.835984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-30ae776b-57c1-424e-bd10-45f248e1a06b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041997 Jul 27 22:55:17.836530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 396/805] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:17 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:18.060446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cc882626-e438-41ad-8e30-8baff9652630 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:18.062559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cc882626-e438-41ad-8e30-8baff9652630 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:18.069022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cc882626-e438-41ad-8e30-8baff9652630 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:18.069467 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cc882626-e438-41ad-8e30-8baff9652630 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:18.070229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cc882626-e438-41ad-8e30-8baff9652630 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:18.070663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cc882626-e438-41ad-8e30-8baff9652630 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:18.098295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cc882626-e438-41ad-8e30-8baff9652630 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041853 Jul 27 22:55:18.098834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 410/806] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:18 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:18.534441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-21992295-4ec5-4688-9901-850efce4dd19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:18.536506 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-21992295-4ec5-4688-9901-850efce4dd19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:18.542496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21992295-4ec5-4688-9901-850efce4dd19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:18.542943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21992295-4ec5-4688-9901-850efce4dd19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:18.543703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21992295-4ec5-4688-9901-850efce4dd19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:18.544159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21992295-4ec5-4688-9901-850efce4dd19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:18.572302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-21992295-4ec5-4688-9901-850efce4dd19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041890 Jul 27 22:55:18.572887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 397/807] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:18.848144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-edced08f-3b5c-4ea5-9d10-a2b5a6ee4a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:18.850373 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-edced08f-3b5c-4ea5-9d10-a2b5a6ee4a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:18.859442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-edced08f-3b5c-4ea5-9d10-a2b5a6ee4a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:18.859882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-edced08f-3b5c-4ea5-9d10-a2b5a6ee4a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:18.860672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-edced08f-3b5c-4ea5-9d10-a2b5a6ee4a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:18.861098 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-edced08f-3b5c-4ea5-9d10-a2b5a6ee4a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:18.890279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-edced08f-3b5c-4ea5-9d10-a2b5a6ee4a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046167 Jul 27 22:55:18.890824 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 411/808] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:18 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:19.111549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f67f2427-7f4d-4d30-91d7-1e47a799fe8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:19.113618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f67f2427-7f4d-4d30-91d7-1e47a799fe8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:19.119555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f67f2427-7f4d-4d30-91d7-1e47a799fe8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:19.119995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f67f2427-7f4d-4d30-91d7-1e47a799fe8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:19.121425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f67f2427-7f4d-4d30-91d7-1e47a799fe8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:19.121873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f67f2427-7f4d-4d30-91d7-1e47a799fe8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:19.149389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f67f2427-7f4d-4d30-91d7-1e47a799fe8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041840 Jul 27 22:55:19.149932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 398/809] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:19 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:19.585175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1ebbb62c-8c1c-43b7-b4ac-b118be6dabb1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:19.587282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1ebbb62c-8c1c-43b7-b4ac-b118be6dabb1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:19.593795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ebbb62c-8c1c-43b7-b4ac-b118be6dabb1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:19.594233 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ebbb62c-8c1c-43b7-b4ac-b118be6dabb1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:19.594976 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ebbb62c-8c1c-43b7-b4ac-b118be6dabb1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:19.595403 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ebbb62c-8c1c-43b7-b4ac-b118be6dabb1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:19.623730 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1ebbb62c-8c1c-43b7-b4ac-b118be6dabb1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042492 Jul 27 22:55:19.624251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 412/810] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:19 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:19.903164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-366d3890-19c7-4530-af09-24486bc2df54 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:19.905296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-366d3890-19c7-4530-af09-24486bc2df54 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:19.911225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-366d3890-19c7-4530-af09-24486bc2df54 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:19.911670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-366d3890-19c7-4530-af09-24486bc2df54 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:19.912426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-366d3890-19c7-4530-af09-24486bc2df54 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:19.912885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-366d3890-19c7-4530-af09-24486bc2df54 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:19.941158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-366d3890-19c7-4530-af09-24486bc2df54 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042493 Jul 27 22:55:19.941702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 399/811] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:19 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:20.161724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2ba47a27-542b-455e-a510-ac2b619cfd29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:20.163852 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2ba47a27-542b-455e-a510-ac2b619cfd29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:20.170455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ba47a27-542b-455e-a510-ac2b619cfd29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:20.170906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ba47a27-542b-455e-a510-ac2b619cfd29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:20.171664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ba47a27-542b-455e-a510-ac2b619cfd29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:20.172100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ba47a27-542b-455e-a510-ac2b619cfd29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:20.200623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2ba47a27-542b-455e-a510-ac2b619cfd29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042852 Jul 27 22:55:20.201158 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 413/812] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:20 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:20.635907 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-35197419-63cd-4fa2-a618-08e1b72f6a0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:20.638089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-35197419-63cd-4fa2-a618-08e1b72f6a0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:20.644070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35197419-63cd-4fa2-a618-08e1b72f6a0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:20.644515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35197419-63cd-4fa2-a618-08e1b72f6a0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:20.645294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35197419-63cd-4fa2-a618-08e1b72f6a0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:20.645724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35197419-63cd-4fa2-a618-08e1b72f6a0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:20.673920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-35197419-63cd-4fa2-a618-08e1b72f6a0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041985 Jul 27 22:55:20.674454 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 400/813] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:20.953821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a838d0cf-9f33-4cf1-bdbd-4da73d91903e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:20.955868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a838d0cf-9f33-4cf1-bdbd-4da73d91903e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:20.958304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c37dd951-ef64-4e63-81e0-06c4fc19449f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:20.958802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c37dd951-ef64-4e63-81e0-06c4fc19449f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:20.962124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a838d0cf-9f33-4cf1-bdbd-4da73d91903e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:20.962570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a838d0cf-9f33-4cf1-bdbd-4da73d91903e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:20.963339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a838d0cf-9f33-4cf1-bdbd-4da73d91903e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:20.963774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a838d0cf-9f33-4cf1-bdbd-4da73d91903e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:20.964740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c37dd951-ef64-4e63-81e0-06c4fc19449f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:20.965182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c37dd951-ef64-4e63-81e0-06c4fc19449f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:20.965935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c37dd951-ef64-4e63-81e0-06c4fc19449f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:20.966367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c37dd951-ef64-4e63-81e0-06c4fc19449f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:20.990243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c37dd951-ef64-4e63-81e0-06c4fc19449f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Going to try to terminate instance {{(pid=129295) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 22:55:20.992680 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a838d0cf-9f33-4cf1-bdbd-4da73d91903e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043329 Jul 27 22:55:20.993246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 414/814] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:20 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:21.063116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c37dd951-ef64-4e63-81e0-06c4fc19449f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 204 len: 0 microversion: 2.1 time: 0.108347 Jul 27 22:55:21.063785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 401/815] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 22:55:20 2022] DELETE /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 22:55:21.072444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8f3fb800-9671-40aa-9082-a73847928b59 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:21.073091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8f3fb800-9671-40aa-9082-a73847928b59 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:21.079652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f3fb800-9671-40aa-9082-a73847928b59 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:21.080102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f3fb800-9671-40aa-9082-a73847928b59 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:21.080900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f3fb800-9671-40aa-9082-a73847928b59 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:21.081337 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f3fb800-9671-40aa-9082-a73847928b59 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:21.211347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8f3fb800-9671-40aa-9082-a73847928b59 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:21.213405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9a80aed4-e62e-4c3b-9f78-483709a25d7d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:21.215645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9a80aed4-e62e-4c3b-9f78-483709a25d7d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:21.218816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8f3fb800-9671-40aa-9082-a73847928b59 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1576 microversion: 2.1 time: 0.150371 Jul 27 22:55:21.219369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 415/816] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:21 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:21.221661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a80aed4-e62e-4c3b-9f78-483709a25d7d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:21.222118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a80aed4-e62e-4c3b-9f78-483709a25d7d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:21.222887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a80aed4-e62e-4c3b-9f78-483709a25d7d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:21.223326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a80aed4-e62e-4c3b-9f78-483709a25d7d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:21.252803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9a80aed4-e62e-4c3b-9f78-483709a25d7d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Jul 27 22:55:21.253352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 402/817] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:21 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:55:21.685240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-731a26bb-d595-4110-85ad-a102349de21f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:21.687386 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-731a26bb-d595-4110-85ad-a102349de21f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:21.693365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-731a26bb-d595-4110-85ad-a102349de21f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:21.693809 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-731a26bb-d595-4110-85ad-a102349de21f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:21.694562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-731a26bb-d595-4110-85ad-a102349de21f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:21.694992 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-731a26bb-d595-4110-85ad-a102349de21f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:21.723730 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-731a26bb-d595-4110-85ad-a102349de21f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042474 Jul 27 22:55:21.724274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 416/818] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:21 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:22.005460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-27eaa9b1-4fbf-4f9c-bd75-f79ea645a450 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:22.007627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-27eaa9b1-4fbf-4f9c-bd75-f79ea645a450 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:22.014107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-27eaa9b1-4fbf-4f9c-bd75-f79ea645a450 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:22.014559 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-27eaa9b1-4fbf-4f9c-bd75-f79ea645a450 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:22.015320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-27eaa9b1-4fbf-4f9c-bd75-f79ea645a450 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:22.015757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-27eaa9b1-4fbf-4f9c-bd75-f79ea645a450 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:22.044094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-27eaa9b1-4fbf-4f9c-bd75-f79ea645a450 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042590 Jul 27 22:55:22.044659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 403/819] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:22 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:22.240002 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1405443f-4388-4504-a1bc-9486a4ade773 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:22.240629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1405443f-4388-4504-a1bc-9486a4ade773 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:22.246975 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1405443f-4388-4504-a1bc-9486a4ade773 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:22.247417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1405443f-4388-4504-a1bc-9486a4ade773 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:22.248169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1405443f-4388-4504-a1bc-9486a4ade773 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:22.248616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1405443f-4388-4504-a1bc-9486a4ade773 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:22.265409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bea4aa12-6edb-4d43-92bd-5fb7d904e17a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:22.267666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bea4aa12-6edb-4d43-92bd-5fb7d904e17a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:22.273567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bea4aa12-6edb-4d43-92bd-5fb7d904e17a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:22.274016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bea4aa12-6edb-4d43-92bd-5fb7d904e17a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:22.274773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bea4aa12-6edb-4d43-92bd-5fb7d904e17a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:22.275204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bea4aa12-6edb-4d43-92bd-5fb7d904e17a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:22.305464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bea4aa12-6edb-4d43-92bd-5fb7d904e17a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044409 Jul 27 22:55:22.306026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 404/820] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:22 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:55:22.380207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1405443f-4388-4504-a1bc-9486a4ade773 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:22.388447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1405443f-4388-4504-a1bc-9486a4ade773 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1576 microversion: 2.1 time: 0.152243 Jul 27 22:55:22.389037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 417/821] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:22 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:22.736917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1547c0b6-0c7e-4874-8115-2723da1acada tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:22.739213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1547c0b6-0c7e-4874-8115-2723da1acada tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:22.745127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1547c0b6-0c7e-4874-8115-2723da1acada tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:22.745565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1547c0b6-0c7e-4874-8115-2723da1acada tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:22.746312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1547c0b6-0c7e-4874-8115-2723da1acada tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:22.747395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1547c0b6-0c7e-4874-8115-2723da1acada tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:22.775461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1547c0b6-0c7e-4874-8115-2723da1acada tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042468 Jul 27 22:55:22.776015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 405/822] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:22 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:23.056290 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0bc9f07c-3440-4509-842f-5140ad94766e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:23.058575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0bc9f07c-3440-4509-842f-5140ad94766e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:23.065137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bc9f07c-3440-4509-842f-5140ad94766e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:23.065588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bc9f07c-3440-4509-842f-5140ad94766e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:23.066353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bc9f07c-3440-4509-842f-5140ad94766e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:23.066787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bc9f07c-3440-4509-842f-5140ad94766e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:23.095538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0bc9f07c-3440-4509-842f-5140ad94766e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 Jul 27 22:55:23.096096 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 418/823] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:23 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:23.318086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8b30c453-51b8-4ad3-8e5f-f6e5684c1b6f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:23.320249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8b30c453-51b8-4ad3-8e5f-f6e5684c1b6f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:23.326272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b30c453-51b8-4ad3-8e5f-f6e5684c1b6f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:23.326718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b30c453-51b8-4ad3-8e5f-f6e5684c1b6f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:23.327470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b30c453-51b8-4ad3-8e5f-f6e5684c1b6f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:23.327898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b30c453-51b8-4ad3-8e5f-f6e5684c1b6f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:23.357131 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8b30c453-51b8-4ad3-8e5f-f6e5684c1b6f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042549 Jul 27 22:55:23.357936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 406/824] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:23 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:55:23.409895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-33c44ece-41f4-4561-8ff8-8f4cad250a19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:23.410515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-33c44ece-41f4-4561-8ff8-8f4cad250a19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:23.417326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-33c44ece-41f4-4561-8ff8-8f4cad250a19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:23.418026 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-33c44ece-41f4-4561-8ff8-8f4cad250a19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:23.419615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-33c44ece-41f4-4561-8ff8-8f4cad250a19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:23.420248 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-33c44ece-41f4-4561-8ff8-8f4cad250a19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:23.486226 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-33c44ece-41f4-4561-8ff8-8f4cad250a19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:23.493738 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-33c44ece-41f4-4561-8ff8-8f4cad250a19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1510 microversion: 2.1 time: 0.087692 Jul 27 22:55:23.494294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 419/825] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:23 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1510 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:23.761004 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-6b5bceb9-2848-49e5-9b3e-76403f0245d8 req-0a6350f2-7a81-4085-a99e-cca76a307422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13f7184-9f3c-4be1-858c-c9bae2a28713", "name": "network-vif-deleted", "tag": "a0592021-f797-414d-a1b0-64ae41a96423"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:55:23.775877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-6b5bceb9-2848-49e5-9b3e-76403f0245d8 req-0a6350f2-7a81-4085-a99e-cca76a307422 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:23.776428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-6b5bceb9-2848-49e5-9b3e-76403f0245d8 req-0a6350f2-7a81-4085-a99e-cca76a307422 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:23.789372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7ac700cb-bb82-401d-b4ca-5d640fbb90a0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:23.791843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-6b5bceb9-2848-49e5-9b3e-76403f0245d8 req-0a6350f2-7a81-4085-a99e-cca76a307422 service nova] Creating event network-vif-deleted:a0592021-f797-414d-a1b0-64ae41a96423 for instance d13f7184-9f3c-4be1-858c-c9bae2a28713 on hv-cinder-85124 Jul 27 22:55:23.791982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7ac700cb-bb82-401d-b4ca-5d640fbb90a0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:23.798302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-6b5bceb9-2848-49e5-9b3e-76403f0245d8 req-0a6350f2-7a81-4085-a99e-cca76a307422 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120369 Jul 27 22:55:23.798540 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ac700cb-bb82-401d-b4ca-5d640fbb90a0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:23.799165 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ac700cb-bb82-401d-b4ca-5d640fbb90a0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:23.799475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 407/826] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 22:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:23.801898 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ac700cb-bb82-401d-b4ca-5d640fbb90a0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:23.802350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ac700cb-bb82-401d-b4ca-5d640fbb90a0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:23.824425 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:23.845574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7ac700cb-bb82-401d-b4ca-5d640fbb90a0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060252 Jul 27 22:55:23.846261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 420/827] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:23 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:24.108409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-58b39403-379a-48d8-bd9e-2471bd7f56fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:24.110583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-58b39403-379a-48d8-bd9e-2471bd7f56fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:24.116740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-58b39403-379a-48d8-bd9e-2471bd7f56fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:24.117223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-58b39403-379a-48d8-bd9e-2471bd7f56fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:24.117937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-58b39403-379a-48d8-bd9e-2471bd7f56fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:24.118370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-58b39403-379a-48d8-bd9e-2471bd7f56fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:24.155016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-58b39403-379a-48d8-bd9e-2471bd7f56fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050694 Jul 27 22:55:24.157383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 408/828] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:24 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:24.369524 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d1a939e5-ccad-44eb-a3ac-15913ee04609 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:24.371657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d1a939e5-ccad-44eb-a3ac-15913ee04609 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:24.378225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1a939e5-ccad-44eb-a3ac-15913ee04609 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:24.378666 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1a939e5-ccad-44eb-a3ac-15913ee04609 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:24.379425 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1a939e5-ccad-44eb-a3ac-15913ee04609 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:24.379853 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1a939e5-ccad-44eb-a3ac-15913ee04609 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:24.408391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d1a939e5-ccad-44eb-a3ac-15913ee04609 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 Jul 27 22:55:24.408996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 421/829] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:24 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:24.515046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-24fb3cc3-2c37-4dc8-8059-faa6a8abf624 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:24.516309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-24fb3cc3-2c37-4dc8-8059-faa6a8abf624 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:24.526086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24fb3cc3-2c37-4dc8-8059-faa6a8abf624 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:24.526637 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24fb3cc3-2c37-4dc8-8059-faa6a8abf624 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:24.527423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24fb3cc3-2c37-4dc8-8059-faa6a8abf624 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:24.527861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24fb3cc3-2c37-4dc8-8059-faa6a8abf624 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:24.592778 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-24fb3cc3-2c37-4dc8-8059-faa6a8abf624 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:24.601021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-24fb3cc3-2c37-4dc8-8059-faa6a8abf624 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.089989 Jul 27 22:55:24.601856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 409/830] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:24 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:24.858684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-19324bbd-ba45-4580-8f1d-124aa095c7c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:24.860839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-19324bbd-ba45-4580-8f1d-124aa095c7c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:24.867196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19324bbd-ba45-4580-8f1d-124aa095c7c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:24.867633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19324bbd-ba45-4580-8f1d-124aa095c7c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:24.868378 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19324bbd-ba45-4580-8f1d-124aa095c7c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:24.868838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19324bbd-ba45-4580-8f1d-124aa095c7c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:24.896402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-19324bbd-ba45-4580-8f1d-124aa095c7c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042293 Jul 27 22:55:24.896906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 422/831] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:24 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:25.166564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2f823a6b-1599-4341-bff4-3bc5d5a10176 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:25.168814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2f823a6b-1599-4341-bff4-3bc5d5a10176 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:25.174916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2f823a6b-1599-4341-bff4-3bc5d5a10176 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:25.175361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2f823a6b-1599-4341-bff4-3bc5d5a10176 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:25.176124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2f823a6b-1599-4341-bff4-3bc5d5a10176 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:25.176583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2f823a6b-1599-4341-bff4-3bc5d5a10176 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:25.192659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:25.206892 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2f823a6b-1599-4341-bff4-3bc5d5a10176 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Jul 27 22:55:25.207446 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 410/832] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:25 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:25.420784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-25182371-ef76-4cd0-86cd-6fb1ef9e4357 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:25.422825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-25182371-ef76-4cd0-86cd-6fb1ef9e4357 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:25.428827 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-25182371-ef76-4cd0-86cd-6fb1ef9e4357 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:25.429272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-25182371-ef76-4cd0-86cd-6fb1ef9e4357 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:25.430022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-25182371-ef76-4cd0-86cd-6fb1ef9e4357 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:25.430451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-25182371-ef76-4cd0-86cd-6fb1ef9e4357 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:25.458838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-25182371-ef76-4cd0-86cd-6fb1ef9e4357 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042130 Jul 27 22:55:25.459379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 423/833] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:25.623974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e105555e-a13b-4134-9361-7b58d7c99b29 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:25.624585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e105555e-a13b-4134-9361-7b58d7c99b29 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:25.630585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e105555e-a13b-4134-9361-7b58d7c99b29 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:25.631022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e105555e-a13b-4134-9361-7b58d7c99b29 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:25.631774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e105555e-a13b-4134-9361-7b58d7c99b29 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:25.632198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e105555e-a13b-4134-9361-7b58d7c99b29 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:25.692015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e105555e-a13b-4134-9361-7b58d7c99b29 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:25.699322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e105555e-a13b-4134-9361-7b58d7c99b29 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079938 Jul 27 22:55:25.700537 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 411/834] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:25 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:25.909397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-16fe4f92-f04a-499c-a32d-3ac4d5264209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:25.911529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-16fe4f92-f04a-499c-a32d-3ac4d5264209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:25.917947 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-16fe4f92-f04a-499c-a32d-3ac4d5264209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:25.918393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-16fe4f92-f04a-499c-a32d-3ac4d5264209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:25.919154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-16fe4f92-f04a-499c-a32d-3ac4d5264209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:25.919595 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-16fe4f92-f04a-499c-a32d-3ac4d5264209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:25.948228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-16fe4f92-f04a-499c-a32d-3ac4d5264209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042637 Jul 27 22:55:25.948743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 424/835] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:25 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:26.219603 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-778c7cca-c127-4f38-98c4-b59ddde581ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:26.221697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-778c7cca-c127-4f38-98c4-b59ddde581ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:26.228169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-778c7cca-c127-4f38-98c4-b59ddde581ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:26.228638 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-778c7cca-c127-4f38-98c4-b59ddde581ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:26.229431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-778c7cca-c127-4f38-98c4-b59ddde581ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:26.229862 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-778c7cca-c127-4f38-98c4-b59ddde581ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:26.259528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-778c7cca-c127-4f38-98c4-b59ddde581ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044015 Jul 27 22:55:26.260078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 412/836] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:26 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:26.470825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5f11509a-3100-4d89-ad78-2748c451ff43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:26.472944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5f11509a-3100-4d89-ad78-2748c451ff43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:26.479251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f11509a-3100-4d89-ad78-2748c451ff43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:26.479697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f11509a-3100-4d89-ad78-2748c451ff43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:26.480452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f11509a-3100-4d89-ad78-2748c451ff43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:26.481430 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f11509a-3100-4d89-ad78-2748c451ff43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:26.509288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5f11509a-3100-4d89-ad78-2748c451ff43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042466 Jul 27 22:55:26.509828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 425/837] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:26 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:26.720558 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c86112ad-56b2-47cd-ab84-32a7c4afb7ca tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:26.721233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c86112ad-56b2-47cd-ab84-32a7c4afb7ca tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:26.727470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c86112ad-56b2-47cd-ab84-32a7c4afb7ca tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:26.727914 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c86112ad-56b2-47cd-ab84-32a7c4afb7ca tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:26.728703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c86112ad-56b2-47cd-ab84-32a7c4afb7ca tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:26.729137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c86112ad-56b2-47cd-ab84-32a7c4afb7ca tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:26.791877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c86112ad-56b2-47cd-ab84-32a7c4afb7ca tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:26.799843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c86112ad-56b2-47cd-ab84-32a7c4afb7ca tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083176 Jul 27 22:55:26.800407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 413/838] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:26 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:26.962570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ebb34449-d597-4c36-bef4-278616357ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:26.964718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ebb34449-d597-4c36-bef4-278616357ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:26.971109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebb34449-d597-4c36-bef4-278616357ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:26.971600 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebb34449-d597-4c36-bef4-278616357ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:26.972309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebb34449-d597-4c36-bef4-278616357ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:26.972780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebb34449-d597-4c36-bef4-278616357ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:27.002222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ebb34449-d597-4c36-bef4-278616357ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043607 Jul 27 22:55:27.002765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 426/839] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:26 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:27.271351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b918559e-35b4-4be2-b70f-f21bd15aedbf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:27.273445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b918559e-35b4-4be2-b70f-f21bd15aedbf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:27.279564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b918559e-35b4-4be2-b70f-f21bd15aedbf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:27.280016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b918559e-35b4-4be2-b70f-f21bd15aedbf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:27.280803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b918559e-35b4-4be2-b70f-f21bd15aedbf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:27.281240 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b918559e-35b4-4be2-b70f-f21bd15aedbf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:27.310716 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b918559e-35b4-4be2-b70f-f21bd15aedbf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043365 Jul 27 22:55:27.311260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 414/840] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:27 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:27.521668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d97d1c56-5415-4dac-a154-87c18904b8e9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:27.523703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d97d1c56-5415-4dac-a154-87c18904b8e9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:27.529680 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d97d1c56-5415-4dac-a154-87c18904b8e9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:27.530126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d97d1c56-5415-4dac-a154-87c18904b8e9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:27.530892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d97d1c56-5415-4dac-a154-87c18904b8e9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:27.531324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d97d1c56-5415-4dac-a154-87c18904b8e9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:27.558706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d97d1c56-5415-4dac-a154-87c18904b8e9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041126 Jul 27 22:55:27.559862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 427/841] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:27 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:27.821110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-eb45ba61-4ac0-4585-983f-019ec15db791 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:27.821718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-eb45ba61-4ac0-4585-983f-019ec15db791 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:27.827706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb45ba61-4ac0-4585-983f-019ec15db791 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:27.828147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb45ba61-4ac0-4585-983f-019ec15db791 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:27.828934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb45ba61-4ac0-4585-983f-019ec15db791 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:27.829362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb45ba61-4ac0-4585-983f-019ec15db791 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:27.889299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eb45ba61-4ac0-4585-983f-019ec15db791 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:27.896664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-eb45ba61-4ac0-4585-983f-019ec15db791 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079322 Jul 27 22:55:27.897218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 415/842] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:27 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:28.014892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ec11810c-28df-4e25-827f-ecc65804e14b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:28.017080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ec11810c-28df-4e25-827f-ecc65804e14b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:28.023475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec11810c-28df-4e25-827f-ecc65804e14b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:28.023916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec11810c-28df-4e25-827f-ecc65804e14b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:28.024698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec11810c-28df-4e25-827f-ecc65804e14b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:28.025134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec11810c-28df-4e25-827f-ecc65804e14b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:28.053100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ec11810c-28df-4e25-827f-ecc65804e14b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042686 Jul 27 22:55:28.053634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 428/843] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:28 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:28.322756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-077f8e04-c794-4a1d-9506-ba84bd27b553 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:28.325402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-077f8e04-c794-4a1d-9506-ba84bd27b553 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:28.331368 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-077f8e04-c794-4a1d-9506-ba84bd27b553 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:28.331812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-077f8e04-c794-4a1d-9506-ba84bd27b553 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:28.332592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-077f8e04-c794-4a1d-9506-ba84bd27b553 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:28.333115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-077f8e04-c794-4a1d-9506-ba84bd27b553 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:28.361951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-077f8e04-c794-4a1d-9506-ba84bd27b553 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Jul 27 22:55:28.362493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 416/844] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:28 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:28.572883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-546b953e-9cef-4084-8a35-8ca220097cb1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:28.575563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-546b953e-9cef-4084-8a35-8ca220097cb1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:28.581555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-546b953e-9cef-4084-8a35-8ca220097cb1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:28.582001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-546b953e-9cef-4084-8a35-8ca220097cb1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:28.582761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-546b953e-9cef-4084-8a35-8ca220097cb1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:28.583224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-546b953e-9cef-4084-8a35-8ca220097cb1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:28.611638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-546b953e-9cef-4084-8a35-8ca220097cb1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042601 Jul 27 22:55:28.612301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 429/845] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:28 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:28.917422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b38ecb57-3b9e-4e7b-a29b-72325e20e26b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:28.917975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b38ecb57-3b9e-4e7b-a29b-72325e20e26b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:28.924480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b38ecb57-3b9e-4e7b-a29b-72325e20e26b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:28.924947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b38ecb57-3b9e-4e7b-a29b-72325e20e26b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:28.925693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b38ecb57-3b9e-4e7b-a29b-72325e20e26b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:28.926121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b38ecb57-3b9e-4e7b-a29b-72325e20e26b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:28.985934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b38ecb57-3b9e-4e7b-a29b-72325e20e26b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:28.994578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b38ecb57-3b9e-4e7b-a29b-72325e20e26b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080836 Jul 27 22:55:28.995130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 417/846] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:28 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:29.066184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c22caee5-4b90-452c-9082-beeb1d9b2a7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:29.068347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c22caee5-4b90-452c-9082-beeb1d9b2a7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:29.074768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c22caee5-4b90-452c-9082-beeb1d9b2a7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:29.075215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c22caee5-4b90-452c-9082-beeb1d9b2a7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:29.075977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c22caee5-4b90-452c-9082-beeb1d9b2a7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:29.076414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c22caee5-4b90-452c-9082-beeb1d9b2a7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:29.105634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c22caee5-4b90-452c-9082-beeb1d9b2a7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043363 Jul 27 22:55:29.106851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 430/847] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:29 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:29.374179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0dbdddf4-e3f2-48dc-9cf8-d9c470bfc8f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:29.376311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0dbdddf4-e3f2-48dc-9cf8-d9c470bfc8f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:29.382383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0dbdddf4-e3f2-48dc-9cf8-d9c470bfc8f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:29.382829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0dbdddf4-e3f2-48dc-9cf8-d9c470bfc8f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:29.383580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0dbdddf4-e3f2-48dc-9cf8-d9c470bfc8f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:29.384009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0dbdddf4-e3f2-48dc-9cf8-d9c470bfc8f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:29.412215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0dbdddf4-e3f2-48dc-9cf8-d9c470bfc8f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042000 Jul 27 22:55:29.412782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 418/848] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:29 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:29.624394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2a5226fe-524a-4e7b-89db-e3b7ceb492fc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:29.626483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2a5226fe-524a-4e7b-89db-e3b7ceb492fc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:29.632426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a5226fe-524a-4e7b-89db-e3b7ceb492fc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:29.632911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a5226fe-524a-4e7b-89db-e3b7ceb492fc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:29.633816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a5226fe-524a-4e7b-89db-e3b7ceb492fc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:29.634249 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a5226fe-524a-4e7b-89db-e3b7ceb492fc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:29.813901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2a5226fe-524a-4e7b-89db-e3b7ceb492fc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193526 Jul 27 22:55:29.814449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 431/849] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:29 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:30.016315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1ad2517d-ba20-4a99-b388-f802a8bb339b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:30.016866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1ad2517d-ba20-4a99-b388-f802a8bb339b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:30.022839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ad2517d-ba20-4a99-b388-f802a8bb339b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:30.023284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ad2517d-ba20-4a99-b388-f802a8bb339b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:30.024040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ad2517d-ba20-4a99-b388-f802a8bb339b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:30.024478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ad2517d-ba20-4a99-b388-f802a8bb339b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:30.083804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1ad2517d-ba20-4a99-b388-f802a8bb339b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:30.091828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1ad2517d-ba20-4a99-b388-f802a8bb339b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080028 Jul 27 22:55:30.092383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 419/850] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:30 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:30.118408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fb5d26bf-8df0-49be-94df-47d194695548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:30.120614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fb5d26bf-8df0-49be-94df-47d194695548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:30.126976 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb5d26bf-8df0-49be-94df-47d194695548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:30.127422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb5d26bf-8df0-49be-94df-47d194695548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:30.128180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb5d26bf-8df0-49be-94df-47d194695548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:30.128648 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb5d26bf-8df0-49be-94df-47d194695548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:30.157907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fb5d26bf-8df0-49be-94df-47d194695548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043381 Jul 27 22:55:30.158450 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 432/851] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:30.424436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-95b01571-57a5-4342-896c-3a761af91caf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:30.426576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-95b01571-57a5-4342-896c-3a761af91caf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:30.432480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-95b01571-57a5-4342-896c-3a761af91caf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:30.432950 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-95b01571-57a5-4342-896c-3a761af91caf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:30.433699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-95b01571-57a5-4342-896c-3a761af91caf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:30.434166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-95b01571-57a5-4342-896c-3a761af91caf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:30.462082 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-95b01571-57a5-4342-896c-3a761af91caf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041624 Jul 27 22:55:30.462615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 420/852] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:30 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:30.826689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0c152344-ab0d-4fe0-9257-c28a92f64890 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:30.828890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0c152344-ab0d-4fe0-9257-c28a92f64890 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:30.835003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0c152344-ab0d-4fe0-9257-c28a92f64890 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:30.835444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0c152344-ab0d-4fe0-9257-c28a92f64890 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:30.836223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0c152344-ab0d-4fe0-9257-c28a92f64890 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:30.836681 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0c152344-ab0d-4fe0-9257-c28a92f64890 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:30.864138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0c152344-ab0d-4fe0-9257-c28a92f64890 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Jul 27 22:55:30.864693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 433/853] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:30 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:31.112861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8295ca71-68c9-40f4-8614-2f6d8e30d2f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:31.113394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8295ca71-68c9-40f4-8614-2f6d8e30d2f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:31.119449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8295ca71-68c9-40f4-8614-2f6d8e30d2f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:31.119893 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8295ca71-68c9-40f4-8614-2f6d8e30d2f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:31.120714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8295ca71-68c9-40f4-8614-2f6d8e30d2f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:31.121147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8295ca71-68c9-40f4-8614-2f6d8e30d2f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:31.171074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ed8f14b9-b0b4-44db-9fe5-b5a169e2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:31.173343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ed8f14b9-b0b4-44db-9fe5-b5a169e2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:31.179895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed8f14b9-b0b4-44db-9fe5-b5a169e2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:31.180422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed8f14b9-b0b4-44db-9fe5-b5a169e2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:31.181682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed8f14b9-b0b4-44db-9fe5-b5a169e2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:31.181828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed8f14b9-b0b4-44db-9fe5-b5a169e2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:31.183777 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8295ca71-68c9-40f4-8614-2f6d8e30d2f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:31.191911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8295ca71-68c9-40f4-8614-2f6d8e30d2f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082970 Jul 27 22:55:31.192464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 421/854] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:31 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:31.211322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ed8f14b9-b0b4-44db-9fe5-b5a169e2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044827 Jul 27 22:55:31.211861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 434/855] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:31 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:55:31.475090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6c072d4a-fe8f-4c1e-8ae2-3f1eec7b6e36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:31.477467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6c072d4a-fe8f-4c1e-8ae2-3f1eec7b6e36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:31.484274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c072d4a-fe8f-4c1e-8ae2-3f1eec7b6e36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:31.484769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c072d4a-fe8f-4c1e-8ae2-3f1eec7b6e36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:31.485522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c072d4a-fe8f-4c1e-8ae2-3f1eec7b6e36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:31.485959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c072d4a-fe8f-4c1e-8ae2-3f1eec7b6e36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:31.515238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6c072d4a-fe8f-4c1e-8ae2-3f1eec7b6e36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044193 Jul 27 22:55:31.515778 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 422/856] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:31 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:31.875487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-696545f3-fd11-4b2e-a2b8-62df62b07778 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:31.877646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-696545f3-fd11-4b2e-a2b8-62df62b07778 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:31.883749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-696545f3-fd11-4b2e-a2b8-62df62b07778 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:31.884198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-696545f3-fd11-4b2e-a2b8-62df62b07778 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:31.884997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-696545f3-fd11-4b2e-a2b8-62df62b07778 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:31.885436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-696545f3-fd11-4b2e-a2b8-62df62b07778 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:31.914376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-696545f3-fd11-4b2e-a2b8-62df62b07778 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042825 Jul 27 22:55:31.914924 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 435/857] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:31 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:32.212678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-22499d12-0c61-4f68-a073-97d1fbe83eb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:32.213239 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-22499d12-0c61-4f68-a073-97d1fbe83eb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:32.219275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-22499d12-0c61-4f68-a073-97d1fbe83eb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:32.219722 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-22499d12-0c61-4f68-a073-97d1fbe83eb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:32.220582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-22499d12-0c61-4f68-a073-97d1fbe83eb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:32.221008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-22499d12-0c61-4f68-a073-97d1fbe83eb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:32.223915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6ef36499-b41c-4aed-a887-2141ca28ac95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:32.227206 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6ef36499-b41c-4aed-a887-2141ca28ac95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:32.233799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6ef36499-b41c-4aed-a887-2141ca28ac95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:32.234246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6ef36499-b41c-4aed-a887-2141ca28ac95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:32.235013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6ef36499-b41c-4aed-a887-2141ca28ac95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:32.235448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6ef36499-b41c-4aed-a887-2141ca28ac95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:32.265334 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6ef36499-b41c-4aed-a887-2141ca28ac95 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045900 Jul 27 22:55:32.265884 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 436/858] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:32 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:55:32.282977 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-22499d12-0c61-4f68-a073-97d1fbe83eb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:32.290338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-22499d12-0c61-4f68-a073-97d1fbe83eb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081799 Jul 27 22:55:32.290887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 423/859] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:32 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:32.527359 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-48c1a9ab-7a80-4e09-9c41-67735fddea75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:32.530142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-48c1a9ab-7a80-4e09-9c41-67735fddea75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:32.536111 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48c1a9ab-7a80-4e09-9c41-67735fddea75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:32.536577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48c1a9ab-7a80-4e09-9c41-67735fddea75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:32.537367 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48c1a9ab-7a80-4e09-9c41-67735fddea75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:32.537813 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48c1a9ab-7a80-4e09-9c41-67735fddea75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:32.541462 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:32.569456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-48c1a9ab-7a80-4e09-9c41-67735fddea75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046072 Jul 27 22:55:32.570002 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 437/860] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:32 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:32.926336 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3fc24c18-c006-432a-a61b-2e9d067bd375 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:32.928469 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3fc24c18-c006-432a-a61b-2e9d067bd375 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:32.936194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3fc24c18-c006-432a-a61b-2e9d067bd375 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:32.936665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3fc24c18-c006-432a-a61b-2e9d067bd375 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:32.937427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3fc24c18-c006-432a-a61b-2e9d067bd375 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:32.938185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3fc24c18-c006-432a-a61b-2e9d067bd375 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:32.968024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3fc24c18-c006-432a-a61b-2e9d067bd375 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Jul 27 22:55:32.968593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 424/861] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:32 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:33.277753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-97ddbbdf-1c8c-4587-a2e8-7097d814c199 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:33.279815 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-97ddbbdf-1c8c-4587-a2e8-7097d814c199 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:33.286517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97ddbbdf-1c8c-4587-a2e8-7097d814c199 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:33.286961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97ddbbdf-1c8c-4587-a2e8-7097d814c199 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:33.287716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97ddbbdf-1c8c-4587-a2e8-7097d814c199 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:33.288147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97ddbbdf-1c8c-4587-a2e8-7097d814c199 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:33.311680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-99687199-0b92-4280-9ed1-6db39a8afd58 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:33.312279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-99687199-0b92-4280-9ed1-6db39a8afd58 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:33.317998 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-97ddbbdf-1c8c-4587-a2e8-7097d814c199 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044318 Jul 27 22:55:33.318172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99687199-0b92-4280-9ed1-6db39a8afd58 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:33.318562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 438/862] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:33.318729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99687199-0b92-4280-9ed1-6db39a8afd58 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:33.319490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99687199-0b92-4280-9ed1-6db39a8afd58 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:33.319916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99687199-0b92-4280-9ed1-6db39a8afd58 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:33.379964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-99687199-0b92-4280-9ed1-6db39a8afd58 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:33.387908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-99687199-0b92-4280-9ed1-6db39a8afd58 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080057 Jul 27 22:55:33.388467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 425/863] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:33 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:55:33.581358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-24c259de-353a-45e2-8398-f483002bae2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:33.583783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-24c259de-353a-45e2-8398-f483002bae2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:33.589631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24c259de-353a-45e2-8398-f483002bae2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:33.590076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24c259de-353a-45e2-8398-f483002bae2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:33.591464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24c259de-353a-45e2-8398-f483002bae2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:33.591895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24c259de-353a-45e2-8398-f483002bae2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:33.621192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-24c259de-353a-45e2-8398-f483002bae2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Jul 27 22:55:33.622252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 439/864] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:33 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:33.979625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-403f0e41-04ac-4767-a410-49f4388315d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:33.982338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-403f0e41-04ac-4767-a410-49f4388315d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:33.988452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-403f0e41-04ac-4767-a410-49f4388315d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:33.988992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-403f0e41-04ac-4767-a410-49f4388315d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:33.989740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-403f0e41-04ac-4767-a410-49f4388315d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:33.990172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-403f0e41-04ac-4767-a410-49f4388315d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:34.022126 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-403f0e41-04ac-4767-a410-49f4388315d4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046702 Jul 27 22:55:34.022675 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 426/865] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:33 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:34.330062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d429d676-2ce1-4d3b-b23d-7bbfaee5d6de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:34.332235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d429d676-2ce1-4d3b-b23d-7bbfaee5d6de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:34.338731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d429d676-2ce1-4d3b-b23d-7bbfaee5d6de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:34.339179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d429d676-2ce1-4d3b-b23d-7bbfaee5d6de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:34.339943 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d429d676-2ce1-4d3b-b23d-7bbfaee5d6de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:34.340895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d429d676-2ce1-4d3b-b23d-7bbfaee5d6de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:34.372867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d429d676-2ce1-4d3b-b23d-7bbfaee5d6de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046766 Jul 27 22:55:34.373324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 440/866] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:34 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:55:34.408495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9cea1d64-7a39-470e-a89d-66cb07ecfbe2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:34.409117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9cea1d64-7a39-470e-a89d-66cb07ecfbe2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:34.415029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9cea1d64-7a39-470e-a89d-66cb07ecfbe2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:34.415465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9cea1d64-7a39-470e-a89d-66cb07ecfbe2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:34.416208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9cea1d64-7a39-470e-a89d-66cb07ecfbe2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:34.416663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9cea1d64-7a39-470e-a89d-66cb07ecfbe2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:34.421197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:34.476843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9cea1d64-7a39-470e-a89d-66cb07ecfbe2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:34.485450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9cea1d64-7a39-470e-a89d-66cb07ecfbe2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080552 Jul 27 22:55:34.486078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 427/867] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:34 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:34.633512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4677c7bf-2f0c-4fd6-b8f6-72cef46c8a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:34.635746 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4677c7bf-2f0c-4fd6-b8f6-72cef46c8a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:34.641764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4677c7bf-2f0c-4fd6-b8f6-72cef46c8a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:34.642227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4677c7bf-2f0c-4fd6-b8f6-72cef46c8a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:34.642986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4677c7bf-2f0c-4fd6-b8f6-72cef46c8a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:34.643416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4677c7bf-2f0c-4fd6-b8f6-72cef46c8a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:34.672777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4677c7bf-2f0c-4fd6-b8f6-72cef46c8a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043396 Jul 27 22:55:34.673321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 441/868] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:34 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:55:35.034952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3bb5596e-2ecd-4d25-ac0c-2222c63c2266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:35.037017 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3bb5596e-2ecd-4d25-ac0c-2222c63c2266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:35.042965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bb5596e-2ecd-4d25-ac0c-2222c63c2266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:35.043406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bb5596e-2ecd-4d25-ac0c-2222c63c2266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:35.044240 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bb5596e-2ecd-4d25-ac0c-2222c63c2266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:35.044694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bb5596e-2ecd-4d25-ac0c-2222c63c2266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:35.071465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3bb5596e-2ecd-4d25-ac0c-2222c63c2266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040517 Jul 27 22:55:35.072003 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 428/869] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:35 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:35.385629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fdfef6f6-04d5-41c1-b941-8669f7082d4c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:35.388899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fdfef6f6-04d5-41c1-b941-8669f7082d4c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:35.395583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdfef6f6-04d5-41c1-b941-8669f7082d4c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:35.396037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdfef6f6-04d5-41c1-b941-8669f7082d4c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:35.396834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdfef6f6-04d5-41c1-b941-8669f7082d4c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:35.397266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdfef6f6-04d5-41c1-b941-8669f7082d4c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:35.424872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fdfef6f6-04d5-41c1-b941-8669f7082d4c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043221 Jul 27 22:55:35.425409 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 442/870] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:35.505943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f6c60104-0246-414e-b496-164269359238 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:35.506549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f6c60104-0246-414e-b496-164269359238 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:35.512770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f6c60104-0246-414e-b496-164269359238 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:35.513218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f6c60104-0246-414e-b496-164269359238 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:35.513986 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f6c60104-0246-414e-b496-164269359238 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:35.514451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f6c60104-0246-414e-b496-164269359238 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:35.577173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f6c60104-0246-414e-b496-164269359238 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:35.584574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f6c60104-0246-414e-b496-164269359238 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082380 Jul 27 22:55:35.585943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 429/871] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:35 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:35.686458 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cb4ae31f-c255-4815-a2f8-bbf16fb1ed8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:35.689300 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cb4ae31f-c255-4815-a2f8-bbf16fb1ed8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:35.700842 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb4ae31f-c255-4815-a2f8-bbf16fb1ed8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:35.701304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb4ae31f-c255-4815-a2f8-bbf16fb1ed8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:35.702084 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb4ae31f-c255-4815-a2f8-bbf16fb1ed8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:35.702519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb4ae31f-c255-4815-a2f8-bbf16fb1ed8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:35.734213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cb4ae31f-c255-4815-a2f8-bbf16fb1ed8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052960 Jul 27 22:55:35.735125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 443/872] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:35 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:55:36.084120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c1377824-60e1-4b7d-b344-ca7a7d7c49e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:36.086276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c1377824-60e1-4b7d-b344-ca7a7d7c49e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:36.092751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1377824-60e1-4b7d-b344-ca7a7d7c49e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:36.093189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1377824-60e1-4b7d-b344-ca7a7d7c49e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:36.093938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1377824-60e1-4b7d-b344-ca7a7d7c49e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:36.094390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1377824-60e1-4b7d-b344-ca7a7d7c49e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:36.122288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c1377824-60e1-4b7d-b344-ca7a7d7c49e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042114 Jul 27 22:55:36.122823 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 430/873] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:36 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:36.437405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3928d3b4-8b30-4dd2-9dd8-2c4a57898f14 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:36.439494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3928d3b4-8b30-4dd2-9dd8-2c4a57898f14 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:36.445940 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3928d3b4-8b30-4dd2-9dd8-2c4a57898f14 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:36.446387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3928d3b4-8b30-4dd2-9dd8-2c4a57898f14 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:36.447148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3928d3b4-8b30-4dd2-9dd8-2c4a57898f14 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:36.447580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3928d3b4-8b30-4dd2-9dd8-2c4a57898f14 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:36.476884 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3928d3b4-8b30-4dd2-9dd8-2c4a57898f14 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043339 Jul 27 22:55:36.477428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 444/874] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:36.605280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-16207878-bd3e-497c-9f60-3a83a10a2e9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:36.605887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-16207878-bd3e-497c-9f60-3a83a10a2e9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:36.611904 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-16207878-bd3e-497c-9f60-3a83a10a2e9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:36.612352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-16207878-bd3e-497c-9f60-3a83a10a2e9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:36.613141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-16207878-bd3e-497c-9f60-3a83a10a2e9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:36.613579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-16207878-bd3e-497c-9f60-3a83a10a2e9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:36.672860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-16207878-bd3e-497c-9f60-3a83a10a2e9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:36.680180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-16207878-bd3e-497c-9f60-3a83a10a2e9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078977 Jul 27 22:55:36.680779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 431/875] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:36 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:36.747159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-41700d53-58df-4530-9aac-a5bda3652d8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:36.749293 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-41700d53-58df-4530-9aac-a5bda3652d8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:36.755239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41700d53-58df-4530-9aac-a5bda3652d8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:36.755677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41700d53-58df-4530-9aac-a5bda3652d8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:36.756495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41700d53-58df-4530-9aac-a5bda3652d8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:36.756950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41700d53-58df-4530-9aac-a5bda3652d8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:36.786644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-41700d53-58df-4530-9aac-a5bda3652d8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044000 Jul 27 22:55:36.787187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 445/876] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:36 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:37.134184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3f2bbe8a-81ba-4dc0-a604-8cd65cd0a702 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:37.136307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3f2bbe8a-81ba-4dc0-a604-8cd65cd0a702 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:37.142271 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f2bbe8a-81ba-4dc0-a604-8cd65cd0a702 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:37.142708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f2bbe8a-81ba-4dc0-a604-8cd65cd0a702 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:37.143458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f2bbe8a-81ba-4dc0-a604-8cd65cd0a702 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:37.143883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f2bbe8a-81ba-4dc0-a604-8cd65cd0a702 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:37.172237 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3f2bbe8a-81ba-4dc0-a604-8cd65cd0a702 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041963 Jul 27 22:55:37.172825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 432/877] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:37 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:37.489242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0b68c553-698b-42a5-a5b5-4ac08097ffa4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:37.491422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0b68c553-698b-42a5-a5b5-4ac08097ffa4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:37.498080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b68c553-698b-42a5-a5b5-4ac08097ffa4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:37.498531 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b68c553-698b-42a5-a5b5-4ac08097ffa4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:37.499291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b68c553-698b-42a5-a5b5-4ac08097ffa4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:37.499727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b68c553-698b-42a5-a5b5-4ac08097ffa4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:37.528485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0b68c553-698b-42a5-a5b5-4ac08097ffa4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042690 Jul 27 22:55:37.529056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 446/878] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:37.701219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bd9c26f9-b970-4751-8c3a-f8b2ad02d67e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:37.701764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bd9c26f9-b970-4751-8c3a-f8b2ad02d67e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:37.703643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:37.709716 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd9c26f9-b970-4751-8c3a-f8b2ad02d67e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:37.710161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd9c26f9-b970-4751-8c3a-f8b2ad02d67e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:37.710916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd9c26f9-b970-4751-8c3a-f8b2ad02d67e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:37.711347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd9c26f9-b970-4751-8c3a-f8b2ad02d67e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:37.771128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bd9c26f9-b970-4751-8c3a-f8b2ad02d67e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:37.779233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bd9c26f9-b970-4751-8c3a-f8b2ad02d67e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081949 Jul 27 22:55:37.779791 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 433/879] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:37 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:37.798728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d39c6d6f-1252-4e31-873f-6893236e8ff2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:37.800881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d39c6d6f-1252-4e31-873f-6893236e8ff2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:37.806767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d39c6d6f-1252-4e31-873f-6893236e8ff2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:37.807208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d39c6d6f-1252-4e31-873f-6893236e8ff2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:37.807958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d39c6d6f-1252-4e31-873f-6893236e8ff2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:37.808383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d39c6d6f-1252-4e31-873f-6893236e8ff2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:37.836282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d39c6d6f-1252-4e31-873f-6893236e8ff2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041457 Jul 27 22:55:37.836849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 447/880] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:37 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:38.183610 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3d98853b-888e-450e-95b9-e6d1454e9dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:38.186278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3d98853b-888e-450e-95b9-e6d1454e9dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:38.192260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3d98853b-888e-450e-95b9-e6d1454e9dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:38.192745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3d98853b-888e-450e-95b9-e6d1454e9dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:38.193494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3d98853b-888e-450e-95b9-e6d1454e9dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:38.193920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3d98853b-888e-450e-95b9-e6d1454e9dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:38.222350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3d98853b-888e-450e-95b9-e6d1454e9dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042635 Jul 27 22:55:38.222899 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 434/881] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:38 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:38.540532 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-80ca3a72-fabe-40e0-a6b9-26a02f6d30cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:38.542743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-80ca3a72-fabe-40e0-a6b9-26a02f6d30cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:38.545060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:38.550245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80ca3a72-fabe-40e0-a6b9-26a02f6d30cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:38.550729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80ca3a72-fabe-40e0-a6b9-26a02f6d30cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:38.551487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80ca3a72-fabe-40e0-a6b9-26a02f6d30cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:38.551913 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80ca3a72-fabe-40e0-a6b9-26a02f6d30cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:38.580187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-80ca3a72-fabe-40e0-a6b9-26a02f6d30cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043603 Jul 27 22:55:38.580748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 448/882] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:38 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:38.801183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-34cad00b-7a39-489e-9e49-607c8e0681f1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:38.801722 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-34cad00b-7a39-489e-9e49-607c8e0681f1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:38.807701 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34cad00b-7a39-489e-9e49-607c8e0681f1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:38.808145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34cad00b-7a39-489e-9e49-607c8e0681f1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:38.808933 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34cad00b-7a39-489e-9e49-607c8e0681f1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:38.809373 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34cad00b-7a39-489e-9e49-607c8e0681f1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:38.848664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f9109e39-5347-49fa-9ca8-174314ba7776 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:38.850798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f9109e39-5347-49fa-9ca8-174314ba7776 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:38.857089 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9109e39-5347-49fa-9ca8-174314ba7776 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:38.857531 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9109e39-5347-49fa-9ca8-174314ba7776 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:38.858292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9109e39-5347-49fa-9ca8-174314ba7776 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:38.858715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9109e39-5347-49fa-9ca8-174314ba7776 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:38.872584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-34cad00b-7a39-489e-9e49-607c8e0681f1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:38.880118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-34cad00b-7a39-489e-9e49-607c8e0681f1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082801 Jul 27 22:55:38.880742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 435/883] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:38 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:38.888210 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f9109e39-5347-49fa-9ca8-174314ba7776 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042907 Jul 27 22:55:38.888783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 449/884] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:38 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:55:39.235323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0faad05f-2766-4f39-a3ef-9c054c09b2b4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:39.237523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0faad05f-2766-4f39-a3ef-9c054c09b2b4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:39.243499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0faad05f-2766-4f39-a3ef-9c054c09b2b4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:39.243942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0faad05f-2766-4f39-a3ef-9c054c09b2b4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:39.244720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0faad05f-2766-4f39-a3ef-9c054c09b2b4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:39.245153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0faad05f-2766-4f39-a3ef-9c054c09b2b4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:39.280648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0faad05f-2766-4f39-a3ef-9c054c09b2b4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049354 Jul 27 22:55:39.282581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 436/885] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:39 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:39.593325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e1a98577-78d2-4dee-8b20-2cc2d8c57921 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:39.595444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e1a98577-78d2-4dee-8b20-2cc2d8c57921 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:39.602172 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1a98577-78d2-4dee-8b20-2cc2d8c57921 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:39.602626 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1a98577-78d2-4dee-8b20-2cc2d8c57921 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:39.603396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1a98577-78d2-4dee-8b20-2cc2d8c57921 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:39.603833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1a98577-78d2-4dee-8b20-2cc2d8c57921 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:39.632147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e1a98577-78d2-4dee-8b20-2cc2d8c57921 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043489 Jul 27 22:55:39.632712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 450/886] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:39.899371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b36c7bb8-f701-4482-96d6-5dbbbba345a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:39.900448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0229a883-b8df-40fc-80dc-a70308bd7109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:39.901097 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0229a883-b8df-40fc-80dc-a70308bd7109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:39.901551 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b36c7bb8-f701-4482-96d6-5dbbbba345a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:39.907922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b36c7bb8-f701-4482-96d6-5dbbbba345a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:39.908082 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0229a883-b8df-40fc-80dc-a70308bd7109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:39.908360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b36c7bb8-f701-4482-96d6-5dbbbba345a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:39.908471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0229a883-b8df-40fc-80dc-a70308bd7109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:39.909150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b36c7bb8-f701-4482-96d6-5dbbbba345a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:39.909250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0229a883-b8df-40fc-80dc-a70308bd7109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:39.909582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b36c7bb8-f701-4482-96d6-5dbbbba345a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:39.909679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0229a883-b8df-40fc-80dc-a70308bd7109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:39.939652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b36c7bb8-f701-4482-96d6-5dbbbba345a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Jul 27 22:55:39.940212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 437/887] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:39 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:39.974614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0229a883-b8df-40fc-80dc-a70308bd7109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:39.982946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0229a883-b8df-40fc-80dc-a70308bd7109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.086196 Jul 27 22:55:39.983505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 451/888] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:39 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:55:40.292752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e86073ad-608c-47ff-8eda-f886909d20c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:40.294894 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e86073ad-608c-47ff-8eda-f886909d20c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:40.300879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e86073ad-608c-47ff-8eda-f886909d20c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:40.301327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e86073ad-608c-47ff-8eda-f886909d20c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:40.302096 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e86073ad-608c-47ff-8eda-f886909d20c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:40.302530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e86073ad-608c-47ff-8eda-f886909d20c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:40.330497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e86073ad-608c-47ff-8eda-f886909d20c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041716 Jul 27 22:55:40.331044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 438/889] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:40 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:40.644623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a15c9963-34d3-4bd0-ac5e-61ba8f4b9437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:40.646774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a15c9963-34d3-4bd0-ac5e-61ba8f4b9437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:40.653219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a15c9963-34d3-4bd0-ac5e-61ba8f4b9437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:40.653657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a15c9963-34d3-4bd0-ac5e-61ba8f4b9437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:40.654407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a15c9963-34d3-4bd0-ac5e-61ba8f4b9437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:40.654833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a15c9963-34d3-4bd0-ac5e-61ba8f4b9437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:40.682162 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a15c9963-34d3-4bd0-ac5e-61ba8f4b9437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041561 Jul 27 22:55:40.682692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 452/890] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:55:40.951433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-87ae5895-7cb5-4700-bf29-5bcd8c782c69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:40.953523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-87ae5895-7cb5-4700-bf29-5bcd8c782c69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:40.960908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87ae5895-7cb5-4700-bf29-5bcd8c782c69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:40.961351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87ae5895-7cb5-4700-bf29-5bcd8c782c69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:40.962107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87ae5895-7cb5-4700-bf29-5bcd8c782c69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:40.962534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87ae5895-7cb5-4700-bf29-5bcd8c782c69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:40.993058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-87ae5895-7cb5-4700-bf29-5bcd8c782c69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045564 Jul 27 22:55:40.993842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 439/891] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:40 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:41.003693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cd5cba57-030a-443e-baa9-1b8a5ba0720e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:41.004331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cd5cba57-030a-443e-baa9-1b8a5ba0720e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:41.010426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd5cba57-030a-443e-baa9-1b8a5ba0720e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:41.010872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd5cba57-030a-443e-baa9-1b8a5ba0720e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:41.011627 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd5cba57-030a-443e-baa9-1b8a5ba0720e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:41.012070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd5cba57-030a-443e-baa9-1b8a5ba0720e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:41.071321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cd5cba57-030a-443e-baa9-1b8a5ba0720e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:41.074756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:41.079255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cd5cba57-030a-443e-baa9-1b8a5ba0720e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079459 Jul 27 22:55:41.079806 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 453/892] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:40 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:41.343463 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-542c234d-2066-4562-8a56-b0c7d7aba603 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:41.345619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-542c234d-2066-4562-8a56-b0c7d7aba603 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:41.351810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-542c234d-2066-4562-8a56-b0c7d7aba603 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:41.352255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-542c234d-2066-4562-8a56-b0c7d7aba603 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:41.353039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-542c234d-2066-4562-8a56-b0c7d7aba603 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:41.353470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-542c234d-2066-4562-8a56-b0c7d7aba603 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:41.381542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-542c234d-2066-4562-8a56-b0c7d7aba603 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042644 Jul 27 22:55:41.382078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 440/893] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:41 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:41.694249 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c704f221-4626-4842-b9f3-909f02c7603f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:41.696367 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c704f221-4626-4842-b9f3-909f02c7603f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:41.703766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c704f221-4626-4842-b9f3-909f02c7603f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:41.704203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c704f221-4626-4842-b9f3-909f02c7603f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:41.704983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c704f221-4626-4842-b9f3-909f02c7603f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:41.705409 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c704f221-4626-4842-b9f3-909f02c7603f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:41.733852 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c704f221-4626-4842-b9f3-909f02c7603f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043677 Jul 27 22:55:41.734384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 454/894] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:42.006963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-966554bf-3d1e-4427-995e-220d7ddb0f85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:42.009048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-966554bf-3d1e-4427-995e-220d7ddb0f85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:42.015747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-966554bf-3d1e-4427-995e-220d7ddb0f85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:42.016193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-966554bf-3d1e-4427-995e-220d7ddb0f85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:42.016985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-966554bf-3d1e-4427-995e-220d7ddb0f85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:42.017420 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-966554bf-3d1e-4427-995e-220d7ddb0f85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:42.044863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-966554bf-3d1e-4427-995e-220d7ddb0f85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041965 Jul 27 22:55:42.045394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 441/895] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:42 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:42.099475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4c289cac-79f6-4f2c-8498-468cee24725f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:42.100078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4c289cac-79f6-4f2c-8498-468cee24725f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:42.106359 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4c289cac-79f6-4f2c-8498-468cee24725f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:42.106798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4c289cac-79f6-4f2c-8498-468cee24725f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:42.107547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4c289cac-79f6-4f2c-8498-468cee24725f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:42.107972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4c289cac-79f6-4f2c-8498-468cee24725f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:42.167388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4c289cac-79f6-4f2c-8498-468cee24725f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:42.174868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4c289cac-79f6-4f2c-8498-468cee24725f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079270 Jul 27 22:55:42.175417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 455/896] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:42 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:42.394057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e2f16613-01ca-42fe-b482-714eb9302326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:42.396251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e2f16613-01ca-42fe-b482-714eb9302326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:42.402352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2f16613-01ca-42fe-b482-714eb9302326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:42.402802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2f16613-01ca-42fe-b482-714eb9302326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:42.403574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2f16613-01ca-42fe-b482-714eb9302326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:42.404015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2f16613-01ca-42fe-b482-714eb9302326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:42.431923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e2f16613-01ca-42fe-b482-714eb9302326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041821 Jul 27 22:55:42.432478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 442/897] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:42 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:55:42.746202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fd40c453-4374-4113-bb83-eabd4ff588a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:42.748484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fd40c453-4374-4113-bb83-eabd4ff588a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:42.754968 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fd40c453-4374-4113-bb83-eabd4ff588a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:42.755402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fd40c453-4374-4113-bb83-eabd4ff588a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:42.756150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fd40c453-4374-4113-bb83-eabd4ff588a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:42.756598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fd40c453-4374-4113-bb83-eabd4ff588a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:42.784654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fd40c453-4374-4113-bb83-eabd4ff588a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042485 Jul 27 22:55:42.785186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 456/898] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:43.057395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-85997560-35c9-4da4-858d-d03acdeafa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:43.059598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-85997560-35c9-4da4-858d-d03acdeafa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:43.065591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85997560-35c9-4da4-858d-d03acdeafa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:43.066038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85997560-35c9-4da4-858d-d03acdeafa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:43.066797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85997560-35c9-4da4-858d-d03acdeafa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:43.067232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85997560-35c9-4da4-858d-d03acdeafa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:43.092441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:43.097442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-85997560-35c9-4da4-858d-d03acdeafa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044013 Jul 27 22:55:43.097995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 443/899] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:43 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:43.195175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bd262c9a-e325-4888-9d08-be23138c13d4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:43.195789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bd262c9a-e325-4888-9d08-be23138c13d4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:43.202331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bd262c9a-e325-4888-9d08-be23138c13d4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:43.202776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bd262c9a-e325-4888-9d08-be23138c13d4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:43.203529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bd262c9a-e325-4888-9d08-be23138c13d4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:43.203959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bd262c9a-e325-4888-9d08-be23138c13d4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:43.263839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bd262c9a-e325-4888-9d08-be23138c13d4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:43.271320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bd262c9a-e325-4888-9d08-be23138c13d4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080074 Jul 27 22:55:43.271870 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 457/900] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:43 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:43.444179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-76b96711-021d-4f78-87bc-54447ebaa5f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:43.446264 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-76b96711-021d-4f78-87bc-54447ebaa5f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:43.453054 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76b96711-021d-4f78-87bc-54447ebaa5f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:43.453503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76b96711-021d-4f78-87bc-54447ebaa5f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:43.454268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76b96711-021d-4f78-87bc-54447ebaa5f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:43.454708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76b96711-021d-4f78-87bc-54447ebaa5f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:43.482355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-76b96711-021d-4f78-87bc-54447ebaa5f8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042220 Jul 27 22:55:43.482896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 444/901] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:43 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:43.797372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-82f69fec-3306-4a36-ac32-45247903928d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:43.799528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-82f69fec-3306-4a36-ac32-45247903928d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:43.806011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82f69fec-3306-4a36-ac32-45247903928d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:43.806457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82f69fec-3306-4a36-ac32-45247903928d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:43.807214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82f69fec-3306-4a36-ac32-45247903928d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:43.807689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82f69fec-3306-4a36-ac32-45247903928d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:43.836137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-82f69fec-3306-4a36-ac32-45247903928d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043324 Jul 27 22:55:43.836698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 458/902] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:44.110633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1809162c-ab7b-41d5-ad7b-9280118f78e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:44.112748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1809162c-ab7b-41d5-ad7b-9280118f78e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:44.118715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1809162c-ab7b-41d5-ad7b-9280118f78e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:44.119151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1809162c-ab7b-41d5-ad7b-9280118f78e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:44.119893 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1809162c-ab7b-41d5-ad7b-9280118f78e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:44.120318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1809162c-ab7b-41d5-ad7b-9280118f78e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:44.150308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1809162c-ab7b-41d5-ad7b-9280118f78e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044253 Jul 27 22:55:44.151066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 445/903] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:44 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:44.292171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-51c4bc02-ad37-455a-be7d-fc1723bfdad5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:44.292818 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-51c4bc02-ad37-455a-be7d-fc1723bfdad5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:44.299445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51c4bc02-ad37-455a-be7d-fc1723bfdad5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:44.299893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51c4bc02-ad37-455a-be7d-fc1723bfdad5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:44.300675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51c4bc02-ad37-455a-be7d-fc1723bfdad5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:44.301109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51c4bc02-ad37-455a-be7d-fc1723bfdad5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:44.365019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-51c4bc02-ad37-455a-be7d-fc1723bfdad5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:44.372471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-51c4bc02-ad37-455a-be7d-fc1723bfdad5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084224 Jul 27 22:55:44.373057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 459/904] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:44 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:44.494521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fc2a6a35-9658-4ffa-ad8b-5600e356915f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:44.496783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fc2a6a35-9658-4ffa-ad8b-5600e356915f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:44.502698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc2a6a35-9658-4ffa-ad8b-5600e356915f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:44.503138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc2a6a35-9658-4ffa-ad8b-5600e356915f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:44.503882 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc2a6a35-9658-4ffa-ad8b-5600e356915f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:44.504307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc2a6a35-9658-4ffa-ad8b-5600e356915f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:44.532890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fc2a6a35-9658-4ffa-ad8b-5600e356915f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 Jul 27 22:55:44.533419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 446/905] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:44 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:44.847941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-893ba294-2491-414a-9a84-ffe50f2cdc29 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:44.850117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-893ba294-2491-414a-9a84-ffe50f2cdc29 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:44.856859 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-893ba294-2491-414a-9a84-ffe50f2cdc29 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:44.857325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-893ba294-2491-414a-9a84-ffe50f2cdc29 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:44.858083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-893ba294-2491-414a-9a84-ffe50f2cdc29 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:44.858512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-893ba294-2491-414a-9a84-ffe50f2cdc29 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:44.886650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-893ba294-2491-414a-9a84-ffe50f2cdc29 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042699 Jul 27 22:55:44.887730 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 460/906] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:44 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:45.163205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8335af8a-1be3-4c6e-86a0-25e92e80a063 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:45.165359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8335af8a-1be3-4c6e-86a0-25e92e80a063 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:45.171291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8335af8a-1be3-4c6e-86a0-25e92e80a063 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:45.171732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8335af8a-1be3-4c6e-86a0-25e92e80a063 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:45.172481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8335af8a-1be3-4c6e-86a0-25e92e80a063 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:45.172934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8335af8a-1be3-4c6e-86a0-25e92e80a063 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:45.201981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8335af8a-1be3-4c6e-86a0-25e92e80a063 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042717 Jul 27 22:55:45.202528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 447/907] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:45 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:45.392867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fa1b9989-c6e2-4ecb-bbac-7740ff40d411 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:45.393472 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fa1b9989-c6e2-4ecb-bbac-7740ff40d411 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:45.399408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa1b9989-c6e2-4ecb-bbac-7740ff40d411 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:45.399849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa1b9989-c6e2-4ecb-bbac-7740ff40d411 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:45.400617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa1b9989-c6e2-4ecb-bbac-7740ff40d411 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:45.401045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa1b9989-c6e2-4ecb-bbac-7740ff40d411 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:45.460013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fa1b9989-c6e2-4ecb-bbac-7740ff40d411 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:45.467448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fa1b9989-c6e2-4ecb-bbac-7740ff40d411 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078515 Jul 27 22:55:45.467998 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 461/908] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:45 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:45.545894 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0315f0f3-94b6-4ab9-b45e-222f6c4690f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:45.548028 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0315f0f3-94b6-4ab9-b45e-222f6c4690f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:45.553917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0315f0f3-94b6-4ab9-b45e-222f6c4690f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:45.554354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0315f0f3-94b6-4ab9-b45e-222f6c4690f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:45.555100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0315f0f3-94b6-4ab9-b45e-222f6c4690f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:45.555523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0315f0f3-94b6-4ab9-b45e-222f6c4690f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:45.583299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0315f0f3-94b6-4ab9-b45e-222f6c4690f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041802 Jul 27 22:55:45.583825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 448/909] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:45 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:45.899380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e22960a7-9f8b-49ad-b384-7eca22275366 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:45.901538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e22960a7-9f8b-49ad-b384-7eca22275366 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:45.908418 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e22960a7-9f8b-49ad-b384-7eca22275366 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:45.908888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e22960a7-9f8b-49ad-b384-7eca22275366 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:45.909643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e22960a7-9f8b-49ad-b384-7eca22275366 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:45.910071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e22960a7-9f8b-49ad-b384-7eca22275366 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:45.938265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e22960a7-9f8b-49ad-b384-7eca22275366 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042927 Jul 27 22:55:45.938794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 462/910] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:45 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:46.214175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bb3bf871-5853-42ff-9055-8810b58dc7d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:46.216943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bb3bf871-5853-42ff-9055-8810b58dc7d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:46.223666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb3bf871-5853-42ff-9055-8810b58dc7d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:46.224392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb3bf871-5853-42ff-9055-8810b58dc7d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:46.225180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb3bf871-5853-42ff-9055-8810b58dc7d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:46.225609 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb3bf871-5853-42ff-9055-8810b58dc7d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:46.260714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bb3bf871-5853-42ff-9055-8810b58dc7d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050447 Jul 27 22:55:46.261270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 449/911] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:46 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:46.487941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-42f5c631-deaf-4cc1-b9ee-226fb3d808aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:46.488480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-42f5c631-deaf-4cc1-b9ee-226fb3d808aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:46.494586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42f5c631-deaf-4cc1-b9ee-226fb3d808aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:46.495040 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42f5c631-deaf-4cc1-b9ee-226fb3d808aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:46.495800 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42f5c631-deaf-4cc1-b9ee-226fb3d808aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:46.496237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42f5c631-deaf-4cc1-b9ee-226fb3d808aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:46.556436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-42f5c631-deaf-4cc1-b9ee-226fb3d808aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:46.564355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-42f5c631-deaf-4cc1-b9ee-226fb3d808aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080391 Jul 27 22:55:46.564943 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 463/912] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:46 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:46.595399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-29f64340-876b-4126-8676-56e27304b3d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:46.597550 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-29f64340-876b-4126-8676-56e27304b3d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:46.603670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29f64340-876b-4126-8676-56e27304b3d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:46.604105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29f64340-876b-4126-8676-56e27304b3d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:46.604878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29f64340-876b-4126-8676-56e27304b3d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:46.605299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29f64340-876b-4126-8676-56e27304b3d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:46.632709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-29f64340-876b-4126-8676-56e27304b3d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041412 Jul 27 22:55:46.633245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 450/913] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:46 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:46.950592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-decc5a12-d176-4713-8129-c9a336cac287 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:46.952769 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-decc5a12-d176-4713-8129-c9a336cac287 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:46.959217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-decc5a12-d176-4713-8129-c9a336cac287 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:46.959663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-decc5a12-d176-4713-8129-c9a336cac287 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:46.960423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-decc5a12-d176-4713-8129-c9a336cac287 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:46.960891 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-decc5a12-d176-4713-8129-c9a336cac287 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:46.989389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-decc5a12-d176-4713-8129-c9a336cac287 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042823 Jul 27 22:55:46.989927 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 464/914] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:55:47.273562 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-02078a39-bae1-426e-8953-bf3115f192b6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:47.275638 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-02078a39-bae1-426e-8953-bf3115f192b6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:47.282286 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-02078a39-bae1-426e-8953-bf3115f192b6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:47.282731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-02078a39-bae1-426e-8953-bf3115f192b6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:47.283484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-02078a39-bae1-426e-8953-bf3115f192b6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:47.283914 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-02078a39-bae1-426e-8953-bf3115f192b6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:47.312210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-02078a39-bae1-426e-8953-bf3115f192b6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042798 Jul 27 22:55:47.312777 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 451/915] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:47 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:47.585542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5f31e19c-8de9-4b12-ba95-73ffaec8fa5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:47.586261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5f31e19c-8de9-4b12-ba95-73ffaec8fa5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:47.592893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f31e19c-8de9-4b12-ba95-73ffaec8fa5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:47.593310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f31e19c-8de9-4b12-ba95-73ffaec8fa5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:47.594067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f31e19c-8de9-4b12-ba95-73ffaec8fa5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:47.594500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f31e19c-8de9-4b12-ba95-73ffaec8fa5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:47.644743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-249d3871-6816-4681-8b3e-25dd7847ad51 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:47.646927 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-249d3871-6816-4681-8b3e-25dd7847ad51 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:47.653572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-249d3871-6816-4681-8b3e-25dd7847ad51 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:47.654018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-249d3871-6816-4681-8b3e-25dd7847ad51 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:47.654665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5f31e19c-8de9-4b12-ba95-73ffaec8fa5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:47.654803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-249d3871-6816-4681-8b3e-25dd7847ad51 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:47.655196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-249d3871-6816-4681-8b3e-25dd7847ad51 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:47.662154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5f31e19c-8de9-4b12-ba95-73ffaec8fa5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080576 Jul 27 22:55:47.662708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 465/916] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:47 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:47.683024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-249d3871-6816-4681-8b3e-25dd7847ad51 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042201 Jul 27 22:55:47.683562 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 452/917] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:47 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:55:48.002710 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-97eca119-0d3a-4482-8422-13229e2190e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:48.004949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-97eca119-0d3a-4482-8422-13229e2190e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:48.011418 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97eca119-0d3a-4482-8422-13229e2190e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:48.011863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97eca119-0d3a-4482-8422-13229e2190e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:48.013322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97eca119-0d3a-4482-8422-13229e2190e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:48.013762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97eca119-0d3a-4482-8422-13229e2190e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:48.041672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-97eca119-0d3a-4482-8422-13229e2190e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043046 Jul 27 22:55:48.042217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 466/918] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:48.324365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7cef59bd-08a0-4c75-88de-3a3a49b4c6a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:48.326515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7cef59bd-08a0-4c75-88de-3a3a49b4c6a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:48.332538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7cef59bd-08a0-4c75-88de-3a3a49b4c6a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:48.333015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7cef59bd-08a0-4c75-88de-3a3a49b4c6a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:48.333767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7cef59bd-08a0-4c75-88de-3a3a49b4c6a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:48.334198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7cef59bd-08a0-4c75-88de-3a3a49b4c6a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:48.362546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7cef59bd-08a0-4c75-88de-3a3a49b4c6a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042149 Jul 27 22:55:48.363091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 453/919] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:48 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:48.682760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3578db76-e0f7-4bea-810e-c2091aa20e10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:48.683284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3578db76-e0f7-4bea-810e-c2091aa20e10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:48.689246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3578db76-e0f7-4bea-810e-c2091aa20e10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:48.689759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3578db76-e0f7-4bea-810e-c2091aa20e10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:48.690468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3578db76-e0f7-4bea-810e-c2091aa20e10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:48.690941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3578db76-e0f7-4bea-810e-c2091aa20e10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:48.695568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-db392ff0-933d-4af6-b6f1-3d0c9630270d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:48.697745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-db392ff0-933d-4af6-b6f1-3d0c9630270d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:48.703760 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db392ff0-933d-4af6-b6f1-3d0c9630270d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:48.704198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db392ff0-933d-4af6-b6f1-3d0c9630270d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:48.705151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db392ff0-933d-4af6-b6f1-3d0c9630270d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:48.705586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db392ff0-933d-4af6-b6f1-3d0c9630270d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:48.734888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-db392ff0-933d-4af6-b6f1-3d0c9630270d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043115 Jul 27 22:55:48.735448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 454/920] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:48 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:55:48.754719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3578db76-e0f7-4bea-810e-c2091aa20e10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:48.762258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3578db76-e0f7-4bea-810e-c2091aa20e10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083547 Jul 27 22:55:48.762817 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 467/921] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:48 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:49.053849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3c9e4a2c-02b1-426f-b55e-2c36c37ad1d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:49.055998 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3c9e4a2c-02b1-426f-b55e-2c36c37ad1d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:49.062028 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c9e4a2c-02b1-426f-b55e-2c36c37ad1d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:49.062468 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c9e4a2c-02b1-426f-b55e-2c36c37ad1d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:49.063248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c9e4a2c-02b1-426f-b55e-2c36c37ad1d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:49.063677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c9e4a2c-02b1-426f-b55e-2c36c37ad1d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:49.092434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3c9e4a2c-02b1-426f-b55e-2c36c37ad1d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042534 Jul 27 22:55:49.093002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 455/922] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:49 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:49.375249 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-66506a37-394b-42ae-badb-10121f8f1008 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:49.377391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-66506a37-394b-42ae-badb-10121f8f1008 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:49.383366 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-66506a37-394b-42ae-badb-10121f8f1008 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:49.383807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-66506a37-394b-42ae-badb-10121f8f1008 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:49.384573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-66506a37-394b-42ae-badb-10121f8f1008 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:49.385021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-66506a37-394b-42ae-badb-10121f8f1008 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:49.413226 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-66506a37-394b-42ae-badb-10121f8f1008 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042491 Jul 27 22:55:49.413763 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 468/923] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:49 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:49.747949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bf63cdc9-58c5-40b4-8885-af9208f4c52c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:49.750117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bf63cdc9-58c5-40b4-8885-af9208f4c52c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:49.756092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf63cdc9-58c5-40b4-8885-af9208f4c52c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:49.756532 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf63cdc9-58c5-40b4-8885-af9208f4c52c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:49.757310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf63cdc9-58c5-40b4-8885-af9208f4c52c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:49.757739 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf63cdc9-58c5-40b4-8885-af9208f4c52c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:49.782484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2781e0c0-e759-4a9a-b868-6efda946ed68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:49.783094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2781e0c0-e759-4a9a-b868-6efda946ed68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:49.785207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bf63cdc9-58c5-40b4-8885-af9208f4c52c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041887 Jul 27 22:55:49.785764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 456/924] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:49 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:49.789486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2781e0c0-e759-4a9a-b868-6efda946ed68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:49.789942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2781e0c0-e759-4a9a-b868-6efda946ed68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:49.790684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2781e0c0-e759-4a9a-b868-6efda946ed68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:49.791112 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2781e0c0-e759-4a9a-b868-6efda946ed68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:49.850633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2781e0c0-e759-4a9a-b868-6efda946ed68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:49.858663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2781e0c0-e759-4a9a-b868-6efda946ed68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080035 Jul 27 22:55:49.859214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 469/925] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:49 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:55:50.104992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-df694a81-03c2-4843-93fb-e87a4a245925 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:50.107115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-df694a81-03c2-4843-93fb-e87a4a245925 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:50.113728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df694a81-03c2-4843-93fb-e87a4a245925 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:50.114176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df694a81-03c2-4843-93fb-e87a4a245925 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:50.114938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df694a81-03c2-4843-93fb-e87a4a245925 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:50.115374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df694a81-03c2-4843-93fb-e87a4a245925 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:50.143493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-df694a81-03c2-4843-93fb-e87a4a245925 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042765 Jul 27 22:55:50.144045 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 457/926] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:50 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:50.425929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d47ed4f4-6068-455a-9e95-3f2b4d60dc30 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:50.427976 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d47ed4f4-6068-455a-9e95-3f2b4d60dc30 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:50.433971 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d47ed4f4-6068-455a-9e95-3f2b4d60dc30 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:50.434414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d47ed4f4-6068-455a-9e95-3f2b4d60dc30 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:50.435170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d47ed4f4-6068-455a-9e95-3f2b4d60dc30 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:50.436260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d47ed4f4-6068-455a-9e95-3f2b4d60dc30 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:50.451842 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:50.464869 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d47ed4f4-6068-455a-9e95-3f2b4d60dc30 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042934 Jul 27 22:55:50.465414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 470/927] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:50 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:50.797615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d580001f-67e0-4bc4-a388-b6424ce6e3c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:50.799738 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d580001f-67e0-4bc4-a388-b6424ce6e3c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:50.805731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d580001f-67e0-4bc4-a388-b6424ce6e3c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:50.806172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d580001f-67e0-4bc4-a388-b6424ce6e3c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:50.806917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d580001f-67e0-4bc4-a388-b6424ce6e3c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:50.807342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d580001f-67e0-4bc4-a388-b6424ce6e3c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:50.835018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d580001f-67e0-4bc4-a388-b6424ce6e3c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 Jul 27 22:55:50.835555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 458/928] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:50.878984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-351eb9a5-52e2-4150-b1f8-89019c697839 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:50.879592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-351eb9a5-52e2-4150-b1f8-89019c697839 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:50.885989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-351eb9a5-52e2-4150-b1f8-89019c697839 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:50.886433 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-351eb9a5-52e2-4150-b1f8-89019c697839 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:50.887214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-351eb9a5-52e2-4150-b1f8-89019c697839 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:50.887644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-351eb9a5-52e2-4150-b1f8-89019c697839 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:50.946918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-351eb9a5-52e2-4150-b1f8-89019c697839 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:50.954261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-351eb9a5-52e2-4150-b1f8-89019c697839 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079113 Jul 27 22:55:50.954814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 471/929] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:50 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:51.156152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-174ebbc0-60e4-45e7-8339-a4576164ced2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:51.158316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-174ebbc0-60e4-45e7-8339-a4576164ced2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:51.164251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-174ebbc0-60e4-45e7-8339-a4576164ced2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:51.164723 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-174ebbc0-60e4-45e7-8339-a4576164ced2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:51.165476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-174ebbc0-60e4-45e7-8339-a4576164ced2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:51.165903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-174ebbc0-60e4-45e7-8339-a4576164ced2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:51.194092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-174ebbc0-60e4-45e7-8339-a4576164ced2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042462 Jul 27 22:55:51.194955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 459/930] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:51 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:51.477538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bdf0ab02-3659-4e8f-bcde-5f639a77d4a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:51.479597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bdf0ab02-3659-4e8f-bcde-5f639a77d4a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:51.485767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bdf0ab02-3659-4e8f-bcde-5f639a77d4a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:51.486212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bdf0ab02-3659-4e8f-bcde-5f639a77d4a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:51.487000 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bdf0ab02-3659-4e8f-bcde-5f639a77d4a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:51.487466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bdf0ab02-3659-4e8f-bcde-5f639a77d4a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:51.515370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bdf0ab02-3659-4e8f-bcde-5f639a77d4a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042107 Jul 27 22:55:51.515907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 472/931] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:51 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:51.847083 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-688dd5b0-5ab2-4c53-a3cf-f9d7bc525f79 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:51.849247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-688dd5b0-5ab2-4c53-a3cf-f9d7bc525f79 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:51.855538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-688dd5b0-5ab2-4c53-a3cf-f9d7bc525f79 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:51.855979 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-688dd5b0-5ab2-4c53-a3cf-f9d7bc525f79 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:51.856761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-688dd5b0-5ab2-4c53-a3cf-f9d7bc525f79 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:51.857190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-688dd5b0-5ab2-4c53-a3cf-f9d7bc525f79 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:51.873704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:51.886016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-688dd5b0-5ab2-4c53-a3cf-f9d7bc525f79 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042884 Jul 27 22:55:51.886557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 460/932] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:51 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:51.974939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-75052042-6d14-4818-96ac-369c28b312ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:51.975550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-75052042-6d14-4818-96ac-369c28b312ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:51.982754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75052042-6d14-4818-96ac-369c28b312ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:51.983188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75052042-6d14-4818-96ac-369c28b312ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:51.983951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75052042-6d14-4818-96ac-369c28b312ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:51.984381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75052042-6d14-4818-96ac-369c28b312ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:52.044203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-75052042-6d14-4818-96ac-369c28b312ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:52.051997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-75052042-6d14-4818-96ac-369c28b312ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080870 Jul 27 22:55:52.052576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 473/933] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:51 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:52.206899 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-29a4fb4b-1fdb-4255-99d7-e45982049c40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:52.209052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-29a4fb4b-1fdb-4255-99d7-e45982049c40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:52.215050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29a4fb4b-1fdb-4255-99d7-e45982049c40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:52.215497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29a4fb4b-1fdb-4255-99d7-e45982049c40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:52.216258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29a4fb4b-1fdb-4255-99d7-e45982049c40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:52.216727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29a4fb4b-1fdb-4255-99d7-e45982049c40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:52.245660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-29a4fb4b-1fdb-4255-99d7-e45982049c40 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042814 Jul 27 22:55:52.246215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 461/934] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:52 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:52.527649 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2d1922f9-471a-45b9-a04a-75bf9b10b36c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:52.529846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2d1922f9-471a-45b9-a04a-75bf9b10b36c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:52.535778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d1922f9-471a-45b9-a04a-75bf9b10b36c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:52.536220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d1922f9-471a-45b9-a04a-75bf9b10b36c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:52.537008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d1922f9-471a-45b9-a04a-75bf9b10b36c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:52.537442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d1922f9-471a-45b9-a04a-75bf9b10b36c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:52.565422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2d1922f9-471a-45b9-a04a-75bf9b10b36c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041815 Jul 27 22:55:52.565954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 474/935] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:52 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:55:52.898844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8f8fb545-62ef-45ee-940d-10a2dbb09676 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:52.900988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8f8fb545-62ef-45ee-940d-10a2dbb09676 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:52.907188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f8fb545-62ef-45ee-940d-10a2dbb09676 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:52.907632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f8fb545-62ef-45ee-940d-10a2dbb09676 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:52.908380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f8fb545-62ef-45ee-940d-10a2dbb09676 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:52.908853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f8fb545-62ef-45ee-940d-10a2dbb09676 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:52.937618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8f8fb545-62ef-45ee-940d-10a2dbb09676 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042742 Jul 27 22:55:52.938153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 462/936] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:52 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:55:53.072045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6a0d2acb-36c4-4968-8fc2-4c3b9568a7cd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:53.072679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6a0d2acb-36c4-4968-8fc2-4c3b9568a7cd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:53.079105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a0d2acb-36c4-4968-8fc2-4c3b9568a7cd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:53.079552 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a0d2acb-36c4-4968-8fc2-4c3b9568a7cd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:53.080306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a0d2acb-36c4-4968-8fc2-4c3b9568a7cd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:53.080765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a0d2acb-36c4-4968-8fc2-4c3b9568a7cd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:53.143546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6a0d2acb-36c4-4968-8fc2-4c3b9568a7cd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:53.154008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6a0d2acb-36c4-4968-8fc2-4c3b9568a7cd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.085621 Jul 27 22:55:53.155371 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 475/937] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:53 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:53.258449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-98347201-fd83-4f7b-a30f-28c89bc33e19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:53.260585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-98347201-fd83-4f7b-a30f-28c89bc33e19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:53.266882 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98347201-fd83-4f7b-a30f-28c89bc33e19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:53.267325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98347201-fd83-4f7b-a30f-28c89bc33e19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:53.268081 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98347201-fd83-4f7b-a30f-28c89bc33e19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:53.268517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98347201-fd83-4f7b-a30f-28c89bc33e19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:53.297554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-98347201-fd83-4f7b-a30f-28c89bc33e19 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043074 Jul 27 22:55:53.298097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 463/938] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:53 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:53.577897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-260cd71e-33ce-4a45-a593-4162ffbc8db6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:53.580141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-260cd71e-33ce-4a45-a593-4162ffbc8db6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:53.586168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-260cd71e-33ce-4a45-a593-4162ffbc8db6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:53.586619 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-260cd71e-33ce-4a45-a593-4162ffbc8db6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:53.587403 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-260cd71e-33ce-4a45-a593-4162ffbc8db6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:53.587833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-260cd71e-33ce-4a45-a593-4162ffbc8db6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:53.616485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-260cd71e-33ce-4a45-a593-4162ffbc8db6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043331 Jul 27 22:55:53.617052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 476/939] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:53 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:53.949326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4903394f-bc38-4bdc-9bc0-e17942aedfbb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:53.951502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4903394f-bc38-4bdc-9bc0-e17942aedfbb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:53.957542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4903394f-bc38-4bdc-9bc0-e17942aedfbb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:53.957989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4903394f-bc38-4bdc-9bc0-e17942aedfbb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:53.958749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4903394f-bc38-4bdc-9bc0-e17942aedfbb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:53.959185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4903394f-bc38-4bdc-9bc0-e17942aedfbb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:53.987768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4903394f-bc38-4bdc-9bc0-e17942aedfbb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042757 Jul 27 22:55:53.988315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 464/940] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:53 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:54.175566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-45fd6bf7-8fed-4e2c-9c3c-9b279d200c57 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:54.176316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-45fd6bf7-8fed-4e2c-9c3c-9b279d200c57 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:54.183117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45fd6bf7-8fed-4e2c-9c3c-9b279d200c57 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:54.183596 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45fd6bf7-8fed-4e2c-9c3c-9b279d200c57 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:54.184405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45fd6bf7-8fed-4e2c-9c3c-9b279d200c57 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:54.184873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45fd6bf7-8fed-4e2c-9c3c-9b279d200c57 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:54.249230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-45fd6bf7-8fed-4e2c-9c3c-9b279d200c57 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:54.259757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-45fd6bf7-8fed-4e2c-9c3c-9b279d200c57 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.088090 Jul 27 22:55:54.272911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 477/941] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:54 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:54.310023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c9e6c20d-536c-4c38-82cd-468b283ca9d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:54.312145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c9e6c20d-536c-4c38-82cd-468b283ca9d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:54.318086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9e6c20d-536c-4c38-82cd-468b283ca9d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:54.318530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9e6c20d-536c-4c38-82cd-468b283ca9d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:54.319279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9e6c20d-536c-4c38-82cd-468b283ca9d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:54.319705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9e6c20d-536c-4c38-82cd-468b283ca9d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:54.349396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c9e6c20d-536c-4c38-82cd-468b283ca9d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043272 Jul 27 22:55:54.349954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 465/942] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:54 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:54.628986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2bc08ffd-3b07-487f-a588-097b03819352 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:54.631836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2bc08ffd-3b07-487f-a588-097b03819352 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:54.638008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2bc08ffd-3b07-487f-a588-097b03819352 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:54.638457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2bc08ffd-3b07-487f-a588-097b03819352 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:54.639950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2bc08ffd-3b07-487f-a588-097b03819352 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:54.640376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2bc08ffd-3b07-487f-a588-097b03819352 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:54.667958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2bc08ffd-3b07-487f-a588-097b03819352 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043148 Jul 27 22:55:54.668519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 478/943] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:54 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:55.000016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ee7faa00-488d-4dcd-97c1-a8c9146c2661 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:55.002178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ee7faa00-488d-4dcd-97c1-a8c9146c2661 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:55.008141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ee7faa00-488d-4dcd-97c1-a8c9146c2661 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:55.008620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ee7faa00-488d-4dcd-97c1-a8c9146c2661 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:55.009383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ee7faa00-488d-4dcd-97c1-a8c9146c2661 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:55.009818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ee7faa00-488d-4dcd-97c1-a8c9146c2661 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:55.037338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ee7faa00-488d-4dcd-97c1-a8c9146c2661 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041855 Jul 27 22:55:55.037884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 466/944] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:54 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:55.282009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9e45d3f5-398f-488b-b78c-55665bc0be1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:55.282547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9e45d3f5-398f-488b-b78c-55665bc0be1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:55.289220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e45d3f5-398f-488b-b78c-55665bc0be1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:55.289701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e45d3f5-398f-488b-b78c-55665bc0be1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:55.290488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e45d3f5-398f-488b-b78c-55665bc0be1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:55.290924 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e45d3f5-398f-488b-b78c-55665bc0be1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:55.351204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9e45d3f5-398f-488b-b78c-55665bc0be1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:55.359617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9e45d3f5-398f-488b-b78c-55665bc0be1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081537 Jul 27 22:55:55.360178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 479/945] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:55 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:55.362777 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b26ee491-b8dd-44fd-97ca-1bcce48f85f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:55.365037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b26ee491-b8dd-44fd-97ca-1bcce48f85f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:55.370988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b26ee491-b8dd-44fd-97ca-1bcce48f85f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:55.371439 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b26ee491-b8dd-44fd-97ca-1bcce48f85f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:55.372200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b26ee491-b8dd-44fd-97ca-1bcce48f85f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:55.372726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b26ee491-b8dd-44fd-97ca-1bcce48f85f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:55.400406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b26ee491-b8dd-44fd-97ca-1bcce48f85f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041848 Jul 27 22:55:55.400987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 467/946] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:55 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:55:55.679636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-343b326d-18ec-42a7-8839-add6d79f840f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:55.681818 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-343b326d-18ec-42a7-8839-add6d79f840f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:55.687828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-343b326d-18ec-42a7-8839-add6d79f840f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:55.688272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-343b326d-18ec-42a7-8839-add6d79f840f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:55.689054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-343b326d-18ec-42a7-8839-add6d79f840f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:55.689485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-343b326d-18ec-42a7-8839-add6d79f840f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:55.718705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-343b326d-18ec-42a7-8839-add6d79f840f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043005 Jul 27 22:55:55.719252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 480/947] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:55 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:56.049452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-de9a0d34-51fe-4712-b4a0-a4219e1e0044 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:56.051607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-de9a0d34-51fe-4712-b4a0-a4219e1e0044 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:56.057573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de9a0d34-51fe-4712-b4a0-a4219e1e0044 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:56.058016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de9a0d34-51fe-4712-b4a0-a4219e1e0044 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:56.058775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de9a0d34-51fe-4712-b4a0-a4219e1e0044 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:56.059207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de9a0d34-51fe-4712-b4a0-a4219e1e0044 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:56.087763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-de9a0d34-51fe-4712-b4a0-a4219e1e0044 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042242 Jul 27 22:55:56.088320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 468/948] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:56 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:56.379660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6e092705-16dd-429d-ba78-f9d825595ad3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:56.380274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6e092705-16dd-429d-ba78-f9d825595ad3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:56.386784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6e092705-16dd-429d-ba78-f9d825595ad3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:56.387229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6e092705-16dd-429d-ba78-f9d825595ad3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:56.387988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6e092705-16dd-429d-ba78-f9d825595ad3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:56.389139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6e092705-16dd-429d-ba78-f9d825595ad3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:56.413208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4aa9b5b9-0698-4ab9-b671-5cfe2516be50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:56.415285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4aa9b5b9-0698-4ab9-b671-5cfe2516be50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:56.421703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4aa9b5b9-0698-4ab9-b671-5cfe2516be50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:56.422149 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4aa9b5b9-0698-4ab9-b671-5cfe2516be50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:56.422942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4aa9b5b9-0698-4ab9-b671-5cfe2516be50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:56.423374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4aa9b5b9-0698-4ab9-b671-5cfe2516be50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:56.455175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6e092705-16dd-429d-ba78-f9d825595ad3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:56.458039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4aa9b5b9-0698-4ab9-b671-5cfe2516be50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048708 Jul 27 22:55:56.458785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 469/949] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:55:56.463294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6e092705-16dd-429d-ba78-f9d825595ad3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.087534 Jul 27 22:55:56.463845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 481/950] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:56 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:56.731382 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-deddc4e2-9f72-44e0-a769-b9b1fa5b774e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:56.733974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-deddc4e2-9f72-44e0-a769-b9b1fa5b774e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:56.739874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-deddc4e2-9f72-44e0-a769-b9b1fa5b774e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:56.740315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-deddc4e2-9f72-44e0-a769-b9b1fa5b774e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:56.741103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-deddc4e2-9f72-44e0-a769-b9b1fa5b774e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:56.741536 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-deddc4e2-9f72-44e0-a769-b9b1fa5b774e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:56.769712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-deddc4e2-9f72-44e0-a769-b9b1fa5b774e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042383 Jul 27 22:55:56.770260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 470/951] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:56 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:57.099951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-739e4dea-83ec-4e41-89d5-1d4de2335ae9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:57.102397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-739e4dea-83ec-4e41-89d5-1d4de2335ae9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:57.108919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-739e4dea-83ec-4e41-89d5-1d4de2335ae9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:57.109377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-739e4dea-83ec-4e41-89d5-1d4de2335ae9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:57.110131 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-739e4dea-83ec-4e41-89d5-1d4de2335ae9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:57.110557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-739e4dea-83ec-4e41-89d5-1d4de2335ae9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:57.138057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-739e4dea-83ec-4e41-89d5-1d4de2335ae9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042067 Jul 27 22:55:57.138604 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 482/952] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:57 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:57.470937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8ef22fd8-82dc-475b-8eaa-fed039755a8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:57.473021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8ef22fd8-82dc-475b-8eaa-fed039755a8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:57.479323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8ef22fd8-82dc-475b-8eaa-fed039755a8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:57.479771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8ef22fd8-82dc-475b-8eaa-fed039755a8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:57.480529 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8ef22fd8-82dc-475b-8eaa-fed039755a8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:57.480986 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8ef22fd8-82dc-475b-8eaa-fed039755a8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:57.483070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-65859031-7be3-4f1c-a3f6-d217100e77d7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:57.483672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-65859031-7be3-4f1c-a3f6-d217100e77d7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:57.490044 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65859031-7be3-4f1c-a3f6-d217100e77d7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:57.490481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65859031-7be3-4f1c-a3f6-d217100e77d7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:57.491235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65859031-7be3-4f1c-a3f6-d217100e77d7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:57.491659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65859031-7be3-4f1c-a3f6-d217100e77d7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:57.509369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8ef22fd8-82dc-475b-8eaa-fed039755a8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043053 Jul 27 22:55:57.509933 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 471/953] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:57 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:57.553727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-65859031-7be3-4f1c-a3f6-d217100e77d7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:57.561616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-65859031-7be3-4f1c-a3f6-d217100e77d7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082356 Jul 27 22:55:57.562190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 483/954] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:57 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:55:57.781735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-665f0758-372e-4fd0-af5d-de15c4d45dcb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:57.783801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-665f0758-372e-4fd0-af5d-de15c4d45dcb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:57.789856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-665f0758-372e-4fd0-af5d-de15c4d45dcb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:57.790297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-665f0758-372e-4fd0-af5d-de15c4d45dcb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:57.791044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-665f0758-372e-4fd0-af5d-de15c4d45dcb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:57.791474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-665f0758-372e-4fd0-af5d-de15c4d45dcb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:57.819659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-665f0758-372e-4fd0-af5d-de15c4d45dcb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041891 Jul 27 22:55:57.820193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 472/955] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:57 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:58.150418 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c14ae589-ab9d-4533-b3d8-e164efa96ec0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:58.153621 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c14ae589-ab9d-4533-b3d8-e164efa96ec0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:58.160708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c14ae589-ab9d-4533-b3d8-e164efa96ec0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:58.161152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c14ae589-ab9d-4533-b3d8-e164efa96ec0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:58.161911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c14ae589-ab9d-4533-b3d8-e164efa96ec0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:58.162339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c14ae589-ab9d-4533-b3d8-e164efa96ec0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:58.189634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c14ae589-ab9d-4533-b3d8-e164efa96ec0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043247 Jul 27 22:55:58.190176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 484/956] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:58 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:58.522279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f4e94a3a-a7e5-4520-8452-c1a0ab0d63c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:58.524341 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f4e94a3a-a7e5-4520-8452-c1a0ab0d63c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:58.530857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f4e94a3a-a7e5-4520-8452-c1a0ab0d63c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:58.531291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f4e94a3a-a7e5-4520-8452-c1a0ab0d63c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:58.532038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f4e94a3a-a7e5-4520-8452-c1a0ab0d63c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:58.532461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f4e94a3a-a7e5-4520-8452-c1a0ab0d63c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:58.560517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f4e94a3a-a7e5-4520-8452-c1a0ab0d63c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042264 Jul 27 22:55:58.561071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 473/957] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:58.581931 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4b267f5a-b0b9-4f6e-aab7-bdcbf65dd892 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:58.582537 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4b267f5a-b0b9-4f6e-aab7-bdcbf65dd892 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:58.588854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b267f5a-b0b9-4f6e-aab7-bdcbf65dd892 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:58.589294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b267f5a-b0b9-4f6e-aab7-bdcbf65dd892 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:58.590039 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b267f5a-b0b9-4f6e-aab7-bdcbf65dd892 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:58.590464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b267f5a-b0b9-4f6e-aab7-bdcbf65dd892 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:58.655037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4b267f5a-b0b9-4f6e-aab7-bdcbf65dd892 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:58.662438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4b267f5a-b0b9-4f6e-aab7-bdcbf65dd892 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084353 Jul 27 22:55:58.662990 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 485/958] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:58 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:58.831680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6f57d236-a122-4038-814a-1d6d587be581 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:58.833873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6f57d236-a122-4038-814a-1d6d587be581 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:58.839853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f57d236-a122-4038-814a-1d6d587be581 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:58.840295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f57d236-a122-4038-814a-1d6d587be581 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:58.841086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f57d236-a122-4038-814a-1d6d587be581 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:58.842099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f57d236-a122-4038-814a-1d6d587be581 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:58.870116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6f57d236-a122-4038-814a-1d6d587be581 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042346 Jul 27 22:55:58.870650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 474/959] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:58 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:59.202382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-877dcb87-9cf2-4458-812d-20c60e393b94 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:59.204514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-877dcb87-9cf2-4458-812d-20c60e393b94 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:59.210532 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-877dcb87-9cf2-4458-812d-20c60e393b94 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:59.210973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-877dcb87-9cf2-4458-812d-20c60e393b94 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:59.211723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-877dcb87-9cf2-4458-812d-20c60e393b94 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:59.212150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-877dcb87-9cf2-4458-812d-20c60e393b94 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:59.239692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-877dcb87-9cf2-4458-812d-20c60e393b94 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041855 Jul 27 22:55:59.240219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 486/960] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:59 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:55:59.572697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-45609293-75ee-4674-8ff9-edb9223611f5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:59.574818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-45609293-75ee-4674-8ff9-edb9223611f5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:59.580852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45609293-75ee-4674-8ff9-edb9223611f5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:59.581288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45609293-75ee-4674-8ff9-edb9223611f5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:59.582131 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45609293-75ee-4674-8ff9-edb9223611f5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:59.582560 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45609293-75ee-4674-8ff9-edb9223611f5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:59.611328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-45609293-75ee-4674-8ff9-edb9223611f5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042613 Jul 27 22:55:59.611863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 475/961] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:55:59 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:55:59.683102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2a8ed931-29e4-4e5e-aa23-34734683a16b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:59.683704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2a8ed931-29e4-4e5e-aa23-34734683a16b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:59.690703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a8ed931-29e4-4e5e-aa23-34734683a16b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:59.691144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a8ed931-29e4-4e5e-aa23-34734683a16b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:59.691892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a8ed931-29e4-4e5e-aa23-34734683a16b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:59.692320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a8ed931-29e4-4e5e-aa23-34734683a16b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:59.696234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:59.752495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2a8ed931-29e4-4e5e-aa23-34734683a16b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:55:59.759881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2a8ed931-29e4-4e5e-aa23-34734683a16b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080552 Jul 27 22:55:59.760431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 487/962] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:55:59 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:55:59.882719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6c80f9df-6acb-4fb5-bbb6-5dbeadbe2b14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:55:59.884818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6c80f9df-6acb-4fb5-bbb6-5dbeadbe2b14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:55:59.890846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c80f9df-6acb-4fb5-bbb6-5dbeadbe2b14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:59.891289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c80f9df-6acb-4fb5-bbb6-5dbeadbe2b14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:59.892047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c80f9df-6acb-4fb5-bbb6-5dbeadbe2b14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:55:59.892484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c80f9df-6acb-4fb5-bbb6-5dbeadbe2b14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:55:59.921313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6c80f9df-6acb-4fb5-bbb6-5dbeadbe2b14 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042671 Jul 27 22:55:59.921879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 476/963] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:55:59 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:00.251042 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-06cf0880-a8b2-4589-a985-7e3d7b528da7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:00.253227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-06cf0880-a8b2-4589-a985-7e3d7b528da7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:00.259227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06cf0880-a8b2-4589-a985-7e3d7b528da7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:00.259664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06cf0880-a8b2-4589-a985-7e3d7b528da7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:00.260412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06cf0880-a8b2-4589-a985-7e3d7b528da7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:00.260860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06cf0880-a8b2-4589-a985-7e3d7b528da7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:00.289045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-06cf0880-a8b2-4589-a985-7e3d7b528da7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041934 Jul 27 22:56:00.289576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 488/964] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:00 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:00.623925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-52bd9568-2624-40f6-b44a-8eae71622225 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:00.626131 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-52bd9568-2624-40f6-b44a-8eae71622225 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:00.632088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52bd9568-2624-40f6-b44a-8eae71622225 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:00.632528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52bd9568-2624-40f6-b44a-8eae71622225 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:00.633313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52bd9568-2624-40f6-b44a-8eae71622225 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:00.633744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52bd9568-2624-40f6-b44a-8eae71622225 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:00.637247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:00.662491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-52bd9568-2624-40f6-b44a-8eae71622225 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043008 Jul 27 22:56:00.663031 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 477/965] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:00 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:00.779617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c4730e85-df5e-4501-9afe-d8a39df6a6ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:00.780220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c4730e85-df5e-4501-9afe-d8a39df6a6ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:00.786679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4730e85-df5e-4501-9afe-d8a39df6a6ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:00.787121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4730e85-df5e-4501-9afe-d8a39df6a6ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:00.787872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4730e85-df5e-4501-9afe-d8a39df6a6ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:00.788300 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4730e85-df5e-4501-9afe-d8a39df6a6ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:00.849328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c4730e85-df5e-4501-9afe-d8a39df6a6ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:00.856841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c4730e85-df5e-4501-9afe-d8a39df6a6ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081052 Jul 27 22:56:00.857432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 489/966] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:00 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:00.933451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0126a21a-cde7-466a-9317-fc379ce514fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:00.936201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0126a21a-cde7-466a-9317-fc379ce514fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:00.942352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0126a21a-cde7-466a-9317-fc379ce514fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:00.942800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0126a21a-cde7-466a-9317-fc379ce514fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:00.943554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0126a21a-cde7-466a-9317-fc379ce514fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:00.943984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0126a21a-cde7-466a-9317-fc379ce514fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:00.971574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0126a21a-cde7-466a-9317-fc379ce514fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042108 Jul 27 22:56:00.972119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 478/967] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:00 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:01.301613 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-461e80b9-5079-4d01-a38f-3ae13f50f870 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:01.303785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-461e80b9-5079-4d01-a38f-3ae13f50f870 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:01.309782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-461e80b9-5079-4d01-a38f-3ae13f50f870 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:01.310823 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-461e80b9-5079-4d01-a38f-3ae13f50f870 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:01.311585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-461e80b9-5079-4d01-a38f-3ae13f50f870 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:01.312014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-461e80b9-5079-4d01-a38f-3ae13f50f870 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:01.338929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-461e80b9-5079-4d01-a38f-3ae13f50f870 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041302 Jul 27 22:56:01.339459 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 490/968] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:01 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:01.674710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a8e950c6-c112-4172-b216-6f7b19b77385 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:01.676849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a8e950c6-c112-4172-b216-6f7b19b77385 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:01.682873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a8e950c6-c112-4172-b216-6f7b19b77385 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:01.683307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a8e950c6-c112-4172-b216-6f7b19b77385 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:01.684063 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a8e950c6-c112-4172-b216-6f7b19b77385 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:01.684496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a8e950c6-c112-4172-b216-6f7b19b77385 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:01.712632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a8e950c6-c112-4172-b216-6f7b19b77385 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041846 Jul 27 22:56:01.713172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 479/969] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:01 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:01.877851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8e4365e3-0bdc-4a0a-ab9d-7529a60a63d2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:01.878389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8e4365e3-0bdc-4a0a-ab9d-7529a60a63d2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:01.884953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e4365e3-0bdc-4a0a-ab9d-7529a60a63d2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:01.885410 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e4365e3-0bdc-4a0a-ab9d-7529a60a63d2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:01.886165 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e4365e3-0bdc-4a0a-ab9d-7529a60a63d2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:01.886598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e4365e3-0bdc-4a0a-ab9d-7529a60a63d2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:01.948678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8e4365e3-0bdc-4a0a-ab9d-7529a60a63d2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:01.956582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8e4365e3-0bdc-4a0a-ab9d-7529a60a63d2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082626 Jul 27 22:56:01.957135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 491/970] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:01 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:01.983205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-31e647a2-5d28-4f3b-be37-75c5f621cda6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:01.985350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-31e647a2-5d28-4f3b-be37-75c5f621cda6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:01.991471 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31e647a2-5d28-4f3b-be37-75c5f621cda6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:01.991912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31e647a2-5d28-4f3b-be37-75c5f621cda6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:01.992737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31e647a2-5d28-4f3b-be37-75c5f621cda6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:01.993196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31e647a2-5d28-4f3b-be37-75c5f621cda6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:02.022159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-31e647a2-5d28-4f3b-be37-75c5f621cda6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042856 Jul 27 22:56:02.022697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 480/971] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:01 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:02.352203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0a47adf3-0dfa-4340-89e5-4f05693436c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:02.354398 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0a47adf3-0dfa-4340-89e5-4f05693436c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:02.360347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a47adf3-0dfa-4340-89e5-4f05693436c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:02.360828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a47adf3-0dfa-4340-89e5-4f05693436c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:02.361584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a47adf3-0dfa-4340-89e5-4f05693436c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:02.362015 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a47adf3-0dfa-4340-89e5-4f05693436c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:02.390555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0a47adf3-0dfa-4340-89e5-4f05693436c3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042516 Jul 27 22:56:02.391091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 492/972] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:02 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:02.725771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d7369645-99cc-4ca4-9a26-be6d9c6beaa7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:02.728210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d7369645-99cc-4ca4-9a26-be6d9c6beaa7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:02.734733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d7369645-99cc-4ca4-9a26-be6d9c6beaa7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:02.735178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d7369645-99cc-4ca4-9a26-be6d9c6beaa7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:02.735938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d7369645-99cc-4ca4-9a26-be6d9c6beaa7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:02.736372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d7369645-99cc-4ca4-9a26-be6d9c6beaa7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:02.764878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d7369645-99cc-4ca4-9a26-be6d9c6beaa7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043063 Jul 27 22:56:02.765434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 481/973] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:02 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:02.977873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-077a0e09-9335-45e0-8822-617a5db7bf0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:02.978422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-077a0e09-9335-45e0-8822-617a5db7bf0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:02.985620 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-077a0e09-9335-45e0-8822-617a5db7bf0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:02.986064 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-077a0e09-9335-45e0-8822-617a5db7bf0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:02.986821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-077a0e09-9335-45e0-8822-617a5db7bf0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:02.987257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-077a0e09-9335-45e0-8822-617a5db7bf0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:03.034875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f07ba3b8-03da-46cb-986f-c7c91ad1db69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:03.037116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f07ba3b8-03da-46cb-986f-c7c91ad1db69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:03.042996 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f07ba3b8-03da-46cb-986f-c7c91ad1db69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:03.043434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f07ba3b8-03da-46cb-986f-c7c91ad1db69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:03.044583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f07ba3b8-03da-46cb-986f-c7c91ad1db69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:03.045259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f07ba3b8-03da-46cb-986f-c7c91ad1db69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:03.047322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-077a0e09-9335-45e0-8822-617a5db7bf0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:03.054882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-077a0e09-9335-45e0-8822-617a5db7bf0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081190 Jul 27 22:56:03.055441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 493/974] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:02 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:03.073522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f07ba3b8-03da-46cb-986f-c7c91ad1db69 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042629 Jul 27 22:56:03.074061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 482/975] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:03 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:03.402585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0bcdc944-bb9e-4bac-aaf9-a8fc6773211b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:03.405376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0bcdc944-bb9e-4bac-aaf9-a8fc6773211b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:03.411416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bcdc944-bb9e-4bac-aaf9-a8fc6773211b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:03.411920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bcdc944-bb9e-4bac-aaf9-a8fc6773211b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:03.412703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bcdc944-bb9e-4bac-aaf9-a8fc6773211b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:03.413131 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bcdc944-bb9e-4bac-aaf9-a8fc6773211b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:03.440012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0bcdc944-bb9e-4bac-aaf9-a8fc6773211b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041445 Jul 27 22:56:03.440533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 494/976] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:03 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:03.777735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3c8ddd20-4beb-4304-a6fb-eaf9ea09ea31 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:03.779960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3c8ddd20-4beb-4304-a6fb-eaf9ea09ea31 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:03.781835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:03.787348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c8ddd20-4beb-4304-a6fb-eaf9ea09ea31 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:03.787787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c8ddd20-4beb-4304-a6fb-eaf9ea09ea31 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:03.788535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c8ddd20-4beb-4304-a6fb-eaf9ea09ea31 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:03.788984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c8ddd20-4beb-4304-a6fb-eaf9ea09ea31 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:03.817123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3c8ddd20-4beb-4304-a6fb-eaf9ea09ea31 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043428 Jul 27 22:56:03.817666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 483/977] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:04.075388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ac201dc6-da1a-4676-a7a0-d542424cc7db tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:04.075999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ac201dc6-da1a-4676-a7a0-d542424cc7db tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:04.082618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac201dc6-da1a-4676-a7a0-d542424cc7db tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:04.083068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac201dc6-da1a-4676-a7a0-d542424cc7db tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:04.083832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac201dc6-da1a-4676-a7a0-d542424cc7db tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:04.084264 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac201dc6-da1a-4676-a7a0-d542424cc7db tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:04.085497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4fad0bd6-3e01-4ff6-8e9e-3d1ea0c17bb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:04.087606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4fad0bd6-3e01-4ff6-8e9e-3d1ea0c17bb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:04.093548 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4fad0bd6-3e01-4ff6-8e9e-3d1ea0c17bb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:04.093991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4fad0bd6-3e01-4ff6-8e9e-3d1ea0c17bb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:04.094740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4fad0bd6-3e01-4ff6-8e9e-3d1ea0c17bb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:04.095168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4fad0bd6-3e01-4ff6-8e9e-3d1ea0c17bb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:04.125125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4fad0bd6-3e01-4ff6-8e9e-3d1ea0c17bb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043325 Jul 27 22:56:04.125702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 484/978] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:04 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:56:04.147062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ac201dc6-da1a-4676-a7a0-d542424cc7db tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:04.154826 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ac201dc6-da1a-4676-a7a0-d542424cc7db tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083292 Jul 27 22:56:04.155391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 495/979] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:04 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:04.452963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5a6639e1-0df5-4437-b9ea-bd9452d11016 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:04.454979 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5a6639e1-0df5-4437-b9ea-bd9452d11016 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:04.460991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a6639e1-0df5-4437-b9ea-bd9452d11016 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:04.461428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a6639e1-0df5-4437-b9ea-bd9452d11016 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:04.462177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a6639e1-0df5-4437-b9ea-bd9452d11016 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:04.462604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a6639e1-0df5-4437-b9ea-bd9452d11016 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:04.489908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5a6639e1-0df5-4437-b9ea-bd9452d11016 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041547 Jul 27 22:56:04.490458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 485/980] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:04 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:04.829539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c573b0c6-8248-45de-b125-18f92d80db06 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:04.831727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c573b0c6-8248-45de-b125-18f92d80db06 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:04.837761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c573b0c6-8248-45de-b125-18f92d80db06 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:04.838199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c573b0c6-8248-45de-b125-18f92d80db06 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:04.838951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c573b0c6-8248-45de-b125-18f92d80db06 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:04.839380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c573b0c6-8248-45de-b125-18f92d80db06 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:04.868326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c573b0c6-8248-45de-b125-18f92d80db06 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042861 Jul 27 22:56:04.868893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 496/981] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:04 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:05.136811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cab715df-a843-4389-bec1-ef4eaa2885f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:05.138875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cab715df-a843-4389-bec1-ef4eaa2885f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:05.145040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cab715df-a843-4389-bec1-ef4eaa2885f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:05.145498 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cab715df-a843-4389-bec1-ef4eaa2885f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:05.146263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cab715df-a843-4389-bec1-ef4eaa2885f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:05.146697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cab715df-a843-4389-bec1-ef4eaa2885f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:05.175661 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-974222a3-ef46-4d97-beef-087ed8f77cae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:05.176270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-974222a3-ef46-4d97-beef-087ed8f77cae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:05.176394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cab715df-a843-4389-bec1-ef4eaa2885f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043678 Jul 27 22:56:05.176944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 486/982] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:05 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:05.182614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-974222a3-ef46-4d97-beef-087ed8f77cae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:05.183055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-974222a3-ef46-4d97-beef-087ed8f77cae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:05.183808 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-974222a3-ef46-4d97-beef-087ed8f77cae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:05.184237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-974222a3-ef46-4d97-beef-087ed8f77cae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:05.245312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-974222a3-ef46-4d97-beef-087ed8f77cae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:05.252541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-974222a3-ef46-4d97-beef-087ed8f77cae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080714 Jul 27 22:56:05.253116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 497/983] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:05 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:56:05.502364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cbffe84f-1f69-4117-89e1-499cf58f8079 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:05.504391 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cbffe84f-1f69-4117-89e1-499cf58f8079 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:05.510302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cbffe84f-1f69-4117-89e1-499cf58f8079 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:05.510741 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cbffe84f-1f69-4117-89e1-499cf58f8079 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:05.511490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cbffe84f-1f69-4117-89e1-499cf58f8079 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:05.511922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cbffe84f-1f69-4117-89e1-499cf58f8079 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:05.540767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cbffe84f-1f69-4117-89e1-499cf58f8079 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042372 Jul 27 22:56:05.541320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 487/984] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:05 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:05.881178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-18042636-dddd-488b-9b47-f1c681e6d3ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:05.883324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-18042636-dddd-488b-9b47-f1c681e6d3ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:05.885247 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:05.891496 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-18042636-dddd-488b-9b47-f1c681e6d3ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:05.891936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-18042636-dddd-488b-9b47-f1c681e6d3ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:05.892737 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-18042636-dddd-488b-9b47-f1c681e6d3ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:05.893170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-18042636-dddd-488b-9b47-f1c681e6d3ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:05.920801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-18042636-dddd-488b-9b47-f1c681e6d3ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043509 Jul 27 22:56:05.921350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 498/985] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:05 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:06.188525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d041b990-d1a2-4525-8f6f-f313d99f67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:06.190656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d041b990-d1a2-4525-8f6f-f313d99f67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:06.196645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d041b990-d1a2-4525-8f6f-f313d99f67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:06.197084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d041b990-d1a2-4525-8f6f-f313d99f67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:06.197858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d041b990-d1a2-4525-8f6f-f313d99f67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:06.198285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d041b990-d1a2-4525-8f6f-f313d99f67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:06.227071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d041b990-d1a2-4525-8f6f-f313d99f67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042238 Jul 27 22:56:06.227603 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 488/986] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:06 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:06.272927 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-53b5f237-43f5-47da-b590-a49a07f9f999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:06.273532 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-53b5f237-43f5-47da-b590-a49a07f9f999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:06.280607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-53b5f237-43f5-47da-b590-a49a07f9f999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:06.281052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-53b5f237-43f5-47da-b590-a49a07f9f999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:06.281803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-53b5f237-43f5-47da-b590-a49a07f9f999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:06.282230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-53b5f237-43f5-47da-b590-a49a07f9f999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:06.345217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-53b5f237-43f5-47da-b590-a49a07f9f999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:06.353409 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-53b5f237-43f5-47da-b590-a49a07f9f999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084243 Jul 27 22:56:06.353966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 499/987] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:06 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:06.552984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-42eddc84-d434-4495-acb7-27c27e047c0e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:06.555132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-42eddc84-d434-4495-acb7-27c27e047c0e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:06.561563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42eddc84-d434-4495-acb7-27c27e047c0e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:06.562007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42eddc84-d434-4495-acb7-27c27e047c0e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:06.562761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42eddc84-d434-4495-acb7-27c27e047c0e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:06.563193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42eddc84-d434-4495-acb7-27c27e047c0e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:06.591264 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-42eddc84-d434-4495-acb7-27c27e047c0e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042365 Jul 27 22:56:06.591819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 489/988] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:06 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:06.933067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-27c0af6d-911e-4d4a-8c62-77b7908ceb76 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:06.935278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-27c0af6d-911e-4d4a-8c62-77b7908ceb76 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:06.941326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-27c0af6d-911e-4d4a-8c62-77b7908ceb76 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:06.941775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-27c0af6d-911e-4d4a-8c62-77b7908ceb76 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:06.942532 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-27c0af6d-911e-4d4a-8c62-77b7908ceb76 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:06.942967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-27c0af6d-911e-4d4a-8c62-77b7908ceb76 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:06.972121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-27c0af6d-911e-4d4a-8c62-77b7908ceb76 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043117 Jul 27 22:56:06.972689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 500/989] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:07.239218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c12791b8-6d8f-4d4d-95fd-eeb1e0928844 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:07.241334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c12791b8-6d8f-4d4d-95fd-eeb1e0928844 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:07.247277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c12791b8-6d8f-4d4d-95fd-eeb1e0928844 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:07.247718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c12791b8-6d8f-4d4d-95fd-eeb1e0928844 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:07.248467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c12791b8-6d8f-4d4d-95fd-eeb1e0928844 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:07.248920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c12791b8-6d8f-4d4d-95fd-eeb1e0928844 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:07.276920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c12791b8-6d8f-4d4d-95fd-eeb1e0928844 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041646 Jul 27 22:56:07.277454 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 490/990] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:07 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:56:07.375873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e0193706-2b27-401d-ad3f-9baf91547763 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:07.376479 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e0193706-2b27-401d-ad3f-9baf91547763 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:07.382873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e0193706-2b27-401d-ad3f-9baf91547763 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:07.383311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e0193706-2b27-401d-ad3f-9baf91547763 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:07.384058 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e0193706-2b27-401d-ad3f-9baf91547763 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:07.384486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e0193706-2b27-401d-ad3f-9baf91547763 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:07.443546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e0193706-2b27-401d-ad3f-9baf91547763 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:07.453285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e0193706-2b27-401d-ad3f-9baf91547763 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079308 Jul 27 22:56:07.453851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 501/991] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:07 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:56:07.603752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3be9fe71-812b-4640-882b-2d4d4a26b5f6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:07.605922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3be9fe71-812b-4640-882b-2d4d4a26b5f6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:07.612424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3be9fe71-812b-4640-882b-2d4d4a26b5f6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:07.612915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3be9fe71-812b-4640-882b-2d4d4a26b5f6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:07.613683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3be9fe71-812b-4640-882b-2d4d4a26b5f6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:07.614123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3be9fe71-812b-4640-882b-2d4d4a26b5f6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:07.643243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3be9fe71-812b-4640-882b-2d4d4a26b5f6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043838 Jul 27 22:56:07.643800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 491/992] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:07 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:07.984909 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ec831418-47dc-4962-b8fd-9f3b263103fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:07.987077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ec831418-47dc-4962-b8fd-9f3b263103fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:07.993203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec831418-47dc-4962-b8fd-9f3b263103fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:07.993707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec831418-47dc-4962-b8fd-9f3b263103fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:07.994604 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec831418-47dc-4962-b8fd-9f3b263103fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:07.995116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec831418-47dc-4962-b8fd-9f3b263103fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:08.024079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ec831418-47dc-4962-b8fd-9f3b263103fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043342 Jul 27 22:56:08.024649 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 502/993] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:07 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:08.289741 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5b3506fd-6e97-4391-be32-82e389f47e77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:08.291876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5b3506fd-6e97-4391-be32-82e389f47e77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:08.298317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b3506fd-6e97-4391-be32-82e389f47e77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:08.298757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b3506fd-6e97-4391-be32-82e389f47e77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:08.299507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b3506fd-6e97-4391-be32-82e389f47e77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:08.299936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b3506fd-6e97-4391-be32-82e389f47e77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:08.327839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5b3506fd-6e97-4391-be32-82e389f47e77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042122 Jul 27 22:56:08.328377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 492/994] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:08 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:08.473722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ed6ba674-ac87-4c1a-8fbb-b22c43c27ed2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:08.474255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ed6ba674-ac87-4c1a-8fbb-b22c43c27ed2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:08.480971 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed6ba674-ac87-4c1a-8fbb-b22c43c27ed2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:08.481408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed6ba674-ac87-4c1a-8fbb-b22c43c27ed2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:08.482207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed6ba674-ac87-4c1a-8fbb-b22c43c27ed2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:08.482631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed6ba674-ac87-4c1a-8fbb-b22c43c27ed2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:08.543264 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ed6ba674-ac87-4c1a-8fbb-b22c43c27ed2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:08.546665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:08.551572 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ed6ba674-ac87-4c1a-8fbb-b22c43c27ed2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081637 Jul 27 22:56:08.552262 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 503/995] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:08 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:08.655852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9ce076bc-0d03-4746-a7ca-a369c34ec126 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:08.657976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9ce076bc-0d03-4746-a7ca-a369c34ec126 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:08.663946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9ce076bc-0d03-4746-a7ca-a369c34ec126 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:08.664384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9ce076bc-0d03-4746-a7ca-a369c34ec126 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:08.665161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9ce076bc-0d03-4746-a7ca-a369c34ec126 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:08.665586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9ce076bc-0d03-4746-a7ca-a369c34ec126 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:08.688654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:08.693429 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9ce076bc-0d03-4746-a7ca-a369c34ec126 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042176 Jul 27 22:56:08.694148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 493/996] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:08 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:09.036088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4566c1ec-5a34-42d5-8ca0-56729579a7ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:09.038313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4566c1ec-5a34-42d5-8ca0-56729579a7ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:09.044405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4566c1ec-5a34-42d5-8ca0-56729579a7ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:09.044883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4566c1ec-5a34-42d5-8ca0-56729579a7ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:09.045642 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4566c1ec-5a34-42d5-8ca0-56729579a7ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:09.046073 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4566c1ec-5a34-42d5-8ca0-56729579a7ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:09.074773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4566c1ec-5a34-42d5-8ca0-56729579a7ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042668 Jul 27 22:56:09.075316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 504/997] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:09 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:09.339664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9f5578d9-2189-46e7-b1a2-6b4b617e6aac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:09.341840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9f5578d9-2189-46e7-b1a2-6b4b617e6aac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:09.347889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f5578d9-2189-46e7-b1a2-6b4b617e6aac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:09.348334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f5578d9-2189-46e7-b1a2-6b4b617e6aac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:09.349138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f5578d9-2189-46e7-b1a2-6b4b617e6aac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:09.349573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f5578d9-2189-46e7-b1a2-6b4b617e6aac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:09.378798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9f5578d9-2189-46e7-b1a2-6b4b617e6aac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043375 Jul 27 22:56:09.379344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 494/998] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:09 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:09.571239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-86feb23b-e990-4602-aa86-c14c8f26beb8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:09.571771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-86feb23b-e990-4602-aa86-c14c8f26beb8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:09.578294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86feb23b-e990-4602-aa86-c14c8f26beb8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:09.578793 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86feb23b-e990-4602-aa86-c14c8f26beb8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:09.579556 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86feb23b-e990-4602-aa86-c14c8f26beb8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:09.579990 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86feb23b-e990-4602-aa86-c14c8f26beb8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:09.642367 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-86feb23b-e990-4602-aa86-c14c8f26beb8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:09.649841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-86feb23b-e990-4602-aa86-c14c8f26beb8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082604 Jul 27 22:56:09.650395 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 505/999] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:09 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:09.705361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-04e53bcb-d366-4022-ad42-8c602e02fa83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:09.707470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-04e53bcb-d366-4022-ad42-8c602e02fa83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:09.713290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-04e53bcb-d366-4022-ad42-8c602e02fa83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:09.713729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-04e53bcb-d366-4022-ad42-8c602e02fa83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:09.714478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-04e53bcb-d366-4022-ad42-8c602e02fa83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:09.714910 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-04e53bcb-d366-4022-ad42-8c602e02fa83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:09.743557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-04e53bcb-d366-4022-ad42-8c602e02fa83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042046 Jul 27 22:56:09.744088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 495/1000] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:09 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:10.087621 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-643cc3a9-05ac-4926-adbf-d677ea078f9f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:10.090109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-643cc3a9-05ac-4926-adbf-d677ea078f9f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:10.096782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-643cc3a9-05ac-4926-adbf-d677ea078f9f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:10.097256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-643cc3a9-05ac-4926-adbf-d677ea078f9f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:10.098046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-643cc3a9-05ac-4926-adbf-d677ea078f9f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:10.098484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-643cc3a9-05ac-4926-adbf-d677ea078f9f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:10.126198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-643cc3a9-05ac-4926-adbf-d677ea078f9f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042598 Jul 27 22:56:10.126750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 506/1001] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:10 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:10.391791 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1e43c27a-b774-4642-aafe-581003b41ff6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:10.393865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1e43c27a-b774-4642-aafe-581003b41ff6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:10.399784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e43c27a-b774-4642-aafe-581003b41ff6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:10.400224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e43c27a-b774-4642-aafe-581003b41ff6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:10.400999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e43c27a-b774-4642-aafe-581003b41ff6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:10.401439 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e43c27a-b774-4642-aafe-581003b41ff6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:10.428573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1e43c27a-b774-4642-aafe-581003b41ff6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041545 Jul 27 22:56:10.429123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 496/1002] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:10 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:10.671169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-54a884be-c7f7-4be8-85a6-f9f2ea34a573 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:10.671726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-54a884be-c7f7-4be8-85a6-f9f2ea34a573 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:10.678153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54a884be-c7f7-4be8-85a6-f9f2ea34a573 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:10.678595 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54a884be-c7f7-4be8-85a6-f9f2ea34a573 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:10.679350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54a884be-c7f7-4be8-85a6-f9f2ea34a573 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:10.679780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54a884be-c7f7-4be8-85a6-f9f2ea34a573 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:10.745385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-54a884be-c7f7-4be8-85a6-f9f2ea34a573 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:10.755339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ce7f047f-deef-453f-8517-c689c529abc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:10.756308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-54a884be-c7f7-4be8-85a6-f9f2ea34a573 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.088858 Jul 27 22:56:10.757076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 507/1003] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:10 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:10.757473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ce7f047f-deef-453f-8517-c689c529abc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:10.764209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce7f047f-deef-453f-8517-c689c529abc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:10.764679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce7f047f-deef-453f-8517-c689c529abc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:10.765716 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce7f047f-deef-453f-8517-c689c529abc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:10.766147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce7f047f-deef-453f-8517-c689c529abc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:10.794046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ce7f047f-deef-453f-8517-c689c529abc5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042495 Jul 27 22:56:10.795098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 497/1004] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:10 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:11.138275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5c64ee7f-8ca5-401c-9b5b-72abb57a81cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:11.140468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5c64ee7f-8ca5-401c-9b5b-72abb57a81cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:11.146485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5c64ee7f-8ca5-401c-9b5b-72abb57a81cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:11.146924 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5c64ee7f-8ca5-401c-9b5b-72abb57a81cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:11.147673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5c64ee7f-8ca5-401c-9b5b-72abb57a81cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:11.148103 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5c64ee7f-8ca5-401c-9b5b-72abb57a81cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:11.176929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5c64ee7f-8ca5-401c-9b5b-72abb57a81cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042637 Jul 27 22:56:11.177471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 508/1005] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:11 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:11.439912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fc310879-8b60-41d9-a9d3-983416b560d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:11.442004 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fc310879-8b60-41d9-a9d3-983416b560d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:11.447916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc310879-8b60-41d9-a9d3-983416b560d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:11.448361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc310879-8b60-41d9-a9d3-983416b560d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:11.449152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc310879-8b60-41d9-a9d3-983416b560d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:11.449581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc310879-8b60-41d9-a9d3-983416b560d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:11.478309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fc310879-8b60-41d9-a9d3-983416b560d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042380 Jul 27 22:56:11.478848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 498/1006] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:11 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:11.776597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1c09ee8e-c6d5-406f-add3-5e4c97882b7f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:11.777122 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1c09ee8e-c6d5-406f-add3-5e4c97882b7f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:11.784173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c09ee8e-c6d5-406f-add3-5e4c97882b7f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:11.784656 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c09ee8e-c6d5-406f-add3-5e4c97882b7f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:11.785422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c09ee8e-c6d5-406f-add3-5e4c97882b7f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:11.785865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c09ee8e-c6d5-406f-add3-5e4c97882b7f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:11.806901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cf61e896-ab0b-425d-815f-175ed562d752 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:11.809123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cf61e896-ab0b-425d-815f-175ed562d752 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:11.815803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf61e896-ab0b-425d-815f-175ed562d752 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:11.816243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf61e896-ab0b-425d-815f-175ed562d752 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:11.817027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf61e896-ab0b-425d-815f-175ed562d752 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:11.817458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf61e896-ab0b-425d-815f-175ed562d752 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:11.848114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1c09ee8e-c6d5-406f-add3-5e4c97882b7f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:11.848409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cf61e896-ab0b-425d-815f-175ed562d752 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Jul 27 22:56:11.849007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 499/1007] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:11 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:56:11.856117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1c09ee8e-c6d5-406f-add3-5e4c97882b7f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083488 Jul 27 22:56:11.856685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 509/1008] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:11 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:12.190522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2aa08f58-cc39-4059-931b-46eb933cda66 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:12.192654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2aa08f58-cc39-4059-931b-46eb933cda66 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:12.198727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2aa08f58-cc39-4059-931b-46eb933cda66 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:12.199170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2aa08f58-cc39-4059-931b-46eb933cda66 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:12.200084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2aa08f58-cc39-4059-931b-46eb933cda66 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:12.200722 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2aa08f58-cc39-4059-931b-46eb933cda66 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:12.229912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2aa08f58-cc39-4059-931b-46eb933cda66 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044516 Jul 27 22:56:12.230465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 500/1009] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:12.490313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e15c3382-64c8-420a-8f7b-6ab4baaf0d21 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:12.492464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e15c3382-64c8-420a-8f7b-6ab4baaf0d21 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:12.499959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e15c3382-64c8-420a-8f7b-6ab4baaf0d21 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:12.500408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e15c3382-64c8-420a-8f7b-6ab4baaf0d21 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:12.501219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e15c3382-64c8-420a-8f7b-6ab4baaf0d21 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:12.501653 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e15c3382-64c8-420a-8f7b-6ab4baaf0d21 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:12.534040 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e15c3382-64c8-420a-8f7b-6ab4baaf0d21 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047686 Jul 27 22:56:12.534793 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 510/1010] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:12 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:12.861436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b8faca71-e1a4-4f4d-97fe-a4e85b70bad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:12.863634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b8faca71-e1a4-4f4d-97fe-a4e85b70bad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:12.869849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b8faca71-e1a4-4f4d-97fe-a4e85b70bad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:12.870312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b8faca71-e1a4-4f4d-97fe-a4e85b70bad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:12.871050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b8faca71-e1a4-4f4d-97fe-a4e85b70bad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:12.871479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b8faca71-e1a4-4f4d-97fe-a4e85b70bad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:12.875500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c36a7cb5-316d-4038-9da7-21ab054c6235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:12.876105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c36a7cb5-316d-4038-9da7-21ab054c6235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:12.882574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c36a7cb5-316d-4038-9da7-21ab054c6235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:12.883015 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c36a7cb5-316d-4038-9da7-21ab054c6235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:12.883772 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c36a7cb5-316d-4038-9da7-21ab054c6235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:12.884198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c36a7cb5-316d-4038-9da7-21ab054c6235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:12.899713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b8faca71-e1a4-4f4d-97fe-a4e85b70bad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042853 Jul 27 22:56:12.900262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 501/1011] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:12 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:12.944521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c36a7cb5-316d-4038-9da7-21ab054c6235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:12.952561 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c36a7cb5-316d-4038-9da7-21ab054c6235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080809 Jul 27 22:56:12.953118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 511/1012] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:12 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:56:13.242821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-004bbfd8-ffff-40b3-bf3d-b617c5c8661e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:13.244966 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-004bbfd8-ffff-40b3-bf3d-b617c5c8661e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:13.250910 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-004bbfd8-ffff-40b3-bf3d-b617c5c8661e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:13.251354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-004bbfd8-ffff-40b3-bf3d-b617c5c8661e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:13.252101 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-004bbfd8-ffff-40b3-bf3d-b617c5c8661e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:13.252529 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-004bbfd8-ffff-40b3-bf3d-b617c5c8661e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:13.281304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-004bbfd8-ffff-40b3-bf3d-b617c5c8661e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042425 Jul 27 22:56:13.281837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 502/1013] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:13.546397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b53a7c24-b056-46d2-b6b5-a91f1c95b6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:13.548618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b53a7c24-b056-46d2-b6b5-a91f1c95b6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:13.554755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b53a7c24-b056-46d2-b6b5-a91f1c95b6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:13.555207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b53a7c24-b056-46d2-b6b5-a91f1c95b6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:13.555971 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b53a7c24-b056-46d2-b6b5-a91f1c95b6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:13.556406 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b53a7c24-b056-46d2-b6b5-a91f1c95b6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:13.585641 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b53a7c24-b056-46d2-b6b5-a91f1c95b6e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043205 Jul 27 22:56:13.586185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 512/1014] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:13 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:13.912339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-39c15671-06e9-432b-92bd-65b5d32f6bd7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:13.914473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-39c15671-06e9-432b-92bd-65b5d32f6bd7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:13.920945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39c15671-06e9-432b-92bd-65b5d32f6bd7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:13.921384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39c15671-06e9-432b-92bd-65b5d32f6bd7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:13.922127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39c15671-06e9-432b-92bd-65b5d32f6bd7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:13.922553 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39c15671-06e9-432b-92bd-65b5d32f6bd7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:13.950493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-39c15671-06e9-432b-92bd-65b5d32f6bd7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Jul 27 22:56:13.951040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 503/1015] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:13 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:13.972213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d1f7b58d-2c29-4735-bee2-5806952ba007 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:13.972869 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d1f7b58d-2c29-4735-bee2-5806952ba007 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:13.979515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1f7b58d-2c29-4735-bee2-5806952ba007 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:13.979955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1f7b58d-2c29-4735-bee2-5806952ba007 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:13.980733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1f7b58d-2c29-4735-bee2-5806952ba007 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:13.981163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1f7b58d-2c29-4735-bee2-5806952ba007 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:14.043008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d1f7b58d-2c29-4735-bee2-5806952ba007 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:14.050900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d1f7b58d-2c29-4735-bee2-5806952ba007 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082570 Jul 27 22:56:14.051453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 513/1016] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:13 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:14.292808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-997821a6-38d4-4897-b4bf-1bac73805ca2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:14.295588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-997821a6-38d4-4897-b4bf-1bac73805ca2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:14.301543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-997821a6-38d4-4897-b4bf-1bac73805ca2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:14.301990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-997821a6-38d4-4897-b4bf-1bac73805ca2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:14.302753 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-997821a6-38d4-4897-b4bf-1bac73805ca2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:14.303185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-997821a6-38d4-4897-b4bf-1bac73805ca2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:14.330801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-997821a6-38d4-4897-b4bf-1bac73805ca2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041990 Jul 27 22:56:14.331343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 504/1017] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:14 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:14.598422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-998c5e30-73a2-49bc-87f6-8f8db26a34b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:14.600460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-998c5e30-73a2-49bc-87f6-8f8db26a34b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:14.606814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-998c5e30-73a2-49bc-87f6-8f8db26a34b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:14.607290 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-998c5e30-73a2-49bc-87f6-8f8db26a34b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:14.608045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-998c5e30-73a2-49bc-87f6-8f8db26a34b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:14.608476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-998c5e30-73a2-49bc-87f6-8f8db26a34b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:14.635899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-998c5e30-73a2-49bc-87f6-8f8db26a34b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041577 Jul 27 22:56:14.636435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 514/1018] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:14 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:14.961920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0d382dc3-7bcb-46e2-9216-d417791579c9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:14.963970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0d382dc3-7bcb-46e2-9216-d417791579c9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:14.970681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d382dc3-7bcb-46e2-9216-d417791579c9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:14.971118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d382dc3-7bcb-46e2-9216-d417791579c9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:14.971869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d382dc3-7bcb-46e2-9216-d417791579c9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:14.972291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d382dc3-7bcb-46e2-9216-d417791579c9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:15.001159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0d382dc3-7bcb-46e2-9216-d417791579c9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 Jul 27 22:56:15.001703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 505/1019] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:14 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:15.071499 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e943a4a1-b3a8-4d46-ab61-4997d0c9b2ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:15.072103 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e943a4a1-b3a8-4d46-ab61-4997d0c9b2ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:15.078579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e943a4a1-b3a8-4d46-ab61-4997d0c9b2ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:15.079022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e943a4a1-b3a8-4d46-ab61-4997d0c9b2ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:15.079781 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e943a4a1-b3a8-4d46-ab61-4997d0c9b2ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:15.080211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e943a4a1-b3a8-4d46-ab61-4997d0c9b2ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:15.144623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e943a4a1-b3a8-4d46-ab61-4997d0c9b2ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:15.152287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e943a4a1-b3a8-4d46-ab61-4997d0c9b2ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084566 Jul 27 22:56:15.152898 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 515/1020] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:15 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:15.343188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a153f781-e5c7-4319-b3b5-553156e63f5c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:15.345468 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a153f781-e5c7-4319-b3b5-553156e63f5c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:15.351370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a153f781-e5c7-4319-b3b5-553156e63f5c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:15.352070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a153f781-e5c7-4319-b3b5-553156e63f5c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:15.352841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a153f781-e5c7-4319-b3b5-553156e63f5c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:15.353264 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a153f781-e5c7-4319-b3b5-553156e63f5c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:15.381901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a153f781-e5c7-4319-b3b5-553156e63f5c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042780 Jul 27 22:56:15.382417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 506/1021] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:15 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:15.648638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c776c721-cc84-40c8-87af-e9a0f90ee002 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:15.650794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c776c721-cc84-40c8-87af-e9a0f90ee002 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:15.657507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c776c721-cc84-40c8-87af-e9a0f90ee002 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:15.657955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c776c721-cc84-40c8-87af-e9a0f90ee002 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:15.658728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c776c721-cc84-40c8-87af-e9a0f90ee002 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:15.659158 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c776c721-cc84-40c8-87af-e9a0f90ee002 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:15.687181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c776c721-cc84-40c8-87af-e9a0f90ee002 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042588 Jul 27 22:56:15.687718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 516/1022] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:16.013875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-51a81a7f-fbb4-4f9d-97e0-274e612e1651 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:16.016021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-51a81a7f-fbb4-4f9d-97e0-274e612e1651 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:16.028621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51a81a7f-fbb4-4f9d-97e0-274e612e1651 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:16.029689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51a81a7f-fbb4-4f9d-97e0-274e612e1651 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:16.030452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51a81a7f-fbb4-4f9d-97e0-274e612e1651 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:16.030877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51a81a7f-fbb4-4f9d-97e0-274e612e1651 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:16.058214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-51a81a7f-fbb4-4f9d-97e0-274e612e1651 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048909 Jul 27 22:56:16.058756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 507/1023] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:16 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:16.173005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b6b7b49e-6521-438b-a940-31d8ad631691 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:16.173639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b6b7b49e-6521-438b-a940-31d8ad631691 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:16.180075 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b6b7b49e-6521-438b-a940-31d8ad631691 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:16.180514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b6b7b49e-6521-438b-a940-31d8ad631691 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:16.181294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b6b7b49e-6521-438b-a940-31d8ad631691 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:16.181721 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b6b7b49e-6521-438b-a940-31d8ad631691 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:16.242119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b6b7b49e-6521-438b-a940-31d8ad631691 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:16.249606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b6b7b49e-6521-438b-a940-31d8ad631691 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080433 Jul 27 22:56:16.250160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 517/1024] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:16 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:16.394221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6c7bdb76-c3e2-4367-b3d5-b1c92398bdbf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:16.396347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6c7bdb76-c3e2-4367-b3d5-b1c92398bdbf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:16.402355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c7bdb76-c3e2-4367-b3d5-b1c92398bdbf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:16.402798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c7bdb76-c3e2-4367-b3d5-b1c92398bdbf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:16.403550 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c7bdb76-c3e2-4367-b3d5-b1c92398bdbf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:16.404488 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c7bdb76-c3e2-4367-b3d5-b1c92398bdbf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:16.433513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6c7bdb76-c3e2-4367-b3d5-b1c92398bdbf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043249 Jul 27 22:56:16.434059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 508/1025] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:16 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:16.699728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-38db9d5d-6243-4f6f-b236-cc251d3a2cf7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:16.702339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-38db9d5d-6243-4f6f-b236-cc251d3a2cf7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:16.708295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-38db9d5d-6243-4f6f-b236-cc251d3a2cf7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:16.708774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-38db9d5d-6243-4f6f-b236-cc251d3a2cf7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:16.709543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-38db9d5d-6243-4f6f-b236-cc251d3a2cf7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:16.709974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-38db9d5d-6243-4f6f-b236-cc251d3a2cf7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:16.738615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-38db9d5d-6243-4f6f-b236-cc251d3a2cf7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 Jul 27 22:56:16.739149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 518/1026] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:16 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:17.070370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c0b616fd-c061-4904-a748-ccebb2d2c3f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:17.072577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c0b616fd-c061-4904-a748-ccebb2d2c3f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:17.078584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c0b616fd-c061-4904-a748-ccebb2d2c3f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:17.079030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c0b616fd-c061-4904-a748-ccebb2d2c3f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:17.079783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c0b616fd-c061-4904-a748-ccebb2d2c3f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:17.080213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c0b616fd-c061-4904-a748-ccebb2d2c3f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:17.108807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c0b616fd-c061-4904-a748-ccebb2d2c3f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042363 Jul 27 22:56:17.109355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 509/1027] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:17 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:17.270065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fbff6b1e-abdb-4fed-9b0e-67a9efeb5a1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:17.270675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fbff6b1e-abdb-4fed-9b0e-67a9efeb5a1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:17.277148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fbff6b1e-abdb-4fed-9b0e-67a9efeb5a1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:17.277597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fbff6b1e-abdb-4fed-9b0e-67a9efeb5a1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:17.278360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fbff6b1e-abdb-4fed-9b0e-67a9efeb5a1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:17.279287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fbff6b1e-abdb-4fed-9b0e-67a9efeb5a1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:17.339436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fbff6b1e-abdb-4fed-9b0e-67a9efeb5a1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:17.347360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fbff6b1e-abdb-4fed-9b0e-67a9efeb5a1a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081201 Jul 27 22:56:17.347922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 519/1028] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:17 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:17.445715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-beba4cc7-64c3-46e7-bb44-53a92c7ce006 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:17.447832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-beba4cc7-64c3-46e7-bb44-53a92c7ce006 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:17.454337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-beba4cc7-64c3-46e7-bb44-53a92c7ce006 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:17.454787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-beba4cc7-64c3-46e7-bb44-53a92c7ce006 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:17.455543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-beba4cc7-64c3-46e7-bb44-53a92c7ce006 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:17.455971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-beba4cc7-64c3-46e7-bb44-53a92c7ce006 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:17.472860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:17.486011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-beba4cc7-64c3-46e7-bb44-53a92c7ce006 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044241 Jul 27 22:56:17.486558 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 510/1029] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:17 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:17.751100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0f245169-2cef-43f0-9e22-95431a59a9d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:17.753315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0f245169-2cef-43f0-9e22-95431a59a9d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:17.759278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f245169-2cef-43f0-9e22-95431a59a9d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:17.759719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f245169-2cef-43f0-9e22-95431a59a9d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:17.760468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f245169-2cef-43f0-9e22-95431a59a9d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:17.760925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f245169-2cef-43f0-9e22-95431a59a9d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:17.776693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:17.789135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0f245169-2cef-43f0-9e22-95431a59a9d7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042609 Jul 27 22:56:17.789683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 520/1030] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:17 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:18.120202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f06a2911-8fbe-46eb-ac63-4ad52208c19a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:18.122865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f06a2911-8fbe-46eb-ac63-4ad52208c19a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:18.128968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f06a2911-8fbe-46eb-ac63-4ad52208c19a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:18.129414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f06a2911-8fbe-46eb-ac63-4ad52208c19a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:18.130168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f06a2911-8fbe-46eb-ac63-4ad52208c19a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:18.130599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f06a2911-8fbe-46eb-ac63-4ad52208c19a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:18.158920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f06a2911-8fbe-46eb-ac63-4ad52208c19a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042585 Jul 27 22:56:18.159469 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 511/1031] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:18 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:18.368723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d48db750-117f-4fc4-b7f1-df367d7a44e5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:18.369328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d48db750-117f-4fc4-b7f1-df367d7a44e5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:18.375871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d48db750-117f-4fc4-b7f1-df367d7a44e5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:18.376311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d48db750-117f-4fc4-b7f1-df367d7a44e5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:18.377088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d48db750-117f-4fc4-b7f1-df367d7a44e5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:18.377515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d48db750-117f-4fc4-b7f1-df367d7a44e5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:18.441547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d48db750-117f-4fc4-b7f1-df367d7a44e5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:18.447954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d48db750-117f-4fc4-b7f1-df367d7a44e5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083281 Jul 27 22:56:18.448503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 521/1032] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:18 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:18.498809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ac79b64b-a920-4f92-97f6-456e052beac3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:18.500959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ac79b64b-a920-4f92-97f6-456e052beac3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:18.506914 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ac79b64b-a920-4f92-97f6-456e052beac3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:18.507354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ac79b64b-a920-4f92-97f6-456e052beac3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:18.508138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ac79b64b-a920-4f92-97f6-456e052beac3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:18.508587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ac79b64b-a920-4f92-97f6-456e052beac3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:18.536220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ac79b64b-a920-4f92-97f6-456e052beac3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042025 Jul 27 22:56:18.536796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 512/1033] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:18.801683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d9e99e69-ee11-4717-a04f-ce1f8c82f93f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:18.803876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d9e99e69-ee11-4717-a04f-ce1f8c82f93f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:18.809933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9e99e69-ee11-4717-a04f-ce1f8c82f93f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:18.810382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9e99e69-ee11-4717-a04f-ce1f8c82f93f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:18.811153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9e99e69-ee11-4717-a04f-ce1f8c82f93f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:18.811581 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9e99e69-ee11-4717-a04f-ce1f8c82f93f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:18.839023 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d9e99e69-ee11-4717-a04f-ce1f8c82f93f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041319 Jul 27 22:56:18.839553 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 522/1034] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:18 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:19.171362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bd67be5a-8897-452c-bb23-ebc4d90e63ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:19.173554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bd67be5a-8897-452c-bb23-ebc4d90e63ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:19.179582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd67be5a-8897-452c-bb23-ebc4d90e63ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:19.180027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd67be5a-8897-452c-bb23-ebc4d90e63ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:19.180819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd67be5a-8897-452c-bb23-ebc4d90e63ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:19.181252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd67be5a-8897-452c-bb23-ebc4d90e63ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:19.208710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bd67be5a-8897-452c-bb23-ebc4d90e63ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041275 Jul 27 22:56:19.209251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 513/1035] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:19 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:19.467720 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-beaca9b0-49de-4c15-b606-b29bb052a466 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:19.468274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-beaca9b0-49de-4c15-b606-b29bb052a466 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:19.474747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-beaca9b0-49de-4c15-b606-b29bb052a466 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:19.475188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-beaca9b0-49de-4c15-b606-b29bb052a466 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:19.475933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-beaca9b0-49de-4c15-b606-b29bb052a466 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:19.476402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-beaca9b0-49de-4c15-b606-b29bb052a466 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:19.541201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-beaca9b0-49de-4c15-b606-b29bb052a466 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:19.548899 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7eaf1a70-cfef-4406-9c5f-c623e9b5202e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:19.549538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-beaca9b0-49de-4c15-b606-b29bb052a466 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.085645 Jul 27 22:56:19.550331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 523/1036] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:19 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:19.552231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7eaf1a70-cfef-4406-9c5f-c623e9b5202e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:19.558335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7eaf1a70-cfef-4406-9c5f-c623e9b5202e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:19.558780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7eaf1a70-cfef-4406-9c5f-c623e9b5202e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:19.559587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7eaf1a70-cfef-4406-9c5f-c623e9b5202e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:19.560534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7eaf1a70-cfef-4406-9c5f-c623e9b5202e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:19.589437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7eaf1a70-cfef-4406-9c5f-c623e9b5202e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044554 Jul 27 22:56:19.589984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 514/1037] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:19 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:56:19.851360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c3beea8b-c583-49e4-9f8a-455fcc21758e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:19.853804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c3beea8b-c583-49e4-9f8a-455fcc21758e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:19.860269 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3beea8b-c583-49e4-9f8a-455fcc21758e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:19.860752 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3beea8b-c583-49e4-9f8a-455fcc21758e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:19.861513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3beea8b-c583-49e4-9f8a-455fcc21758e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:19.861949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3beea8b-c583-49e4-9f8a-455fcc21758e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:19.890178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c3beea8b-c583-49e4-9f8a-455fcc21758e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042842 Jul 27 22:56:19.890714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 524/1038] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:19 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:20.221044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fe622df1-da63-411d-97ac-81a6b3dbdaeb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:20.223170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fe622df1-da63-411d-97ac-81a6b3dbdaeb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:20.229361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fe622df1-da63-411d-97ac-81a6b3dbdaeb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:20.229800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fe622df1-da63-411d-97ac-81a6b3dbdaeb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:20.230544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fe622df1-da63-411d-97ac-81a6b3dbdaeb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:20.230989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fe622df1-da63-411d-97ac-81a6b3dbdaeb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:20.258715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fe622df1-da63-411d-97ac-81a6b3dbdaeb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041563 Jul 27 22:56:20.259240 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 515/1039] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:20 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:20.569947 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a9d9eb79-d0ad-410c-b28e-026c20c36b00 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:20.570557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a9d9eb79-d0ad-410c-b28e-026c20c36b00 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:20.577579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9d9eb79-d0ad-410c-b28e-026c20c36b00 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:20.578024 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9d9eb79-d0ad-410c-b28e-026c20c36b00 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:20.578781 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9d9eb79-d0ad-410c-b28e-026c20c36b00 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:20.579214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9d9eb79-d0ad-410c-b28e-026c20c36b00 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:20.602052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-46644767-5a30-4a9f-8b85-7baf6a942e7f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:20.604202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-46644767-5a30-4a9f-8b85-7baf6a942e7f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:20.610167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-46644767-5a30-4a9f-8b85-7baf6a942e7f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:20.610613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-46644767-5a30-4a9f-8b85-7baf6a942e7f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:20.611381 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-46644767-5a30-4a9f-8b85-7baf6a942e7f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:20.611820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-46644767-5a30-4a9f-8b85-7baf6a942e7f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:20.640115 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a9d9eb79-d0ad-410c-b28e-026c20c36b00 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:20.641030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-46644767-5a30-4a9f-8b85-7baf6a942e7f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043188 Jul 27 22:56:20.641604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 516/1040] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:56:20.647836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a9d9eb79-d0ad-410c-b28e-026c20c36b00 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081880 Jul 27 22:56:20.648378 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 525/1041] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:20 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:20.902267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ae913213-b730-4c52-baf6-596a133029fc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:20.904352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ae913213-b730-4c52-baf6-596a133029fc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:20.910280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae913213-b730-4c52-baf6-596a133029fc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:20.910717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae913213-b730-4c52-baf6-596a133029fc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:20.911463 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae913213-b730-4c52-baf6-596a133029fc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:20.911890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae913213-b730-4c52-baf6-596a133029fc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:20.939796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ae913213-b730-4c52-baf6-596a133029fc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041480 Jul 27 22:56:20.940325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 517/1042] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:20 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:21.270865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1971003f-a00c-4bb0-9c79-c6c3f63c733c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:21.273067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1971003f-a00c-4bb0-9c79-c6c3f63c733c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:21.279160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1971003f-a00c-4bb0-9c79-c6c3f63c733c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:21.279601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1971003f-a00c-4bb0-9c79-c6c3f63c733c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:21.280353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1971003f-a00c-4bb0-9c79-c6c3f63c733c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:21.280811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1971003f-a00c-4bb0-9c79-c6c3f63c733c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:21.308073 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1971003f-a00c-4bb0-9c79-c6c3f63c733c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041211 Jul 27 22:56:21.308622 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 526/1043] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:21 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:21.653308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7bbf7d64-253a-48ef-9a5c-52093e19ee36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:21.656063 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7bbf7d64-253a-48ef-9a5c-52093e19ee36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:21.661998 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7bbf7d64-253a-48ef-9a5c-52093e19ee36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:21.662469 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7bbf7d64-253a-48ef-9a5c-52093e19ee36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:21.663209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7bbf7d64-253a-48ef-9a5c-52093e19ee36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:21.663635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7bbf7d64-253a-48ef-9a5c-52093e19ee36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:21.668596 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-49335fef-6902-47e2-a244-0a69b0e17438 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:21.671555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-49335fef-6902-47e2-a244-0a69b0e17438 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:21.678035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-49335fef-6902-47e2-a244-0a69b0e17438 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:21.678478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-49335fef-6902-47e2-a244-0a69b0e17438 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:21.679241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-49335fef-6902-47e2-a244-0a69b0e17438 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:21.679669 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-49335fef-6902-47e2-a244-0a69b0e17438 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:21.692616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7bbf7d64-253a-48ef-9a5c-52093e19ee36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043190 Jul 27 22:56:21.693169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 518/1044] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:21 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:21.742314 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-49335fef-6902-47e2-a244-0a69b0e17438 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:21.750396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-49335fef-6902-47e2-a244-0a69b0e17438 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.085594 Jul 27 22:56:21.750946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 527/1045] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:21 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:21.951703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4acbd0d0-e4f0-4f6f-b68d-6bb4a3d24cb0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:21.953804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4acbd0d0-e4f0-4f6f-b68d-6bb4a3d24cb0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:21.959641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4acbd0d0-e4f0-4f6f-b68d-6bb4a3d24cb0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:21.960084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4acbd0d0-e4f0-4f6f-b68d-6bb4a3d24cb0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:21.960849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4acbd0d0-e4f0-4f6f-b68d-6bb4a3d24cb0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:21.961274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4acbd0d0-e4f0-4f6f-b68d-6bb4a3d24cb0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:21.989613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4acbd0d0-e4f0-4f6f-b68d-6bb4a3d24cb0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042356 Jul 27 22:56:21.990142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 519/1046] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:21 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:22.321211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ab28fd50-e21a-4681-9d8e-582ead67e46d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:22.323357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ab28fd50-e21a-4681-9d8e-582ead67e46d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:22.329993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab28fd50-e21a-4681-9d8e-582ead67e46d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:22.330436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab28fd50-e21a-4681-9d8e-582ead67e46d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:22.331188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab28fd50-e21a-4681-9d8e-582ead67e46d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:22.331619 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab28fd50-e21a-4681-9d8e-582ead67e46d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:22.359012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ab28fd50-e21a-4681-9d8e-582ead67e46d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041809 Jul 27 22:56:22.359539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 528/1047] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:22 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:56:22.705644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d9a707bd-d3d7-4c8e-b624-a976214ae565 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:22.707695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d9a707bd-d3d7-4c8e-b624-a976214ae565 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:22.713750 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d9a707bd-d3d7-4c8e-b624-a976214ae565 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:22.714191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d9a707bd-d3d7-4c8e-b624-a976214ae565 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:22.714947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d9a707bd-d3d7-4c8e-b624-a976214ae565 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:22.715374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d9a707bd-d3d7-4c8e-b624-a976214ae565 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:22.744256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d9a707bd-d3d7-4c8e-b624-a976214ae565 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042613 Jul 27 22:56:22.744848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 520/1048] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:22 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:22.769840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-45c137df-1553-4da2-b663-d1abc6971324 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:22.770470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-45c137df-1553-4da2-b663-d1abc6971324 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:22.776949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45c137df-1553-4da2-b663-d1abc6971324 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:22.777391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45c137df-1553-4da2-b663-d1abc6971324 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:22.778141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45c137df-1553-4da2-b663-d1abc6971324 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:22.779199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45c137df-1553-4da2-b663-d1abc6971324 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:22.840209 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-45c137df-1553-4da2-b663-d1abc6971324 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:22.848199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-45c137df-1553-4da2-b663-d1abc6971324 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082149 Jul 27 22:56:22.848791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 529/1049] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:22 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:23.002082 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8cd41fb1-8ebb-4cf7-99d6-c452a0f90e83 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:23.004117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8cd41fb1-8ebb-4cf7-99d6-c452a0f90e83 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:23.010198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8cd41fb1-8ebb-4cf7-99d6-c452a0f90e83 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:23.010669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8cd41fb1-8ebb-4cf7-99d6-c452a0f90e83 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:23.011427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8cd41fb1-8ebb-4cf7-99d6-c452a0f90e83 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:23.011853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8cd41fb1-8ebb-4cf7-99d6-c452a0f90e83 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:23.040751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8cd41fb1-8ebb-4cf7-99d6-c452a0f90e83 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042720 Jul 27 22:56:23.041285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 521/1050] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:22 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:23.371267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3e1fcfac-8d31-488d-944c-adca34e0e0e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:23.374021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3e1fcfac-8d31-488d-944c-adca34e0e0e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:23.380067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e1fcfac-8d31-488d-944c-adca34e0e0e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:23.380511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e1fcfac-8d31-488d-944c-adca34e0e0e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:23.381284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e1fcfac-8d31-488d-944c-adca34e0e0e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:23.381709 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e1fcfac-8d31-488d-944c-adca34e0e0e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:23.409399 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3e1fcfac-8d31-488d-944c-adca34e0e0e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042158 Jul 27 22:56:23.409939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 530/1051] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:23 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:23.756037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f79ba5d8-3497-40f9-820c-ecade58fca3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:23.758150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f79ba5d8-3497-40f9-820c-ecade58fca3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:23.764151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f79ba5d8-3497-40f9-820c-ecade58fca3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:23.764625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f79ba5d8-3497-40f9-820c-ecade58fca3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:23.765389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f79ba5d8-3497-40f9-820c-ecade58fca3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:23.765822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f79ba5d8-3497-40f9-820c-ecade58fca3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:23.793758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f79ba5d8-3497-40f9-820c-ecade58fca3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041772 Jul 27 22:56:23.794808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 522/1052] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:23 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:23.868959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1470a6bc-0b84-40da-9993-dd03fe7e725c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:23.869597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1470a6bc-0b84-40da-9993-dd03fe7e725c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:23.876075 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1470a6bc-0b84-40da-9993-dd03fe7e725c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:23.876526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1470a6bc-0b84-40da-9993-dd03fe7e725c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:23.877307 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1470a6bc-0b84-40da-9993-dd03fe7e725c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:23.877742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1470a6bc-0b84-40da-9993-dd03fe7e725c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:23.940659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1470a6bc-0b84-40da-9993-dd03fe7e725c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:23.948216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1470a6bc-0b84-40da-9993-dd03fe7e725c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083075 Jul 27 22:56:23.948808 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 531/1053] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:23 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:24.052865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-be40afc2-25fe-42d8-a56c-7a36424bdaa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:24.055049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-be40afc2-25fe-42d8-a56c-7a36424bdaa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:24.060947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be40afc2-25fe-42d8-a56c-7a36424bdaa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:24.061393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be40afc2-25fe-42d8-a56c-7a36424bdaa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:24.062154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be40afc2-25fe-42d8-a56c-7a36424bdaa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:24.062587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be40afc2-25fe-42d8-a56c-7a36424bdaa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:24.090527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-be40afc2-25fe-42d8-a56c-7a36424bdaa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041658 Jul 27 22:56:24.091574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 523/1054] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:24 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:24.421588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e5705432-1164-48ca-8a40-3b6a7a525258 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:24.423722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e5705432-1164-48ca-8a40-3b6a7a525258 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:24.429684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5705432-1164-48ca-8a40-3b6a7a525258 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:24.430123 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5705432-1164-48ca-8a40-3b6a7a525258 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:24.430873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5705432-1164-48ca-8a40-3b6a7a525258 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:24.431297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5705432-1164-48ca-8a40-3b6a7a525258 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:24.467151 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e5705432-1164-48ca-8a40-3b6a7a525258 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049567 Jul 27 22:56:24.467702 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 532/1055] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:24 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:24.806557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8811d685-9977-4340-86e9-85c3772f15f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:24.808700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8811d685-9977-4340-86e9-85c3772f15f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:24.815164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8811d685-9977-4340-86e9-85c3772f15f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:24.815625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8811d685-9977-4340-86e9-85c3772f15f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:24.816366 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8811d685-9977-4340-86e9-85c3772f15f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:24.816821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8811d685-9977-4340-86e9-85c3772f15f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:24.844898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8811d685-9977-4340-86e9-85c3772f15f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042241 Jul 27 22:56:24.845426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 524/1056] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:24 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:24.969078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f06ccb0a-cefa-4e53-98e5-fbe8ca9d0b48 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:24.969670 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f06ccb0a-cefa-4e53-98e5-fbe8ca9d0b48 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:24.976422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f06ccb0a-cefa-4e53-98e5-fbe8ca9d0b48 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:24.977376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f06ccb0a-cefa-4e53-98e5-fbe8ca9d0b48 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:24.978133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f06ccb0a-cefa-4e53-98e5-fbe8ca9d0b48 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:24.978561 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f06ccb0a-cefa-4e53-98e5-fbe8ca9d0b48 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:25.039508 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f06ccb0a-cefa-4e53-98e5-fbe8ca9d0b48 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:25.047807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f06ccb0a-cefa-4e53-98e5-fbe8ca9d0b48 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082625 Jul 27 22:56:25.048362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 533/1057] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:24 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:25.103207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b5472689-8896-4803-8700-bfb274c5a51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:25.105410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b5472689-8896-4803-8700-bfb274c5a51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:25.111767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5472689-8896-4803-8700-bfb274c5a51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:25.112210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5472689-8896-4803-8700-bfb274c5a51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:25.112984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5472689-8896-4803-8700-bfb274c5a51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:25.113411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5472689-8896-4803-8700-bfb274c5a51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:25.141806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b5472689-8896-4803-8700-bfb274c5a51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042735 Jul 27 22:56:25.142347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 525/1058] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:25 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:25.479867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f0f7680c-1fff-4d71-a950-16db28272e3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:25.482551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f0f7680c-1fff-4d71-a950-16db28272e3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:25.488480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f0f7680c-1fff-4d71-a950-16db28272e3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:25.488964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f0f7680c-1fff-4d71-a950-16db28272e3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:25.489712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f0f7680c-1fff-4d71-a950-16db28272e3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:25.490139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f0f7680c-1fff-4d71-a950-16db28272e3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:25.517654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f0f7680c-1fff-4d71-a950-16db28272e3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042172 Jul 27 22:56:25.518204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 534/1059] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:25.857352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0439b61b-14dd-4005-b7cf-6d6e94ae72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:25.859474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0439b61b-14dd-4005-b7cf-6d6e94ae72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:25.865404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0439b61b-14dd-4005-b7cf-6d6e94ae72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:25.865843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0439b61b-14dd-4005-b7cf-6d6e94ae72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:25.866585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0439b61b-14dd-4005-b7cf-6d6e94ae72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:25.867010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0439b61b-14dd-4005-b7cf-6d6e94ae72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:25.895112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0439b61b-14dd-4005-b7cf-6d6e94ae72a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041692 Jul 27 22:56:25.895646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 526/1060] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:25 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:26.068768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-04d67d86-e325-41c1-b605-45af13562589 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:26.069370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-04d67d86-e325-41c1-b605-45af13562589 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:26.075710 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04d67d86-e325-41c1-b605-45af13562589 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:26.076151 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04d67d86-e325-41c1-b605-45af13562589 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:26.077599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04d67d86-e325-41c1-b605-45af13562589 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:26.078030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04d67d86-e325-41c1-b605-45af13562589 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:26.137518 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-04d67d86-e325-41c1-b605-45af13562589 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:26.145711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-04d67d86-e325-41c1-b605-45af13562589 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080851 Jul 27 22:56:26.146259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 535/1061] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:26 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:26.159339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b765a634-f64a-43b7-a992-5921b12046cc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:26.161488 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b765a634-f64a-43b7-a992-5921b12046cc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:26.167413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b765a634-f64a-43b7-a992-5921b12046cc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:26.167855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b765a634-f64a-43b7-a992-5921b12046cc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:26.168632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b765a634-f64a-43b7-a992-5921b12046cc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:26.169061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b765a634-f64a-43b7-a992-5921b12046cc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:26.173280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:26.197862 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b765a634-f64a-43b7-a992-5921b12046cc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Jul 27 22:56:26.198399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 527/1062] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:26 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:26.529946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d7375c54-9fc9-436f-9cf0-9bf235ca62ad tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:26.531993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d7375c54-9fc9-436f-9cf0-9bf235ca62ad tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:26.537961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7375c54-9fc9-436f-9cf0-9bf235ca62ad tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:26.538399 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7375c54-9fc9-436f-9cf0-9bf235ca62ad tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:26.539144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7375c54-9fc9-436f-9cf0-9bf235ca62ad tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:26.539585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7375c54-9fc9-436f-9cf0-9bf235ca62ad tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:26.568024 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d7375c54-9fc9-436f-9cf0-9bf235ca62ad tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 Jul 27 22:56:26.568586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 536/1063] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:26 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:26.907870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4c276046-fc7c-4daa-82a1-13f25db3e2a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:26.910017 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4c276046-fc7c-4daa-82a1-13f25db3e2a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:26.915962 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c276046-fc7c-4daa-82a1-13f25db3e2a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:26.916402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c276046-fc7c-4daa-82a1-13f25db3e2a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:26.917194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c276046-fc7c-4daa-82a1-13f25db3e2a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:26.917628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c276046-fc7c-4daa-82a1-13f25db3e2a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:26.945905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4c276046-fc7c-4daa-82a1-13f25db3e2a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042566 Jul 27 22:56:26.946448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 528/1064] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:26 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:27.166107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8573d509-753b-4522-8b76-22b98e1f39cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:27.166661 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8573d509-753b-4522-8b76-22b98e1f39cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:27.173251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8573d509-753b-4522-8b76-22b98e1f39cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:27.173710 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8573d509-753b-4522-8b76-22b98e1f39cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:27.174501 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8573d509-753b-4522-8b76-22b98e1f39cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:27.174937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8573d509-753b-4522-8b76-22b98e1f39cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:27.178901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:27.210524 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ca34f743-023d-46f2-9270-19acfd27a84f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:27.212674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ca34f743-023d-46f2-9270-19acfd27a84f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:27.219465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ca34f743-023d-46f2-9270-19acfd27a84f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:27.219913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ca34f743-023d-46f2-9270-19acfd27a84f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:27.220702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ca34f743-023d-46f2-9270-19acfd27a84f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:27.221136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ca34f743-023d-46f2-9270-19acfd27a84f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:27.238354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8573d509-753b-4522-8b76-22b98e1f39cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:27.245742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8573d509-753b-4522-8b76-22b98e1f39cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083573 Jul 27 22:56:27.246307 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 537/1065] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:27 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:27.250811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ca34f743-023d-46f2-9270-19acfd27a84f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Jul 27 22:56:27.251370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 529/1066] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:27 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:56:27.579907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-423e027f-7677-4d9c-b3ee-fbd5fb19cedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:27.582078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-423e027f-7677-4d9c-b3ee-fbd5fb19cedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:27.588099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-423e027f-7677-4d9c-b3ee-fbd5fb19cedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:27.588542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-423e027f-7677-4d9c-b3ee-fbd5fb19cedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:27.589338 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-423e027f-7677-4d9c-b3ee-fbd5fb19cedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:27.589767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-423e027f-7677-4d9c-b3ee-fbd5fb19cedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:27.618249 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-423e027f-7677-4d9c-b3ee-fbd5fb19cedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042807 Jul 27 22:56:27.618965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 538/1067] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:27 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:27.958365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b3dbaf3b-12ce-408e-8c2b-325fc8812d75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:27.960511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b3dbaf3b-12ce-408e-8c2b-325fc8812d75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:27.966553 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3dbaf3b-12ce-408e-8c2b-325fc8812d75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:27.966992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3dbaf3b-12ce-408e-8c2b-325fc8812d75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:27.967735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3dbaf3b-12ce-408e-8c2b-325fc8812d75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:27.968160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3dbaf3b-12ce-408e-8c2b-325fc8812d75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:27.997557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b3dbaf3b-12ce-408e-8c2b-325fc8812d75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042897 Jul 27 22:56:27.998229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 530/1068] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:27 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:28.263240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2f1cd304-dcc2-4580-ac2d-7f4997bb9533 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:28.265407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2f1cd304-dcc2-4580-ac2d-7f4997bb9533 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:28.265617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4abd34c9-cd5d-4944-8bc4-7a8dbb480dc1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:28.266224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4abd34c9-cd5d-4944-8bc4-7a8dbb480dc1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:28.271841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f1cd304-dcc2-4580-ac2d-7f4997bb9533 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:28.272199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4abd34c9-cd5d-4944-8bc4-7a8dbb480dc1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:28.272334 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f1cd304-dcc2-4580-ac2d-7f4997bb9533 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:28.272678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4abd34c9-cd5d-4944-8bc4-7a8dbb480dc1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:28.273046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f1cd304-dcc2-4580-ac2d-7f4997bb9533 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:28.273431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4abd34c9-cd5d-4944-8bc4-7a8dbb480dc1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:28.273538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f1cd304-dcc2-4580-ac2d-7f4997bb9533 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:28.273865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4abd34c9-cd5d-4944-8bc4-7a8dbb480dc1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:28.302905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2f1cd304-dcc2-4580-ac2d-7f4997bb9533 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043807 Jul 27 22:56:28.303464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 539/1069] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:28 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:28.336217 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4abd34c9-cd5d-4944-8bc4-7a8dbb480dc1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:28.344306 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4abd34c9-cd5d-4944-8bc4-7a8dbb480dc1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082406 Jul 27 22:56:28.344895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 531/1070] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:28 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:28.630255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7edd61fd-9c37-4eb1-a8be-f47d15381d7f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:28.632397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7edd61fd-9c37-4eb1-a8be-f47d15381d7f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:28.638461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7edd61fd-9c37-4eb1-a8be-f47d15381d7f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:28.638903 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7edd61fd-9c37-4eb1-a8be-f47d15381d7f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:28.640191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7edd61fd-9c37-4eb1-a8be-f47d15381d7f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:28.640629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7edd61fd-9c37-4eb1-a8be-f47d15381d7f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:28.668278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7edd61fd-9c37-4eb1-a8be-f47d15381d7f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 Jul 27 22:56:28.668838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 540/1071] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:28 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:29.010681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-db506e08-c51d-4a84-8b5b-6daa408739fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:29.012750 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-db506e08-c51d-4a84-8b5b-6daa408739fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:29.019177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db506e08-c51d-4a84-8b5b-6daa408739fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:29.019671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db506e08-c51d-4a84-8b5b-6daa408739fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:29.020418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db506e08-c51d-4a84-8b5b-6daa408739fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:29.020875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db506e08-c51d-4a84-8b5b-6daa408739fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:29.048959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-db506e08-c51d-4a84-8b5b-6daa408739fa tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042338 Jul 27 22:56:29.049496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 532/1072] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:29 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:29.315561 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-477b13d2-8ec2-44e4-962b-884243381fe3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:29.317736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-477b13d2-8ec2-44e4-962b-884243381fe3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:29.324176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-477b13d2-8ec2-44e4-962b-884243381fe3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:29.324657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-477b13d2-8ec2-44e4-962b-884243381fe3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:29.325415 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-477b13d2-8ec2-44e4-962b-884243381fe3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:29.325848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-477b13d2-8ec2-44e4-962b-884243381fe3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:29.354801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-477b13d2-8ec2-44e4-962b-884243381fe3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 Jul 27 22:56:29.355340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 541/1073] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:29 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:29.364861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-402db320-6872-4754-9443-881c7d742071 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:29.365456 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-402db320-6872-4754-9443-881c7d742071 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:29.367367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:29.372651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-402db320-6872-4754-9443-881c7d742071 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:29.373098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-402db320-6872-4754-9443-881c7d742071 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:29.374355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-402db320-6872-4754-9443-881c7d742071 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:29.374785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-402db320-6872-4754-9443-881c7d742071 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:29.434137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-402db320-6872-4754-9443-881c7d742071 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:29.442055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-402db320-6872-4754-9443-881c7d742071 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081215 Jul 27 22:56:29.442611 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 533/1074] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:29 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:29.680642 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c634d433-57a0-4018-a50d-33eb93432271 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:29.682811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c634d433-57a0-4018-a50d-33eb93432271 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:29.689517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c634d433-57a0-4018-a50d-33eb93432271 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:29.689970 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c634d433-57a0-4018-a50d-33eb93432271 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:29.690733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c634d433-57a0-4018-a50d-33eb93432271 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:29.691171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c634d433-57a0-4018-a50d-33eb93432271 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:29.718515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c634d433-57a0-4018-a50d-33eb93432271 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041841 Jul 27 22:56:29.719059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 542/1075] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:29 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:30.060958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5fff1364-8407-44fe-8b7a-c26280f1ce5a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:30.063076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5fff1364-8407-44fe-8b7a-c26280f1ce5a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:30.069099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5fff1364-8407-44fe-8b7a-c26280f1ce5a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:30.069540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5fff1364-8407-44fe-8b7a-c26280f1ce5a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:30.070296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5fff1364-8407-44fe-8b7a-c26280f1ce5a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:30.070724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5fff1364-8407-44fe-8b7a-c26280f1ce5a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:30.099177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5fff1364-8407-44fe-8b7a-c26280f1ce5a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042268 Jul 27 22:56:30.099713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 534/1076] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:30.366531 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-06cc9c01-81e6-4270-9c9c-ee4c312d19ac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:30.368768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-06cc9c01-81e6-4270-9c9c-ee4c312d19ac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:30.375867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06cc9c01-81e6-4270-9c9c-ee4c312d19ac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:30.376316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06cc9c01-81e6-4270-9c9c-ee4c312d19ac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:30.377122 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06cc9c01-81e6-4270-9c9c-ee4c312d19ac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:30.377561 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06cc9c01-81e6-4270-9c9c-ee4c312d19ac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:30.405645 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-06cc9c01-81e6-4270-9c9c-ee4c312d19ac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043136 Jul 27 22:56:30.406185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 543/1077] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:30 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:30.462411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f17cdc2b-0121-4ea7-86d9-f16aac751064 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:30.463008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f17cdc2b-0121-4ea7-86d9-f16aac751064 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:30.469229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f17cdc2b-0121-4ea7-86d9-f16aac751064 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:30.469663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f17cdc2b-0121-4ea7-86d9-f16aac751064 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:30.470409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f17cdc2b-0121-4ea7-86d9-f16aac751064 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:30.470839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f17cdc2b-0121-4ea7-86d9-f16aac751064 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:30.530918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f17cdc2b-0121-4ea7-86d9-f16aac751064 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:30.538238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f17cdc2b-0121-4ea7-86d9-f16aac751064 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079684 Jul 27 22:56:30.538786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 535/1078] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:30 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:30.731181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d4f06ce6-94eb-445c-a069-ab2e220b13ab tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:30.734001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d4f06ce6-94eb-445c-a069-ab2e220b13ab tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:30.739933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d4f06ce6-94eb-445c-a069-ab2e220b13ab tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:30.740382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d4f06ce6-94eb-445c-a069-ab2e220b13ab tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:30.741187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d4f06ce6-94eb-445c-a069-ab2e220b13ab tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:30.741627 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d4f06ce6-94eb-445c-a069-ab2e220b13ab tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:30.768983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d4f06ce6-94eb-445c-a069-ab2e220b13ab tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042179 Jul 27 22:56:30.769527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 544/1079] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:30 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:31.110820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-61388c09-e709-4d8a-b1c7-d09725921014 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:31.112975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-61388c09-e709-4d8a-b1c7-d09725921014 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:31.119192 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61388c09-e709-4d8a-b1c7-d09725921014 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:31.119632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61388c09-e709-4d8a-b1c7-d09725921014 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:31.120385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61388c09-e709-4d8a-b1c7-d09725921014 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:31.120906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61388c09-e709-4d8a-b1c7-d09725921014 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:31.149514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-61388c09-e709-4d8a-b1c7-d09725921014 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042678 Jul 27 22:56:31.150064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 536/1080] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:31 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:56:31.417773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6b7c8b67-4c51-4972-ba71-490c4d0d86dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:31.419846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6b7c8b67-4c51-4972-ba71-490c4d0d86dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:31.426328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b7c8b67-4c51-4972-ba71-490c4d0d86dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:31.426772 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b7c8b67-4c51-4972-ba71-490c4d0d86dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:31.427529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b7c8b67-4c51-4972-ba71-490c4d0d86dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:31.427964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b7c8b67-4c51-4972-ba71-490c4d0d86dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:31.456848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6b7c8b67-4c51-4972-ba71-490c4d0d86dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043086 Jul 27 22:56:31.457388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 545/1081] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:31 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:31.558878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f5f4f2a1-10c8-40df-8fe8-cd40a3a64d5c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:31.559481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f5f4f2a1-10c8-40df-8fe8-cd40a3a64d5c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:31.565971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f5f4f2a1-10c8-40df-8fe8-cd40a3a64d5c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:31.566409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f5f4f2a1-10c8-40df-8fe8-cd40a3a64d5c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:31.567152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f5f4f2a1-10c8-40df-8fe8-cd40a3a64d5c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:31.567578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f5f4f2a1-10c8-40df-8fe8-cd40a3a64d5c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:31.626922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f5f4f2a1-10c8-40df-8fe8-cd40a3a64d5c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:31.634281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f5f4f2a1-10c8-40df-8fe8-cd40a3a64d5c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079194 Jul 27 22:56:31.634842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 537/1082] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:31 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:31.781380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-07734938-763c-47cc-9c45-83400fdc38d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:31.783456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-07734938-763c-47cc-9c45-83400fdc38d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:31.789506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07734938-763c-47cc-9c45-83400fdc38d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:31.789952 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07734938-763c-47cc-9c45-83400fdc38d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:31.790711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07734938-763c-47cc-9c45-83400fdc38d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:31.791147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07734938-763c-47cc-9c45-83400fdc38d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:31.819691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-07734938-763c-47cc-9c45-83400fdc38d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042336 Jul 27 22:56:31.820226 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 546/1083] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:31 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:32.162015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3a517151-483f-455f-8acc-c6f5db929879 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:32.164152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3a517151-483f-455f-8acc-c6f5db929879 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:32.170070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3a517151-483f-455f-8acc-c6f5db929879 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:32.171165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3a517151-483f-455f-8acc-c6f5db929879 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:32.171917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3a517151-483f-455f-8acc-c6f5db929879 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:32.172341 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3a517151-483f-455f-8acc-c6f5db929879 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:32.200072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3a517151-483f-455f-8acc-c6f5db929879 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042058 Jul 27 22:56:32.200626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 538/1084] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:32 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:32.469185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1680ece0-c600-4bdd-abc0-5a4d7f9d8df2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:32.471258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1680ece0-c600-4bdd-abc0-5a4d7f9d8df2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:32.484290 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1680ece0-c600-4bdd-abc0-5a4d7f9d8df2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:32.484777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1680ece0-c600-4bdd-abc0-5a4d7f9d8df2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:32.485551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1680ece0-c600-4bdd-abc0-5a4d7f9d8df2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:32.485983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1680ece0-c600-4bdd-abc0-5a4d7f9d8df2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:32.514850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1680ece0-c600-4bdd-abc0-5a4d7f9d8df2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049748 Jul 27 22:56:32.515401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 547/1085] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:32 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:32.655070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fff010e1-1e2b-4662-860a-d427758d1c9e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:32.655667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fff010e1-1e2b-4662-860a-d427758d1c9e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:32.661654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fff010e1-1e2b-4662-860a-d427758d1c9e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:32.662091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fff010e1-1e2b-4662-860a-d427758d1c9e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:32.662838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fff010e1-1e2b-4662-860a-d427758d1c9e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:32.663267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fff010e1-1e2b-4662-860a-d427758d1c9e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:32.724931 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fff010e1-1e2b-4662-860a-d427758d1c9e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:32.732544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fff010e1-1e2b-4662-860a-d427758d1c9e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081328 Jul 27 22:56:32.733648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 539/1086] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:32 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:32.831738 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7f11aa8d-f4b5-4adf-8c92-cf5dfd81dc69 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:32.833928 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7f11aa8d-f4b5-4adf-8c92-cf5dfd81dc69 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:32.835871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:32.841161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f11aa8d-f4b5-4adf-8c92-cf5dfd81dc69 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:32.841613 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f11aa8d-f4b5-4adf-8c92-cf5dfd81dc69 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:32.842901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f11aa8d-f4b5-4adf-8c92-cf5dfd81dc69 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:32.843422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f11aa8d-f4b5-4adf-8c92-cf5dfd81dc69 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:32.872473 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7f11aa8d-f4b5-4adf-8c92-cf5dfd81dc69 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Jul 27 22:56:32.873052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 548/1087] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:32 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:33.212983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2e628ff1-fbd0-46f1-90a6-8f6b7bbe25f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:33.215109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2e628ff1-fbd0-46f1-90a6-8f6b7bbe25f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:33.221807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e628ff1-fbd0-46f1-90a6-8f6b7bbe25f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:33.222251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e628ff1-fbd0-46f1-90a6-8f6b7bbe25f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:33.223011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e628ff1-fbd0-46f1-90a6-8f6b7bbe25f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:33.223440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e628ff1-fbd0-46f1-90a6-8f6b7bbe25f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:33.251299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2e628ff1-fbd0-46f1-90a6-8f6b7bbe25f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042313 Jul 27 22:56:33.251836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 540/1088] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:33.528492 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e8177f2d-feb8-4448-9695-80c07139c1a4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:33.531205 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e8177f2d-feb8-4448-9695-80c07139c1a4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:33.537636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8177f2d-feb8-4448-9695-80c07139c1a4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:33.538079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8177f2d-feb8-4448-9695-80c07139c1a4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:33.538826 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8177f2d-feb8-4448-9695-80c07139c1a4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:33.539254 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8177f2d-feb8-4448-9695-80c07139c1a4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:33.567886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e8177f2d-feb8-4448-9695-80c07139c1a4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043489 Jul 27 22:56:33.568414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 549/1089] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:33 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:33.752958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f936e7fe-8675-4d66-9f4e-fc450be4d4f3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:33.753584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f936e7fe-8675-4d66-9f4e-fc450be4d4f3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:33.759513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f936e7fe-8675-4d66-9f4e-fc450be4d4f3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:33.759956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f936e7fe-8675-4d66-9f4e-fc450be4d4f3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:33.760736 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f936e7fe-8675-4d66-9f4e-fc450be4d4f3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:33.761175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f936e7fe-8675-4d66-9f4e-fc450be4d4f3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:33.819708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f936e7fe-8675-4d66-9f4e-fc450be4d4f3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:33.827734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f936e7fe-8675-4d66-9f4e-fc450be4d4f3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079161 Jul 27 22:56:33.828288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 541/1090] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:33 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:33.884777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0bd5b297-2a1c-4dc6-8d96-cca6aeec4d21 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:33.887059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0bd5b297-2a1c-4dc6-8d96-cca6aeec4d21 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:33.893714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bd5b297-2a1c-4dc6-8d96-cca6aeec4d21 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:33.894160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bd5b297-2a1c-4dc6-8d96-cca6aeec4d21 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:33.894926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bd5b297-2a1c-4dc6-8d96-cca6aeec4d21 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:33.895364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bd5b297-2a1c-4dc6-8d96-cca6aeec4d21 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:33.923142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0bd5b297-2a1c-4dc6-8d96-cca6aeec4d21 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042454 Jul 27 22:56:33.923687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 550/1091] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:33 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:34.264967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fc0eedb8-c9fb-47e6-8cc9-3f31a7d727ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:34.267102 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fc0eedb8-c9fb-47e6-8cc9-3f31a7d727ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:34.273069 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc0eedb8-c9fb-47e6-8cc9-3f31a7d727ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:34.273512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc0eedb8-c9fb-47e6-8cc9-3f31a7d727ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:34.274273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc0eedb8-c9fb-47e6-8cc9-3f31a7d727ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:34.274706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc0eedb8-c9fb-47e6-8cc9-3f31a7d727ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:34.303752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fc0eedb8-c9fb-47e6-8cc9-3f31a7d727ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043697 Jul 27 22:56:34.304313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 542/1092] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:34 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:34.580030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-af012737-5887-4305-99d9-790e8fe2660e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:34.582197 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-af012737-5887-4305-99d9-790e8fe2660e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:34.588756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af012737-5887-4305-99d9-790e8fe2660e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:34.589203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af012737-5887-4305-99d9-790e8fe2660e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:34.589965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af012737-5887-4305-99d9-790e8fe2660e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:34.590398 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af012737-5887-4305-99d9-790e8fe2660e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:34.619120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-af012737-5887-4305-99d9-790e8fe2660e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043671 Jul 27 22:56:34.619685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 551/1093] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:34 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:34.848592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fecc540c-6d36-417e-9849-bc59dab939aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:34.849143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fecc540c-6d36-417e-9849-bc59dab939aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:34.855366 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fecc540c-6d36-417e-9849-bc59dab939aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:34.855815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fecc540c-6d36-417e-9849-bc59dab939aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:34.856585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fecc540c-6d36-417e-9849-bc59dab939aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:34.857027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fecc540c-6d36-417e-9849-bc59dab939aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:34.916431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fecc540c-6d36-417e-9849-bc59dab939aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:34.919780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:34.925070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fecc540c-6d36-417e-9849-bc59dab939aa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080405 Jul 27 22:56:34.925634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 543/1094] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:34 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:34.935202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-77a3cb43-b0aa-411e-9c68-b67a785ccf80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:34.938031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-77a3cb43-b0aa-411e-9c68-b67a785ccf80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:34.943958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77a3cb43-b0aa-411e-9c68-b67a785ccf80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:34.944401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77a3cb43-b0aa-411e-9c68-b67a785ccf80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:34.945194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77a3cb43-b0aa-411e-9c68-b67a785ccf80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:34.945628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77a3cb43-b0aa-411e-9c68-b67a785ccf80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:34.972901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-77a3cb43-b0aa-411e-9c68-b67a785ccf80 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041579 Jul 27 22:56:34.973440 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 552/1095] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:34 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:35.317867 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fab58ec6-0206-4ebf-aa06-12846ac1f347 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:35.319991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fab58ec6-0206-4ebf-aa06-12846ac1f347 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:35.325983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fab58ec6-0206-4ebf-aa06-12846ac1f347 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:35.326431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fab58ec6-0206-4ebf-aa06-12846ac1f347 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:35.327186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fab58ec6-0206-4ebf-aa06-12846ac1f347 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:35.327613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fab58ec6-0206-4ebf-aa06-12846ac1f347 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:35.356135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fab58ec6-0206-4ebf-aa06-12846ac1f347 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042470 Jul 27 22:56:35.356697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 544/1096] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:35.631333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-47f635a6-47c7-4920-b625-2a9c22a82595 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:35.633499 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-47f635a6-47c7-4920-b625-2a9c22a82595 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:35.639986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-47f635a6-47c7-4920-b625-2a9c22a82595 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:35.640424 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-47f635a6-47c7-4920-b625-2a9c22a82595 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:35.641216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-47f635a6-47c7-4920-b625-2a9c22a82595 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:35.641647 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-47f635a6-47c7-4920-b625-2a9c22a82595 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:35.665306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:35.670011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-47f635a6-47c7-4920-b625-2a9c22a82595 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042649 Jul 27 22:56:35.671091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 553/1097] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:35 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:35.945751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c67e5092-c91d-45cc-b14c-2802d415f219 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:35.946268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c67e5092-c91d-45cc-b14c-2802d415f219 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:35.952268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c67e5092-c91d-45cc-b14c-2802d415f219 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:35.952816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c67e5092-c91d-45cc-b14c-2802d415f219 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:35.953559 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c67e5092-c91d-45cc-b14c-2802d415f219 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:35.953983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c67e5092-c91d-45cc-b14c-2802d415f219 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:35.986353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-43e44ec9-d0ba-41f8-a757-c42f29fb50e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:35.988878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-43e44ec9-d0ba-41f8-a757-c42f29fb50e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:35.995408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43e44ec9-d0ba-41f8-a757-c42f29fb50e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:35.995918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43e44ec9-d0ba-41f8-a757-c42f29fb50e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:35.996778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43e44ec9-d0ba-41f8-a757-c42f29fb50e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:35.997253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43e44ec9-d0ba-41f8-a757-c42f29fb50e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:36.013936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c67e5092-c91d-45cc-b14c-2802d415f219 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:36.021490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c67e5092-c91d-45cc-b14c-2802d415f219 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079606 Jul 27 22:56:36.022054 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 545/1098] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:35 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:36.026465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-43e44ec9-d0ba-41f8-a757-c42f29fb50e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044712 Jul 27 22:56:36.027015 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 554/1099] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:35 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:56:36.369864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ed984d8a-5c3b-40c5-88d4-4016c94f77b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:36.371980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ed984d8a-5c3b-40c5-88d4-4016c94f77b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:36.377909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed984d8a-5c3b-40c5-88d4-4016c94f77b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:36.378351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed984d8a-5c3b-40c5-88d4-4016c94f77b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:36.379097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed984d8a-5c3b-40c5-88d4-4016c94f77b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:36.379525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed984d8a-5c3b-40c5-88d4-4016c94f77b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:36.408298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ed984d8a-5c3b-40c5-88d4-4016c94f77b2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042441 Jul 27 22:56:36.408865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 546/1100] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:36.682948 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6a9ceeb6-6e0d-4465-8d1b-048542b19055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:36.685031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6a9ceeb6-6e0d-4465-8d1b-048542b19055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:36.692009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a9ceeb6-6e0d-4465-8d1b-048542b19055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:36.692481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a9ceeb6-6e0d-4465-8d1b-048542b19055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:36.693256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a9ceeb6-6e0d-4465-8d1b-048542b19055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:36.693684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a9ceeb6-6e0d-4465-8d1b-048542b19055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:36.722427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6a9ceeb6-6e0d-4465-8d1b-048542b19055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043536 Jul 27 22:56:36.722958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 555/1101] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:36 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:37.039186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-16cd95f3-583a-419d-ab18-ce3be09d788b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:37.041358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-16cd95f3-583a-419d-ab18-ce3be09d788b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:37.042994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ec80e70b-4a9b-49c9-aeb1-8d81e43e0446 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:37.043599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ec80e70b-4a9b-49c9-aeb1-8d81e43e0446 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:37.047918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-16cd95f3-583a-419d-ab18-ce3be09d788b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:37.048391 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-16cd95f3-583a-419d-ab18-ce3be09d788b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:37.049508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-16cd95f3-583a-419d-ab18-ce3be09d788b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:37.050289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-16cd95f3-583a-419d-ab18-ce3be09d788b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:37.054827 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec80e70b-4a9b-49c9-aeb1-8d81e43e0446 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:37.055518 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec80e70b-4a9b-49c9-aeb1-8d81e43e0446 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:37.056379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec80e70b-4a9b-49c9-aeb1-8d81e43e0446 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:37.056844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec80e70b-4a9b-49c9-aeb1-8d81e43e0446 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:37.080281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-16cd95f3-583a-419d-ab18-ce3be09d788b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045075 Jul 27 22:56:37.080864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 547/1102] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:37 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:37.122303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ec80e70b-4a9b-49c9-aeb1-8d81e43e0446 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:37.131111 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ec80e70b-4a9b-49c9-aeb1-8d81e43e0446 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.091846 Jul 27 22:56:37.131673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 556/1103] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:37 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:56:37.421274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-be021fe6-d098-4d1c-8bab-e0dcd99cd1f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:37.423301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-be021fe6-d098-4d1c-8bab-e0dcd99cd1f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:37.429327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be021fe6-d098-4d1c-8bab-e0dcd99cd1f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:37.429772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be021fe6-d098-4d1c-8bab-e0dcd99cd1f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:37.430529 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be021fe6-d098-4d1c-8bab-e0dcd99cd1f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:37.430959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be021fe6-d098-4d1c-8bab-e0dcd99cd1f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:37.458585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-be021fe6-d098-4d1c-8bab-e0dcd99cd1f2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042084 Jul 27 22:56:37.459120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 548/1104] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:37.735834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dd5f683a-1dfb-41e7-93be-49f931563303 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:37.737986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dd5f683a-1dfb-41e7-93be-49f931563303 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:37.744396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dd5f683a-1dfb-41e7-93be-49f931563303 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:37.744873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dd5f683a-1dfb-41e7-93be-49f931563303 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:37.745634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dd5f683a-1dfb-41e7-93be-49f931563303 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:37.747039 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dd5f683a-1dfb-41e7-93be-49f931563303 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:37.775533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dd5f683a-1dfb-41e7-93be-49f931563303 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044364 Jul 27 22:56:37.776080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 557/1105] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:37 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:38.093119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-83c574aa-66ed-4519-9170-bf27de6022cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:38.095256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-83c574aa-66ed-4519-9170-bf27de6022cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:38.101274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-83c574aa-66ed-4519-9170-bf27de6022cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:38.101720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-83c574aa-66ed-4519-9170-bf27de6022cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:38.102727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-83c574aa-66ed-4519-9170-bf27de6022cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:38.103160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-83c574aa-66ed-4519-9170-bf27de6022cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:38.130941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-83c574aa-66ed-4519-9170-bf27de6022cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042355 Jul 27 22:56:38.131480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 549/1106] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:38 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:38.150973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8e8ea25e-a09a-420c-9ddc-74133837e25f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:38.151588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8e8ea25e-a09a-420c-9ddc-74133837e25f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:38.158111 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e8ea25e-a09a-420c-9ddc-74133837e25f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:38.158557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e8ea25e-a09a-420c-9ddc-74133837e25f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:38.159343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e8ea25e-a09a-420c-9ddc-74133837e25f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:38.159780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e8ea25e-a09a-420c-9ddc-74133837e25f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:38.219528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8e8ea25e-a09a-420c-9ddc-74133837e25f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:38.227139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8e8ea25e-a09a-420c-9ddc-74133837e25f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079742 Jul 27 22:56:38.227692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 558/1107] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:38 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:38.471525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6739a88b-20ac-45ca-87c2-80445be9476f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:38.473577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6739a88b-20ac-45ca-87c2-80445be9476f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:38.479756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6739a88b-20ac-45ca-87c2-80445be9476f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:38.480190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6739a88b-20ac-45ca-87c2-80445be9476f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:38.480968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6739a88b-20ac-45ca-87c2-80445be9476f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:38.481392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6739a88b-20ac-45ca-87c2-80445be9476f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:38.509596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6739a88b-20ac-45ca-87c2-80445be9476f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042631 Jul 27 22:56:38.510148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 550/1108] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:38 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:38.787775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a27b9b4d-b394-46cd-a631-355d257051da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:38.789959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a27b9b4d-b394-46cd-a631-355d257051da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:38.796440 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a27b9b4d-b394-46cd-a631-355d257051da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:38.796916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a27b9b4d-b394-46cd-a631-355d257051da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:38.797678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a27b9b4d-b394-46cd-a631-355d257051da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:38.798115 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a27b9b4d-b394-46cd-a631-355d257051da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:38.827019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a27b9b4d-b394-46cd-a631-355d257051da tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042777 Jul 27 22:56:38.827567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 559/1109] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:38 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:39.143905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b1fb4c4a-5195-4e8a-9953-d8d28c091ed9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:39.145989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b1fb4c4a-5195-4e8a-9953-d8d28c091ed9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:39.152014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1fb4c4a-5195-4e8a-9953-d8d28c091ed9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:39.152462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1fb4c4a-5195-4e8a-9953-d8d28c091ed9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:39.153246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1fb4c4a-5195-4e8a-9953-d8d28c091ed9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:39.153677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1fb4c4a-5195-4e8a-9953-d8d28c091ed9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:39.181790 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b1fb4c4a-5195-4e8a-9953-d8d28c091ed9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042624 Jul 27 22:56:39.182334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 551/1110] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:39 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:39.246995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f1be7921-1a70-4e54-b212-63d7422f06f8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:39.247601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f1be7921-1a70-4e54-b212-63d7422f06f8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:39.254204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1be7921-1a70-4e54-b212-63d7422f06f8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:39.254698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1be7921-1a70-4e54-b212-63d7422f06f8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:39.255433 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1be7921-1a70-4e54-b212-63d7422f06f8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:39.255862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1be7921-1a70-4e54-b212-63d7422f06f8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:39.316843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f1be7921-1a70-4e54-b212-63d7422f06f8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:39.324438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f1be7921-1a70-4e54-b212-63d7422f06f8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081264 Jul 27 22:56:39.325035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 560/1111] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:39 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:39.522646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2dd81243-411b-47fb-bc48-1271afe9b7c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:39.524718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2dd81243-411b-47fb-bc48-1271afe9b7c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:39.531343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2dd81243-411b-47fb-bc48-1271afe9b7c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:39.531785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2dd81243-411b-47fb-bc48-1271afe9b7c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:39.532640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2dd81243-411b-47fb-bc48-1271afe9b7c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:39.533076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2dd81243-411b-47fb-bc48-1271afe9b7c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:39.561264 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2dd81243-411b-47fb-bc48-1271afe9b7c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042681 Jul 27 22:56:39.561840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 552/1112] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:39.839295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2059c086-8555-49d8-9485-e335b4361fa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:39.841483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2059c086-8555-49d8-9485-e335b4361fa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:39.848633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2059c086-8555-49d8-9485-e335b4361fa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:39.849085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2059c086-8555-49d8-9485-e335b4361fa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:39.849905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2059c086-8555-49d8-9485-e335b4361fa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:39.850339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2059c086-8555-49d8-9485-e335b4361fa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:39.879775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2059c086-8555-49d8-9485-e335b4361fa3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044497 Jul 27 22:56:39.880326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 561/1113] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:39 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:40.194887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-52f5e5b7-f9c5-400f-99da-e4ead00f4b93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:40.206830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-52f5e5b7-f9c5-400f-99da-e4ead00f4b93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:40.207078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52f5e5b7-f9c5-400f-99da-e4ead00f4b93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:40.207522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52f5e5b7-f9c5-400f-99da-e4ead00f4b93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:40.208283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52f5e5b7-f9c5-400f-99da-e4ead00f4b93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:40.208749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52f5e5b7-f9c5-400f-99da-e4ead00f4b93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:40.237222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-52f5e5b7-f9c5-400f-99da-e4ead00f4b93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046380 Jul 27 22:56:40.237775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 553/1114] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:40 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:40.345530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-335e2c97-5a6b-4154-a6a4-cc39e07305be tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:40.346160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-335e2c97-5a6b-4154-a6a4-cc39e07305be tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:40.352356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-335e2c97-5a6b-4154-a6a4-cc39e07305be tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:40.352825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-335e2c97-5a6b-4154-a6a4-cc39e07305be tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:40.353577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-335e2c97-5a6b-4154-a6a4-cc39e07305be tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:40.354003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-335e2c97-5a6b-4154-a6a4-cc39e07305be tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:40.413520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-335e2c97-5a6b-4154-a6a4-cc39e07305be tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:40.421695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-335e2c97-5a6b-4154-a6a4-cc39e07305be tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080461 Jul 27 22:56:40.422268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 562/1115] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:40 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:40.573560 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b92e632f-2ab5-41bd-aa47-1710d32943db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:40.575657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b92e632f-2ab5-41bd-aa47-1710d32943db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:40.582330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b92e632f-2ab5-41bd-aa47-1710d32943db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:40.582764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b92e632f-2ab5-41bd-aa47-1710d32943db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:40.583537 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b92e632f-2ab5-41bd-aa47-1710d32943db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:40.583961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b92e632f-2ab5-41bd-aa47-1710d32943db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:40.611806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b92e632f-2ab5-41bd-aa47-1710d32943db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042194 Jul 27 22:56:40.612343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 554/1116] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:56:40.891368 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6cd3ce17-2107-49a5-9797-1c210371acc5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:40.893563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6cd3ce17-2107-49a5-9797-1c210371acc5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:40.899973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6cd3ce17-2107-49a5-9797-1c210371acc5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:40.900413 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6cd3ce17-2107-49a5-9797-1c210371acc5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:40.901201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6cd3ce17-2107-49a5-9797-1c210371acc5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:40.901637 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6cd3ce17-2107-49a5-9797-1c210371acc5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:40.929920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6cd3ce17-2107-49a5-9797-1c210371acc5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042530 Jul 27 22:56:40.930457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 563/1117] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:40 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:41.249609 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-01e948b3-2802-411e-840a-c7b5fe1fbece tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:41.251757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-01e948b3-2802-411e-840a-c7b5fe1fbece tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:41.257670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01e948b3-2802-411e-840a-c7b5fe1fbece tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:41.258101 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01e948b3-2802-411e-840a-c7b5fe1fbece tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:41.258849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01e948b3-2802-411e-840a-c7b5fe1fbece tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:41.259274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01e948b3-2802-411e-840a-c7b5fe1fbece tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:41.287008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-01e948b3-2802-411e-840a-c7b5fe1fbece tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041372 Jul 27 22:56:41.287543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 555/1118] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:41 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:41.442664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-107d9e44-9951-4fb7-92e1-7fac3c5d94e2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:41.443178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-107d9e44-9951-4fb7-92e1-7fac3c5d94e2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:41.449160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-107d9e44-9951-4fb7-92e1-7fac3c5d94e2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:41.449613 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-107d9e44-9951-4fb7-92e1-7fac3c5d94e2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:41.450366 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-107d9e44-9951-4fb7-92e1-7fac3c5d94e2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:41.450798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-107d9e44-9951-4fb7-92e1-7fac3c5d94e2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:41.513319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-107d9e44-9951-4fb7-92e1-7fac3c5d94e2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:41.520864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-107d9e44-9951-4fb7-92e1-7fac3c5d94e2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082057 Jul 27 22:56:41.521424 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 564/1119] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:41 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:41.625037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a191a590-d31b-47e9-99e0-4ff681ae0104 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:41.626622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a191a590-d31b-47e9-99e0-4ff681ae0104 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:41.632608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a191a590-d31b-47e9-99e0-4ff681ae0104 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:41.633054 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a191a590-d31b-47e9-99e0-4ff681ae0104 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:41.633803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a191a590-d31b-47e9-99e0-4ff681ae0104 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:41.634229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a191a590-d31b-47e9-99e0-4ff681ae0104 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:41.662047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a191a590-d31b-47e9-99e0-4ff681ae0104 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042119 Jul 27 22:56:41.662587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 556/1120] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:41.941987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7b2bdfd1-afac-4f75-946b-1c29ac2c5b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:41.944164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7b2bdfd1-afac-4f75-946b-1c29ac2c5b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:41.950545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7b2bdfd1-afac-4f75-946b-1c29ac2c5b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:41.951016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7b2bdfd1-afac-4f75-946b-1c29ac2c5b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:41.951929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7b2bdfd1-afac-4f75-946b-1c29ac2c5b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:41.952356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7b2bdfd1-afac-4f75-946b-1c29ac2c5b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:41.983420 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7b2bdfd1-afac-4f75-946b-1c29ac2c5b6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 Jul 27 22:56:41.984025 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 565/1121] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:41 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:42.299432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fff61bb6-5390-4373-96f4-e30af26a52e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:42.301637 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fff61bb6-5390-4373-96f4-e30af26a52e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:42.307676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fff61bb6-5390-4373-96f4-e30af26a52e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:42.308123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fff61bb6-5390-4373-96f4-e30af26a52e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:42.308915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fff61bb6-5390-4373-96f4-e30af26a52e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:42.309351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fff61bb6-5390-4373-96f4-e30af26a52e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:42.337534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fff61bb6-5390-4373-96f4-e30af26a52e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042048 Jul 27 22:56:42.338094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 557/1122] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:42 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:42.541283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2e040e84-9245-47bb-ac59-a0f3c337c847 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:42.541893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2e040e84-9245-47bb-ac59-a0f3c337c847 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:42.548203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2e040e84-9245-47bb-ac59-a0f3c337c847 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:42.548672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2e040e84-9245-47bb-ac59-a0f3c337c847 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:42.549429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2e040e84-9245-47bb-ac59-a0f3c337c847 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:42.549904 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2e040e84-9245-47bb-ac59-a0f3c337c847 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:42.609252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2e040e84-9245-47bb-ac59-a0f3c337c847 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:42.616598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2e040e84-9245-47bb-ac59-a0f3c337c847 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079137 Jul 27 22:56:42.617155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 566/1123] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:42 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:42.674351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c4a9ff3b-4ec4-4465-a2ce-70cf8da90031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:42.676494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c4a9ff3b-4ec4-4465-a2ce-70cf8da90031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:42.682530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c4a9ff3b-4ec4-4465-a2ce-70cf8da90031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:42.682987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c4a9ff3b-4ec4-4465-a2ce-70cf8da90031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:42.683737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c4a9ff3b-4ec4-4465-a2ce-70cf8da90031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:42.684168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c4a9ff3b-4ec4-4465-a2ce-70cf8da90031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:42.713291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c4a9ff3b-4ec4-4465-a2ce-70cf8da90031 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043020 Jul 27 22:56:42.713847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 558/1124] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:42.997127 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-640c3254-dfeb-469d-a678-730f0cf1eb46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:43.000166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-640c3254-dfeb-469d-a678-730f0cf1eb46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:43.006984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-640c3254-dfeb-469d-a678-730f0cf1eb46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:43.007429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-640c3254-dfeb-469d-a678-730f0cf1eb46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:43.008203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-640c3254-dfeb-469d-a678-730f0cf1eb46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:43.008668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-640c3254-dfeb-469d-a678-730f0cf1eb46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:43.036493 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-640c3254-dfeb-469d-a678-730f0cf1eb46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Jul 27 22:56:43.037062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 567/1125] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:42 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:43.350234 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f79a84e0-a459-4a31-8d30-c52b05911b17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:43.352679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f79a84e0-a459-4a31-8d30-c52b05911b17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:43.359320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f79a84e0-a459-4a31-8d30-c52b05911b17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:43.359769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f79a84e0-a459-4a31-8d30-c52b05911b17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:43.360525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f79a84e0-a459-4a31-8d30-c52b05911b17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:43.360985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f79a84e0-a459-4a31-8d30-c52b05911b17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:43.387972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f79a84e0-a459-4a31-8d30-c52b05911b17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041731 Jul 27 22:56:43.388517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 559/1126] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:43 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:43.637404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-07f5f57b-8047-4d4a-a95f-7aae9482666b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:43.638007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-07f5f57b-8047-4d4a-a95f-7aae9482666b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:43.644456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07f5f57b-8047-4d4a-a95f-7aae9482666b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:43.644927 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07f5f57b-8047-4d4a-a95f-7aae9482666b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:43.645671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07f5f57b-8047-4d4a-a95f-7aae9482666b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:43.646099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07f5f57b-8047-4d4a-a95f-7aae9482666b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:43.705137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-07f5f57b-8047-4d4a-a95f-7aae9482666b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:43.712487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-07f5f57b-8047-4d4a-a95f-7aae9482666b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078943 Jul 27 22:56:43.713066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 568/1127] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:43 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:43.724981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c356d545-744c-4256-9eba-c6cf2219602a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:43.727351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c356d545-744c-4256-9eba-c6cf2219602a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:43.733295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c356d545-744c-4256-9eba-c6cf2219602a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:43.733767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c356d545-744c-4256-9eba-c6cf2219602a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:43.734518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c356d545-744c-4256-9eba-c6cf2219602a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:43.734946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c356d545-744c-4256-9eba-c6cf2219602a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:43.750858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:43.763719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c356d545-744c-4256-9eba-c6cf2219602a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042626 Jul 27 22:56:43.764823 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 560/1128] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:44.048775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-839f6b4b-85bc-47ad-a969-9ad195fe73a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:44.050943 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-839f6b4b-85bc-47ad-a969-9ad195fe73a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:44.057365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-839f6b4b-85bc-47ad-a969-9ad195fe73a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:44.057803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-839f6b4b-85bc-47ad-a969-9ad195fe73a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:44.058553 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-839f6b4b-85bc-47ad-a969-9ad195fe73a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:44.058979 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-839f6b4b-85bc-47ad-a969-9ad195fe73a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:44.090503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-839f6b4b-85bc-47ad-a969-9ad195fe73a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045654 Jul 27 22:56:44.091042 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 569/1129] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:44 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:44.399833 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b9344afa-1825-4c4e-8ce3-864c4042f33b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:44.402121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b9344afa-1825-4c4e-8ce3-864c4042f33b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:44.408069 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b9344afa-1825-4c4e-8ce3-864c4042f33b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:44.408512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b9344afa-1825-4c4e-8ce3-864c4042f33b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:44.409292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b9344afa-1825-4c4e-8ce3-864c4042f33b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:44.409723 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b9344afa-1825-4c4e-8ce3-864c4042f33b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:44.438148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b9344afa-1825-4c4e-8ce3-864c4042f33b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042329 Jul 27 22:56:44.438674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 561/1130] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:44 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:44.734209 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d8228d58-4ee6-4d4b-878a-4afbd04f14b2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:44.734831 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d8228d58-4ee6-4d4b-878a-4afbd04f14b2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:44.740932 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8228d58-4ee6-4d4b-878a-4afbd04f14b2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:44.741372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8228d58-4ee6-4d4b-878a-4afbd04f14b2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:44.742212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8228d58-4ee6-4d4b-878a-4afbd04f14b2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:44.742642 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8228d58-4ee6-4d4b-878a-4afbd04f14b2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:44.760607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:44.776394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6de022e8-cf76-4e2e-9d86-154698035de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:44.778588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6de022e8-cf76-4e2e-9d86-154698035de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:44.785158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6de022e8-cf76-4e2e-9d86-154698035de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:44.785600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6de022e8-cf76-4e2e-9d86-154698035de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:44.786363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6de022e8-cf76-4e2e-9d86-154698035de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:44.786794 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6de022e8-cf76-4e2e-9d86-154698035de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:44.803901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d8228d58-4ee6-4d4b-878a-4afbd04f14b2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:44.811396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d8228d58-4ee6-4d4b-878a-4afbd04f14b2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081629 Jul 27 22:56:44.812019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 570/1131] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:44 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:44.815924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6de022e8-cf76-4e2e-9d86-154698035de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043413 Jul 27 22:56:44.816477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 562/1132] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:44 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:56:45.102959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-50c3b3dc-affd-4bdb-9c2e-7a73899277d3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:45.105196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-50c3b3dc-affd-4bdb-9c2e-7a73899277d3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:45.112202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50c3b3dc-affd-4bdb-9c2e-7a73899277d3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:45.112674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50c3b3dc-affd-4bdb-9c2e-7a73899277d3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:45.113423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50c3b3dc-affd-4bdb-9c2e-7a73899277d3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:45.113852 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50c3b3dc-affd-4bdb-9c2e-7a73899277d3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:45.142302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-50c3b3dc-affd-4bdb-9c2e-7a73899277d3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043553 Jul 27 22:56:45.142844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 571/1133] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:45 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:45.450563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9e0817ba-f870-4048-a7fc-9f4bed7e1bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:45.453247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9e0817ba-f870-4048-a7fc-9f4bed7e1bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:45.459226 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9e0817ba-f870-4048-a7fc-9f4bed7e1bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:45.459673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9e0817ba-f870-4048-a7fc-9f4bed7e1bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:45.460423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9e0817ba-f870-4048-a7fc-9f4bed7e1bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:45.460883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9e0817ba-f870-4048-a7fc-9f4bed7e1bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:45.489445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9e0817ba-f870-4048-a7fc-9f4bed7e1bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042938 Jul 27 22:56:45.490164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 563/1134] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:45 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:45.828823 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b7718af7-a9e5-47ac-90e7-dc1ebcc7661d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:45.830950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b7718af7-a9e5-47ac-90e7-dc1ebcc7661d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:45.832260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f40c1c82-6168-4766-9917-b2c137856372 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:45.832896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f40c1c82-6168-4766-9917-b2c137856372 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:45.836996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7718af7-a9e5-47ac-90e7-dc1ebcc7661d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:45.837436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7718af7-a9e5-47ac-90e7-dc1ebcc7661d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:45.838190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7718af7-a9e5-47ac-90e7-dc1ebcc7661d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:45.838615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7718af7-a9e5-47ac-90e7-dc1ebcc7661d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:45.838737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f40c1c82-6168-4766-9917-b2c137856372 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:45.839133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f40c1c82-6168-4766-9917-b2c137856372 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:45.839891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f40c1c82-6168-4766-9917-b2c137856372 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:45.840322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f40c1c82-6168-4766-9917-b2c137856372 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:45.866983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b7718af7-a9e5-47ac-90e7-dc1ebcc7661d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042683 Jul 27 22:56:45.867537 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 572/1135] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:45 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:45.904221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f40c1c82-6168-4766-9917-b2c137856372 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:45.911815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f40c1c82-6168-4766-9917-b2c137856372 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083301 Jul 27 22:56:45.912370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 564/1136] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:45 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:56:46.154597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d3626f0f-6ada-40e0-afb5-bf62104c36e1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:46.156882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d3626f0f-6ada-40e0-afb5-bf62104c36e1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:46.163354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3626f0f-6ada-40e0-afb5-bf62104c36e1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:46.163796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3626f0f-6ada-40e0-afb5-bf62104c36e1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:46.164572 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3626f0f-6ada-40e0-afb5-bf62104c36e1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:46.165015 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3626f0f-6ada-40e0-afb5-bf62104c36e1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:46.194924 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d3626f0f-6ada-40e0-afb5-bf62104c36e1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044488 Jul 27 22:56:46.195487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 573/1137] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:46 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:46.502366 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b056bf7b-1b1e-4192-8fcb-bb8a983fad83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:46.504405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b056bf7b-1b1e-4192-8fcb-bb8a983fad83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:46.510406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b056bf7b-1b1e-4192-8fcb-bb8a983fad83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:46.510845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b056bf7b-1b1e-4192-8fcb-bb8a983fad83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:46.511584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b056bf7b-1b1e-4192-8fcb-bb8a983fad83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:46.512005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b056bf7b-1b1e-4192-8fcb-bb8a983fad83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:46.540048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b056bf7b-1b1e-4192-8fcb-bb8a983fad83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042328 Jul 27 22:56:46.540607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 565/1138] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:46 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:46.879344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6a856851-1b03-4f4b-bedb-3093fab2b6ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:46.881517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6a856851-1b03-4f4b-bedb-3093fab2b6ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:46.887527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a856851-1b03-4f4b-bedb-3093fab2b6ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:46.887967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a856851-1b03-4f4b-bedb-3093fab2b6ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:46.888749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a856851-1b03-4f4b-bedb-3093fab2b6ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:46.889206 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6a856851-1b03-4f4b-bedb-3093fab2b6ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:46.916808 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6a856851-1b03-4f4b-bedb-3093fab2b6ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041455 Jul 27 22:56:46.917341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 574/1139] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:46.932634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-23d56149-5eb7-4e80-9e85-b517eba5f20c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:46.933245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-23d56149-5eb7-4e80-9e85-b517eba5f20c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:46.939950 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23d56149-5eb7-4e80-9e85-b517eba5f20c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:46.940388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23d56149-5eb7-4e80-9e85-b517eba5f20c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:46.941318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23d56149-5eb7-4e80-9e85-b517eba5f20c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:46.941749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23d56149-5eb7-4e80-9e85-b517eba5f20c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:47.002020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-23d56149-5eb7-4e80-9e85-b517eba5f20c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:47.009396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-23d56149-5eb7-4e80-9e85-b517eba5f20c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080731 Jul 27 22:56:47.009948 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 566/1140] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:46 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:47.207163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3780e95a-073b-4661-8f70-f520c9c9b48c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:47.209330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3780e95a-073b-4661-8f70-f520c9c9b48c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:47.215742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3780e95a-073b-4661-8f70-f520c9c9b48c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:47.216181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3780e95a-073b-4661-8f70-f520c9c9b48c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:47.217489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3780e95a-073b-4661-8f70-f520c9c9b48c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:47.217914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3780e95a-073b-4661-8f70-f520c9c9b48c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:47.246435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3780e95a-073b-4661-8f70-f520c9c9b48c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043221 Jul 27 22:56:47.246973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 575/1141] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:47 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:47.552157 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e4eec8f2-dc02-422f-a6bb-5a227588738a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:47.554299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e4eec8f2-dc02-422f-a6bb-5a227588738a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:47.560233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4eec8f2-dc02-422f-a6bb-5a227588738a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:47.560703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4eec8f2-dc02-422f-a6bb-5a227588738a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:47.561444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4eec8f2-dc02-422f-a6bb-5a227588738a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:47.561867 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4eec8f2-dc02-422f-a6bb-5a227588738a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:47.589429 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e4eec8f2-dc02-422f-a6bb-5a227588738a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041250 Jul 27 22:56:47.589964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 567/1142] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:47 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:47.929897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3fc270d1-2620-498a-a7f4-32f0dc7fd4cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:47.931945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3fc270d1-2620-498a-a7f4-32f0dc7fd4cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:47.938521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3fc270d1-2620-498a-a7f4-32f0dc7fd4cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:47.938960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3fc270d1-2620-498a-a7f4-32f0dc7fd4cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:47.939704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3fc270d1-2620-498a-a7f4-32f0dc7fd4cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:47.940132 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3fc270d1-2620-498a-a7f4-32f0dc7fd4cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:47.968520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3fc270d1-2620-498a-a7f4-32f0dc7fd4cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042754 Jul 27 22:56:47.969083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 576/1143] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:48.029503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4ce7b75f-17fc-46c2-ae60-3c3528e81b2d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:48.030147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4ce7b75f-17fc-46c2-ae60-3c3528e81b2d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:48.036122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ce7b75f-17fc-46c2-ae60-3c3528e81b2d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:48.036592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ce7b75f-17fc-46c2-ae60-3c3528e81b2d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:48.037352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ce7b75f-17fc-46c2-ae60-3c3528e81b2d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:48.037788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ce7b75f-17fc-46c2-ae60-3c3528e81b2d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:48.097343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4ce7b75f-17fc-46c2-ae60-3c3528e81b2d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:48.105013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4ce7b75f-17fc-46c2-ae60-3c3528e81b2d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079260 Jul 27 22:56:48.105568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 568/1144] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:48 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:48.258629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7a65a6ae-449c-4db2-8566-80fd4f06e39f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:48.260737 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7a65a6ae-449c-4db2-8566-80fd4f06e39f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:48.267145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a65a6ae-449c-4db2-8566-80fd4f06e39f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:48.267585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a65a6ae-449c-4db2-8566-80fd4f06e39f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:48.268337 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a65a6ae-449c-4db2-8566-80fd4f06e39f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:48.268795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a65a6ae-449c-4db2-8566-80fd4f06e39f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:48.296900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7a65a6ae-449c-4db2-8566-80fd4f06e39f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042239 Jul 27 22:56:48.297440 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 577/1145] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:48 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:48.602390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a2b910e1-40d8-445a-a107-2ea389c2b515 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:48.604559 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a2b910e1-40d8-445a-a107-2ea389c2b515 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:48.611268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2b910e1-40d8-445a-a107-2ea389c2b515 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:48.612010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2b910e1-40d8-445a-a107-2ea389c2b515 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:48.612461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2b910e1-40d8-445a-a107-2ea389c2b515 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:48.612994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2b910e1-40d8-445a-a107-2ea389c2b515 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:48.642796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a2b910e1-40d8-445a-a107-2ea389c2b515 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044520 Jul 27 22:56:48.643393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 569/1146] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:48 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:48.981315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-21130d1b-a9b7-4725-8d9b-48f52083ff2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:48.983432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-21130d1b-a9b7-4725-8d9b-48f52083ff2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:48.989495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21130d1b-a9b7-4725-8d9b-48f52083ff2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:48.989946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21130d1b-a9b7-4725-8d9b-48f52083ff2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:48.990715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21130d1b-a9b7-4725-8d9b-48f52083ff2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:48.991150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21130d1b-a9b7-4725-8d9b-48f52083ff2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:49.019828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-21130d1b-a9b7-4725-8d9b-48f52083ff2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042854 Jul 27 22:56:49.020385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 578/1147] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:48 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:49.125607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1ec6f344-f130-45bf-8408-cb7ee2568811 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:49.126213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1ec6f344-f130-45bf-8408-cb7ee2568811 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:49.132151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ec6f344-f130-45bf-8408-cb7ee2568811 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:49.132648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ec6f344-f130-45bf-8408-cb7ee2568811 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:49.133405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ec6f344-f130-45bf-8408-cb7ee2568811 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:49.133837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ec6f344-f130-45bf-8408-cb7ee2568811 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:49.193380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1ec6f344-f130-45bf-8408-cb7ee2568811 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:49.200718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1ec6f344-f130-45bf-8408-cb7ee2568811 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078938 Jul 27 22:56:49.201780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 570/1148] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:49 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:56:49.308377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-72722dff-eef5-4f25-b31b-310663368963 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:49.311158 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-72722dff-eef5-4f25-b31b-310663368963 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:49.317812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72722dff-eef5-4f25-b31b-310663368963 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:49.318261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72722dff-eef5-4f25-b31b-310663368963 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:49.319027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72722dff-eef5-4f25-b31b-310663368963 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:49.319464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72722dff-eef5-4f25-b31b-310663368963 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:49.348279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-72722dff-eef5-4f25-b31b-310663368963 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043838 Jul 27 22:56:49.348905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 579/1149] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:49 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:49.654434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d1abd8b0-eb79-48cb-8cd1-e40c52f3c76e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:49.656607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d1abd8b0-eb79-48cb-8cd1-e40c52f3c76e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:49.662590 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d1abd8b0-eb79-48cb-8cd1-e40c52f3c76e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:49.663029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d1abd8b0-eb79-48cb-8cd1-e40c52f3c76e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:49.663774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d1abd8b0-eb79-48cb-8cd1-e40c52f3c76e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:49.664195 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d1abd8b0-eb79-48cb-8cd1-e40c52f3c76e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:49.692432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d1abd8b0-eb79-48cb-8cd1-e40c52f3c76e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041960 Jul 27 22:56:49.692999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 571/1150] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:49 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:50.031958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b29dbeee-7cb1-4880-8dd0-6779e547c802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:50.034174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b29dbeee-7cb1-4880-8dd0-6779e547c802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:50.040122 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b29dbeee-7cb1-4880-8dd0-6779e547c802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:50.040583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b29dbeee-7cb1-4880-8dd0-6779e547c802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:50.041339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b29dbeee-7cb1-4880-8dd0-6779e547c802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:50.041765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b29dbeee-7cb1-4880-8dd0-6779e547c802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:50.069924 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b29dbeee-7cb1-4880-8dd0-6779e547c802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042546 Jul 27 22:56:50.070457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 580/1151] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:50 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:50.222074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-eade2438-4e71-474e-922b-d02fb4cedcbc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:50.222676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-eade2438-4e71-474e-922b-d02fb4cedcbc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:50.228881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eade2438-4e71-474e-922b-d02fb4cedcbc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:50.229319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eade2438-4e71-474e-922b-d02fb4cedcbc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:50.230058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eade2438-4e71-474e-922b-d02fb4cedcbc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:50.230480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eade2438-4e71-474e-922b-d02fb4cedcbc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:50.292143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eade2438-4e71-474e-922b-d02fb4cedcbc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:50.305656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-eade2438-4e71-474e-922b-d02fb4cedcbc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.087352 Jul 27 22:56:50.306228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 572/1152] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:50 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:50.361424 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e4f17652-eb63-44c7-9ff1-a9c4074de4e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:50.363633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e4f17652-eb63-44c7-9ff1-a9c4074de4e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:50.370022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4f17652-eb63-44c7-9ff1-a9c4074de4e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:50.370464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4f17652-eb63-44c7-9ff1-a9c4074de4e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:50.371217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4f17652-eb63-44c7-9ff1-a9c4074de4e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:50.371645 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4f17652-eb63-44c7-9ff1-a9c4074de4e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:50.399728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e4f17652-eb63-44c7-9ff1-a9c4074de4e6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042862 Jul 27 22:56:50.400258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 581/1153] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:50 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:50.705130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b4e30b7f-2514-4e05-81c8-92043f7ecd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:50.707144 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b4e30b7f-2514-4e05-81c8-92043f7ecd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:50.713080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b4e30b7f-2514-4e05-81c8-92043f7ecd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:50.713516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b4e30b7f-2514-4e05-81c8-92043f7ecd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:50.714258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b4e30b7f-2514-4e05-81c8-92043f7ecd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:50.714682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b4e30b7f-2514-4e05-81c8-92043f7ecd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:50.743947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b4e30b7f-2514-4e05-81c8-92043f7ecd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043274 Jul 27 22:56:50.744499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 573/1154] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:51.082878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f522c7a5-40c5-49f2-8cfa-d655c6c84ad0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:51.085086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f522c7a5-40c5-49f2-8cfa-d655c6c84ad0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:51.091091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f522c7a5-40c5-49f2-8cfa-d655c6c84ad0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:51.091539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f522c7a5-40c5-49f2-8cfa-d655c6c84ad0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:51.092297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f522c7a5-40c5-49f2-8cfa-d655c6c84ad0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:51.092772 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f522c7a5-40c5-49f2-8cfa-d655c6c84ad0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:51.121238 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f522c7a5-40c5-49f2-8cfa-d655c6c84ad0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042284 Jul 27 22:56:51.121802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 582/1155] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:51 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:51.325223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7c2c1886-2937-484b-bb02-1fb25726b4d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:51.325757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7c2c1886-2937-484b-bb02-1fb25726b4d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:51.332663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7c2c1886-2937-484b-bb02-1fb25726b4d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:51.333109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7c2c1886-2937-484b-bb02-1fb25726b4d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:51.333859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7c2c1886-2937-484b-bb02-1fb25726b4d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:51.334320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7c2c1886-2937-484b-bb02-1fb25726b4d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:51.393275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7c2c1886-2937-484b-bb02-1fb25726b4d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:51.400626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7c2c1886-2937-484b-bb02-1fb25726b4d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079416 Jul 27 22:56:51.401183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 574/1156] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:51 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:51.412793 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5629d7fb-a717-400f-8491-a7962206400a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:51.414953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5629d7fb-a717-400f-8491-a7962206400a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:51.421858 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5629d7fb-a717-400f-8491-a7962206400a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:51.422299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5629d7fb-a717-400f-8491-a7962206400a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:51.423057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5629d7fb-a717-400f-8491-a7962206400a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:51.423490 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5629d7fb-a717-400f-8491-a7962206400a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:51.452465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5629d7fb-a717-400f-8491-a7962206400a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043691 Jul 27 22:56:51.453038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 583/1157] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:51 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:51.755954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e72b31ab-796c-48b3-96a2-f5fbdf4f906e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:51.758087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e72b31ab-796c-48b3-96a2-f5fbdf4f906e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:51.764011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e72b31ab-796c-48b3-96a2-f5fbdf4f906e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:51.764447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e72b31ab-796c-48b3-96a2-f5fbdf4f906e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:51.765222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e72b31ab-796c-48b3-96a2-f5fbdf4f906e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:51.765647 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e72b31ab-796c-48b3-96a2-f5fbdf4f906e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:51.793146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e72b31ab-796c-48b3-96a2-f5fbdf4f906e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041176 Jul 27 22:56:51.793680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 575/1158] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:51 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:52.135056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f4aeba60-e96b-4fc9-adc3-073f9e2aaa5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:52.137230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f4aeba60-e96b-4fc9-adc3-073f9e2aaa5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:52.143893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4aeba60-e96b-4fc9-adc3-073f9e2aaa5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:52.144333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4aeba60-e96b-4fc9-adc3-073f9e2aaa5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:52.145127 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4aeba60-e96b-4fc9-adc3-073f9e2aaa5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:52.145557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4aeba60-e96b-4fc9-adc3-073f9e2aaa5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:52.174733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f4aeba60-e96b-4fc9-adc3-073f9e2aaa5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043707 Jul 27 22:56:52.175272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 584/1159] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:52 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:52.421343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1c5b10a9-e335-49d2-9ba4-b3641dbef4c0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:52.421872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1c5b10a9-e335-49d2-9ba4-b3641dbef4c0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:52.427830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c5b10a9-e335-49d2-9ba4-b3641dbef4c0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:52.428273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c5b10a9-e335-49d2-9ba4-b3641dbef4c0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:52.429052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c5b10a9-e335-49d2-9ba4-b3641dbef4c0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:52.429482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c5b10a9-e335-49d2-9ba4-b3641dbef4c0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:52.464377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-74d800bf-2cb1-48d1-bee1-ba37438909d0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:52.466662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-74d800bf-2cb1-48d1-bee1-ba37438909d0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:52.473203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-74d800bf-2cb1-48d1-bee1-ba37438909d0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:52.473646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-74d800bf-2cb1-48d1-bee1-ba37438909d0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:52.474406 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-74d800bf-2cb1-48d1-bee1-ba37438909d0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:52.474834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-74d800bf-2cb1-48d1-bee1-ba37438909d0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:52.489481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1c5b10a9-e335-49d2-9ba4-b3641dbef4c0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:52.496899 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1c5b10a9-e335-49d2-9ba4-b3641dbef4c0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079459 Jul 27 22:56:52.497478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 576/1160] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:52 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:52.504664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-74d800bf-2cb1-48d1-bee1-ba37438909d0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Jul 27 22:56:52.505210 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 585/1161] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:52 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:56:52.807425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-787ddb8b-598a-434f-9196-dafe22894ac5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:52.809584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-787ddb8b-598a-434f-9196-dafe22894ac5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:52.816631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-787ddb8b-598a-434f-9196-dafe22894ac5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:52.817018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-787ddb8b-598a-434f-9196-dafe22894ac5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:52.817775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-787ddb8b-598a-434f-9196-dafe22894ac5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:52.818204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-787ddb8b-598a-434f-9196-dafe22894ac5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:52.822017 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:52.846893 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-787ddb8b-598a-434f-9196-dafe22894ac5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044864 Jul 27 22:56:52.847442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 577/1162] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:52 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:53.187502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-72f644bc-78bf-47bb-bf8e-e34be6fcb33b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:53.189741 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-72f644bc-78bf-47bb-bf8e-e34be6fcb33b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:53.196149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72f644bc-78bf-47bb-bf8e-e34be6fcb33b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:53.196614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72f644bc-78bf-47bb-bf8e-e34be6fcb33b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:53.197380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72f644bc-78bf-47bb-bf8e-e34be6fcb33b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:53.197803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72f644bc-78bf-47bb-bf8e-e34be6fcb33b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:53.226341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-72f644bc-78bf-47bb-bf8e-e34be6fcb33b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042886 Jul 27 22:56:53.226885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 586/1163] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:53 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:53.517241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b8fcbd29-88f1-48eb-83cc-4e234098aa04 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:53.518302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ab9c5b0f-b43a-446f-aea5-232ebb79d6a1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:53.518906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ab9c5b0f-b43a-446f-aea5-232ebb79d6a1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:53.519491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b8fcbd29-88f1-48eb-83cc-4e234098aa04 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:53.525508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b8fcbd29-88f1-48eb-83cc-4e234098aa04 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:53.525662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab9c5b0f-b43a-446f-aea5-232ebb79d6a1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:53.525948 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b8fcbd29-88f1-48eb-83cc-4e234098aa04 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:53.526068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab9c5b0f-b43a-446f-aea5-232ebb79d6a1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:53.526713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b8fcbd29-88f1-48eb-83cc-4e234098aa04 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:53.526814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab9c5b0f-b43a-446f-aea5-232ebb79d6a1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:53.527147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b8fcbd29-88f1-48eb-83cc-4e234098aa04 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:53.527311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab9c5b0f-b43a-446f-aea5-232ebb79d6a1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:53.531643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:53.557299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b8fcbd29-88f1-48eb-83cc-4e234098aa04 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044538 Jul 27 22:56:53.557856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 578/1164] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:53 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:53.587763 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ab9c5b0f-b43a-446f-aea5-232ebb79d6a1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:53.595788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ab9c5b0f-b43a-446f-aea5-232ebb79d6a1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081824 Jul 27 22:56:53.596345 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 587/1165] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:53 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:56:53.859684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3de9db73-9a51-4c33-a989-c30bc03cadcf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:53.861855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3de9db73-9a51-4c33-a989-c30bc03cadcf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:53.867770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3de9db73-9a51-4c33-a989-c30bc03cadcf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:53.868211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3de9db73-9a51-4c33-a989-c30bc03cadcf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:53.869287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3de9db73-9a51-4c33-a989-c30bc03cadcf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:53.869724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3de9db73-9a51-4c33-a989-c30bc03cadcf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:53.897590 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3de9db73-9a51-4c33-a989-c30bc03cadcf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042428 Jul 27 22:56:53.898148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 579/1166] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:53 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:54.239494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c14d04aa-ba4b-47ff-b64c-b77cfa61fec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:54.241724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c14d04aa-ba4b-47ff-b64c-b77cfa61fec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:54.247821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c14d04aa-ba4b-47ff-b64c-b77cfa61fec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:54.248257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c14d04aa-ba4b-47ff-b64c-b77cfa61fec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:54.249693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c14d04aa-ba4b-47ff-b64c-b77cfa61fec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:54.250131 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c14d04aa-ba4b-47ff-b64c-b77cfa61fec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:54.277878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c14d04aa-ba4b-47ff-b64c-b77cfa61fec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042434 Jul 27 22:56:54.278426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 588/1167] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:54 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:54.569602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-10084ace-545b-47e4-a11d-19457c6466b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:54.571720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-10084ace-545b-47e4-a11d-19457c6466b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:54.577810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10084ace-545b-47e4-a11d-19457c6466b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:54.578256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10084ace-545b-47e4-a11d-19457c6466b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:54.579016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10084ace-545b-47e4-a11d-19457c6466b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:54.579449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10084ace-545b-47e4-a11d-19457c6466b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:54.611752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-10084ace-545b-47e4-a11d-19457c6466b7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044644 Jul 27 22:56:54.611752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 580/1168] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:54 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:54.618942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e8cd61ea-ea6f-458c-aa69-a28b504d04f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:54.619562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e8cd61ea-ea6f-458c-aa69-a28b504d04f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:54.626065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8cd61ea-ea6f-458c-aa69-a28b504d04f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:54.626514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8cd61ea-ea6f-458c-aa69-a28b504d04f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:54.627280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8cd61ea-ea6f-458c-aa69-a28b504d04f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:54.627713 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8cd61ea-ea6f-458c-aa69-a28b504d04f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:54.692567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e8cd61ea-ea6f-458c-aa69-a28b504d04f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:54.704456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e8cd61ea-ea6f-458c-aa69-a28b504d04f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.089359 Jul 27 22:56:54.705045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 589/1169] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:54 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:54.910825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5bdca465-763e-49ad-adf6-e19278efd598 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:54.912913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5bdca465-763e-49ad-adf6-e19278efd598 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:54.918869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bdca465-763e-49ad-adf6-e19278efd598 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:54.919309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bdca465-763e-49ad-adf6-e19278efd598 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:54.920047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bdca465-763e-49ad-adf6-e19278efd598 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:54.920504 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bdca465-763e-49ad-adf6-e19278efd598 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:54.947523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5bdca465-763e-49ad-adf6-e19278efd598 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041089 Jul 27 22:56:54.948061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 581/1170] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:54 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:56:55.290401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ed5512eb-aa51-44c1-8d54-83838f141327 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:55.292608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ed5512eb-aa51-44c1-8d54-83838f141327 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:55.299114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed5512eb-aa51-44c1-8d54-83838f141327 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:55.299558 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed5512eb-aa51-44c1-8d54-83838f141327 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:55.300305 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed5512eb-aa51-44c1-8d54-83838f141327 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:55.300783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed5512eb-aa51-44c1-8d54-83838f141327 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:55.328177 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ed5512eb-aa51-44c1-8d54-83838f141327 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041782 Jul 27 22:56:55.328757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 590/1171] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:55 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:55.622911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dfebcc94-7813-4145-97c4-7a96f322b5fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:55.624992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dfebcc94-7813-4145-97c4-7a96f322b5fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:55.632270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfebcc94-7813-4145-97c4-7a96f322b5fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:55.633091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfebcc94-7813-4145-97c4-7a96f322b5fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:55.634564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfebcc94-7813-4145-97c4-7a96f322b5fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:55.635368 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfebcc94-7813-4145-97c4-7a96f322b5fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:55.669621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dfebcc94-7813-4145-97c4-7a96f322b5fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050689 Jul 27 22:56:55.670175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 582/1172] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:55 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:55.724501 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ebe4c1df-0e44-4176-b0a5-7a63b305520b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:55.725130 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ebe4c1df-0e44-4176-b0a5-7a63b305520b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:55.731703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebe4c1df-0e44-4176-b0a5-7a63b305520b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:55.732137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebe4c1df-0e44-4176-b0a5-7a63b305520b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:55.732911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebe4c1df-0e44-4176-b0a5-7a63b305520b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:55.733332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebe4c1df-0e44-4176-b0a5-7a63b305520b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:55.792576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ebe4c1df-0e44-4176-b0a5-7a63b305520b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:55.799832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ebe4c1df-0e44-4176-b0a5-7a63b305520b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079134 Jul 27 22:56:55.800379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 591/1173] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:55 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:55.960080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0c2acbe6-777b-4d28-9eb2-1c5110e124d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:55.962196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0c2acbe6-777b-4d28-9eb2-1c5110e124d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:55.964005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:55.969831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c2acbe6-777b-4d28-9eb2-1c5110e124d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:55.970267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c2acbe6-777b-4d28-9eb2-1c5110e124d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:55.971013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c2acbe6-777b-4d28-9eb2-1c5110e124d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:55.971436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c2acbe6-777b-4d28-9eb2-1c5110e124d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:56.000701 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0c2acbe6-777b-4d28-9eb2-1c5110e124d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Jul 27 22:56:56.001749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 583/1174] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:55 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:56.341786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-548ecb2b-b083-4135-a5b9-df2eec398170 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:56.344179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-548ecb2b-b083-4135-a5b9-df2eec398170 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:56.351794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-548ecb2b-b083-4135-a5b9-df2eec398170 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:56.352648 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-548ecb2b-b083-4135-a5b9-df2eec398170 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:56.353442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-548ecb2b-b083-4135-a5b9-df2eec398170 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:56.353874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-548ecb2b-b083-4135-a5b9-df2eec398170 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:56.386082 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-548ecb2b-b083-4135-a5b9-df2eec398170 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048548 Jul 27 22:56:56.386677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 592/1175] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:56.681435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-01cdb4c2-f254-4d10-8c70-483973666122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:56.683467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-01cdb4c2-f254-4d10-8c70-483973666122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:56.689988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01cdb4c2-f254-4d10-8c70-483973666122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:56.690436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01cdb4c2-f254-4d10-8c70-483973666122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:56.691187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01cdb4c2-f254-4d10-8c70-483973666122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:56.691616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01cdb4c2-f254-4d10-8c70-483973666122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:56.719079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-01cdb4c2-f254-4d10-8c70-483973666122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041667 Jul 27 22:56:56.719623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 584/1176] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:56 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:56.820975 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-45b59ac3-d136-485b-8121-23e2baf93815 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:56.821583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-45b59ac3-d136-485b-8121-23e2baf93815 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:56.827901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45b59ac3-d136-485b-8121-23e2baf93815 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:56.828338 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45b59ac3-d136-485b-8121-23e2baf93815 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:56.829119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45b59ac3-d136-485b-8121-23e2baf93815 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:56.829548 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45b59ac3-d136-485b-8121-23e2baf93815 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:56.890902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-45b59ac3-d136-485b-8121-23e2baf93815 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:56.898223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-45b59ac3-d136-485b-8121-23e2baf93815 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081126 Jul 27 22:56:56.898777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 593/1177] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:56 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:57.013474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-445ec4f4-ce1b-4cde-9ca6-5fd6a40d5ada tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:57.015572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-445ec4f4-ce1b-4cde-9ca6-5fd6a40d5ada tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:57.021529 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-445ec4f4-ce1b-4cde-9ca6-5fd6a40d5ada tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:57.021972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-445ec4f4-ce1b-4cde-9ca6-5fd6a40d5ada tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:57.022721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-445ec4f4-ce1b-4cde-9ca6-5fd6a40d5ada tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:57.023151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-445ec4f4-ce1b-4cde-9ca6-5fd6a40d5ada tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:57.051432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-445ec4f4-ce1b-4cde-9ca6-5fd6a40d5ada tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042038 Jul 27 22:56:57.051965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 585/1178] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:57 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:56:57.399366 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a90fd7c1-3b18-4b55-9f10-519bdd368bb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:57.401559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a90fd7c1-3b18-4b55-9f10-519bdd368bb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:57.408161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a90fd7c1-3b18-4b55-9f10-519bdd368bb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:57.408626 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a90fd7c1-3b18-4b55-9f10-519bdd368bb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:57.409374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a90fd7c1-3b18-4b55-9f10-519bdd368bb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:57.409829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a90fd7c1-3b18-4b55-9f10-519bdd368bb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:57.437695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a90fd7c1-3b18-4b55-9f10-519bdd368bb4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042291 Jul 27 22:56:57.438232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 594/1179] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:57 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:57.731099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-88bb1568-a360-4d98-933f-811d187da575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:57.733155 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-88bb1568-a360-4d98-933f-811d187da575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:57.739119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-88bb1568-a360-4d98-933f-811d187da575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:57.739554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-88bb1568-a360-4d98-933f-811d187da575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:57.740294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-88bb1568-a360-4d98-933f-811d187da575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:57.740756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-88bb1568-a360-4d98-933f-811d187da575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:57.769556 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-88bb1568-a360-4d98-933f-811d187da575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042691 Jul 27 22:56:57.770090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 586/1180] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:57 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:57.918918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bf7a1eb4-85e2-4a23-99e3-260679dde2a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:57.919526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bf7a1eb4-85e2-4a23-99e3-260679dde2a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:57.926455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf7a1eb4-85e2-4a23-99e3-260679dde2a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:57.926900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf7a1eb4-85e2-4a23-99e3-260679dde2a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:57.927652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf7a1eb4-85e2-4a23-99e3-260679dde2a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:57.928085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf7a1eb4-85e2-4a23-99e3-260679dde2a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:57.988351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bf7a1eb4-85e2-4a23-99e3-260679dde2a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:57.996647 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bf7a1eb4-85e2-4a23-99e3-260679dde2a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081403 Jul 27 22:56:57.997292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 595/1181] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:57 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:58.064073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-14e73a90-6a54-4736-87eb-09b0948b104f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:58.066214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-14e73a90-6a54-4736-87eb-09b0948b104f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:58.072085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14e73a90-6a54-4736-87eb-09b0948b104f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:58.072523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14e73a90-6a54-4736-87eb-09b0948b104f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:58.073295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14e73a90-6a54-4736-87eb-09b0948b104f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:58.073721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14e73a90-6a54-4736-87eb-09b0948b104f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:58.100902 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-14e73a90-6a54-4736-87eb-09b0948b104f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041281 Jul 27 22:56:58.101433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 587/1182] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:58 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:58.449977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dfc0c53c-2ad2-44fb-bef5-d71c8701b298 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:58.452163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dfc0c53c-2ad2-44fb-bef5-d71c8701b298 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:58.458175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfc0c53c-2ad2-44fb-bef5-d71c8701b298 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:58.458616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfc0c53c-2ad2-44fb-bef5-d71c8701b298 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:58.459372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfc0c53c-2ad2-44fb-bef5-d71c8701b298 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:58.459802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfc0c53c-2ad2-44fb-bef5-d71c8701b298 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:58.489094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dfc0c53c-2ad2-44fb-bef5-d71c8701b298 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043082 Jul 27 22:56:58.489638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 596/1183] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:58.782371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ff68bb45-1f1c-4bab-af1d-2b1bec75a6ea tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:58.784424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ff68bb45-1f1c-4bab-af1d-2b1bec75a6ea tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:58.790388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff68bb45-1f1c-4bab-af1d-2b1bec75a6ea tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:58.790829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff68bb45-1f1c-4bab-af1d-2b1bec75a6ea tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:58.791572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff68bb45-1f1c-4bab-af1d-2b1bec75a6ea tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:58.791998 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff68bb45-1f1c-4bab-af1d-2b1bec75a6ea tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:58.819278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ff68bb45-1f1c-4bab-af1d-2b1bec75a6ea tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041534 Jul 27 22:56:58.819810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 588/1184] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:58 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:59.023646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-534c42bb-e5a5-434d-b300-b1466a45b5dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:59.024252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-534c42bb-e5a5-434d-b300-b1466a45b5dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:59.030908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-534c42bb-e5a5-434d-b300-b1466a45b5dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:59.031347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-534c42bb-e5a5-434d-b300-b1466a45b5dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:59.032139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-534c42bb-e5a5-434d-b300-b1466a45b5dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:59.032673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-534c42bb-e5a5-434d-b300-b1466a45b5dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:59.095507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-534c42bb-e5a5-434d-b300-b1466a45b5dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:56:59.103192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-534c42bb-e5a5-434d-b300-b1466a45b5dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083438 Jul 27 22:56:59.103780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 597/1185] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:56:59 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:56:59.113368 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-89cd48e1-0ab3-4400-bcbb-f05e4cd14774 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:59.115502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-89cd48e1-0ab3-4400-bcbb-f05e4cd14774 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:59.121417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-89cd48e1-0ab3-4400-bcbb-f05e4cd14774 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:59.121858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-89cd48e1-0ab3-4400-bcbb-f05e4cd14774 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:59.122601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-89cd48e1-0ab3-4400-bcbb-f05e4cd14774 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:59.123025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-89cd48e1-0ab3-4400-bcbb-f05e4cd14774 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:59.151798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-89cd48e1-0ab3-4400-bcbb-f05e4cd14774 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042328 Jul 27 22:56:59.152361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 589/1186] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:59 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:56:59.501783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7a110177-d1a0-4d18-b9d1-79b9de01c191 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:59.503923 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7a110177-d1a0-4d18-b9d1-79b9de01c191 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:59.505783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:59.510914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a110177-d1a0-4d18-b9d1-79b9de01c191 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:59.511354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a110177-d1a0-4d18-b9d1-79b9de01c191 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:59.512102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a110177-d1a0-4d18-b9d1-79b9de01c191 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:59.512527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a110177-d1a0-4d18-b9d1-79b9de01c191 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:59.539944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7a110177-d1a0-4d18-b9d1-79b9de01c191 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042791 Jul 27 22:56:59.540480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 598/1187] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:56:59 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:56:59.831072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3fa173da-cd66-4e9f-b2df-b9127579032a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:56:59.833215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3fa173da-cd66-4e9f-b2df-b9127579032a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:56:59.839169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3fa173da-cd66-4e9f-b2df-b9127579032a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:59.839608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3fa173da-cd66-4e9f-b2df-b9127579032a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:59.840363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3fa173da-cd66-4e9f-b2df-b9127579032a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:56:59.840821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3fa173da-cd66-4e9f-b2df-b9127579032a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:56:59.869754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3fa173da-cd66-4e9f-b2df-b9127579032a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042629 Jul 27 22:56:59.870294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 590/1188] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:56:59 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:00.123218 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6063f4c9-fc66-4902-9d5c-cebb0695fc53 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:00.123749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6063f4c9-fc66-4902-9d5c-cebb0695fc53 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:00.130175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6063f4c9-fc66-4902-9d5c-cebb0695fc53 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:00.130623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6063f4c9-fc66-4902-9d5c-cebb0695fc53 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:00.131381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6063f4c9-fc66-4902-9d5c-cebb0695fc53 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:00.131819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6063f4c9-fc66-4902-9d5c-cebb0695fc53 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:00.163494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ca781000-6992-4024-8d69-949ddc96b290 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:00.165670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ca781000-6992-4024-8d69-949ddc96b290 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:00.171796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ca781000-6992-4024-8d69-949ddc96b290 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:00.172242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ca781000-6992-4024-8d69-949ddc96b290 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:00.173029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ca781000-6992-4024-8d69-949ddc96b290 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:00.173465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ca781000-6992-4024-8d69-949ddc96b290 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:00.192313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6063f4c9-fc66-4902-9d5c-cebb0695fc53 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:00.199792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6063f4c9-fc66-4902-9d5c-cebb0695fc53 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080492 Jul 27 22:57:00.200344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 599/1189] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:00 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:00.201659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ca781000-6992-4024-8d69-949ddc96b290 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042143 Jul 27 22:57:00.202211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 591/1190] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:00 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:00.552686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cef2c79d-c8eb-412e-8aab-819454cea5d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:00.554871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cef2c79d-c8eb-412e-8aab-819454cea5d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:00.560907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cef2c79d-c8eb-412e-8aab-819454cea5d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:00.561350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cef2c79d-c8eb-412e-8aab-819454cea5d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:00.562103 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cef2c79d-c8eb-412e-8aab-819454cea5d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:00.562556 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cef2c79d-c8eb-412e-8aab-819454cea5d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:00.589934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cef2c79d-c8eb-412e-8aab-819454cea5d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041243 Jul 27 22:57:00.590465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 600/1191] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:00 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:00.882197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d2c8b3db-c461-4131-bc82-0f4a9bb11e3d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:00.884223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d2c8b3db-c461-4131-bc82-0f4a9bb11e3d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:00.890202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2c8b3db-c461-4131-bc82-0f4a9bb11e3d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:00.890653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2c8b3db-c461-4131-bc82-0f4a9bb11e3d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:00.891397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2c8b3db-c461-4131-bc82-0f4a9bb11e3d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:00.891827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2c8b3db-c461-4131-bc82-0f4a9bb11e3d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:00.919133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d2c8b3db-c461-4131-bc82-0f4a9bb11e3d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040988 Jul 27 22:57:00.919665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 592/1192] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:00 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:01.214380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-04080ac1-ba08-47f3-aa06-a7103b2aa0cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:01.216598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-04080ac1-ba08-47f3-aa06-a7103b2aa0cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:01.220219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-789d6f0b-f0be-408a-a4a6-76e15d8b7d09 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:01.220843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-789d6f0b-f0be-408a-a4a6-76e15d8b7d09 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:01.223665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04080ac1-ba08-47f3-aa06-a7103b2aa0cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:01.224075 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04080ac1-ba08-47f3-aa06-a7103b2aa0cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:01.224864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04080ac1-ba08-47f3-aa06-a7103b2aa0cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:01.225297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04080ac1-ba08-47f3-aa06-a7103b2aa0cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:01.226656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-789d6f0b-f0be-408a-a4a6-76e15d8b7d09 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:01.227346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-789d6f0b-f0be-408a-a4a6-76e15d8b7d09 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:01.228275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-789d6f0b-f0be-408a-a4a6-76e15d8b7d09 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:01.228740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-789d6f0b-f0be-408a-a4a6-76e15d8b7d09 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:01.254056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-04080ac1-ba08-47f3-aa06-a7103b2aa0cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Jul 27 22:57:01.254616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 601/1193] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:01 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:01.291567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-789d6f0b-f0be-408a-a4a6-76e15d8b7d09 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:01.295000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:01.300393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-789d6f0b-f0be-408a-a4a6-76e15d8b7d09 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084371 Jul 27 22:57:01.300994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 593/1194] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:01 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:57:01.602954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4ef31cc9-72a8-4082-87a6-c23ac6258fcd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:01.605276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4ef31cc9-72a8-4082-87a6-c23ac6258fcd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:01.611952 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4ef31cc9-72a8-4082-87a6-c23ac6258fcd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:01.612394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4ef31cc9-72a8-4082-87a6-c23ac6258fcd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:01.613164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4ef31cc9-72a8-4082-87a6-c23ac6258fcd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:01.613593 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4ef31cc9-72a8-4082-87a6-c23ac6258fcd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:01.643572 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4ef31cc9-72a8-4082-87a6-c23ac6258fcd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044857 Jul 27 22:57:01.644117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 602/1195] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:01 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:01.932070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5a625205-2fb4-434b-9891-49d98a95367e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:01.934213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5a625205-2fb4-434b-9891-49d98a95367e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:01.940198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a625205-2fb4-434b-9891-49d98a95367e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:01.940684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a625205-2fb4-434b-9891-49d98a95367e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:01.941452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a625205-2fb4-434b-9891-49d98a95367e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:01.941884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a625205-2fb4-434b-9891-49d98a95367e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:01.970977 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5a625205-2fb4-434b-9891-49d98a95367e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 Jul 27 22:57:01.971522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 594/1196] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:01 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:02.266235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3558f69b-8cfa-4f0f-9eaa-0b1d2d996c8e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:02.268370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3558f69b-8cfa-4f0f-9eaa-0b1d2d996c8e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:02.274851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3558f69b-8cfa-4f0f-9eaa-0b1d2d996c8e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:02.275295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3558f69b-8cfa-4f0f-9eaa-0b1d2d996c8e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:02.276050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3558f69b-8cfa-4f0f-9eaa-0b1d2d996c8e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:02.276482 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3558f69b-8cfa-4f0f-9eaa-0b1d2d996c8e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:02.299981 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:02.305223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3558f69b-8cfa-4f0f-9eaa-0b1d2d996c8e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043634 Jul 27 22:57:02.305766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 603/1197] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:02 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:02.320631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9d3cb5cc-1a45-4821-8bdc-59c72db2b782 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:02.321263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9d3cb5cc-1a45-4821-8bdc-59c72db2b782 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:02.327222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d3cb5cc-1a45-4821-8bdc-59c72db2b782 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:02.327657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d3cb5cc-1a45-4821-8bdc-59c72db2b782 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:02.329079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d3cb5cc-1a45-4821-8bdc-59c72db2b782 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:02.329507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d3cb5cc-1a45-4821-8bdc-59c72db2b782 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:02.388846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9d3cb5cc-1a45-4821-8bdc-59c72db2b782 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:02.396356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9d3cb5cc-1a45-4821-8bdc-59c72db2b782 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079432 Jul 27 22:57:02.396946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 595/1198] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:02 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:02.656145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-24c84ecb-a9a1-40e4-9a19-56bb14fd19ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:02.658347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-24c84ecb-a9a1-40e4-9a19-56bb14fd19ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:02.664517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24c84ecb-a9a1-40e4-9a19-56bb14fd19ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:02.664991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24c84ecb-a9a1-40e4-9a19-56bb14fd19ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:02.665777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24c84ecb-a9a1-40e4-9a19-56bb14fd19ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:02.666212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24c84ecb-a9a1-40e4-9a19-56bb14fd19ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:02.695041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-24c84ecb-a9a1-40e4-9a19-56bb14fd19ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043151 Jul 27 22:57:02.695577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 604/1199] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:02 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:02.983539 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7a6e4c9f-2d92-4471-8bac-2156819b51ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:02.985631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7a6e4c9f-2d92-4471-8bac-2156819b51ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:02.991649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a6e4c9f-2d92-4471-8bac-2156819b51ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:02.992094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a6e4c9f-2d92-4471-8bac-2156819b51ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:02.992893 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a6e4c9f-2d92-4471-8bac-2156819b51ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:02.993327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a6e4c9f-2d92-4471-8bac-2156819b51ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:03.022993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7a6e4c9f-2d92-4471-8bac-2156819b51ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043481 Jul 27 22:57:03.023541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 596/1200] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:02 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:03.317512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-aba51eea-75ef-4494-9466-8317f1f5aace tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:03.319691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-aba51eea-75ef-4494-9466-8317f1f5aace tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:03.326230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aba51eea-75ef-4494-9466-8317f1f5aace tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:03.326672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aba51eea-75ef-4494-9466-8317f1f5aace tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:03.327428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aba51eea-75ef-4494-9466-8317f1f5aace tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:03.328351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aba51eea-75ef-4494-9466-8317f1f5aace tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:03.356562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-aba51eea-75ef-4494-9466-8317f1f5aace tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043133 Jul 27 22:57:03.357119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 605/1201] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:03 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:03.417054 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-65ca132a-4eb3-463f-8b80-7f1ee207a87b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:03.417656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-65ca132a-4eb3-463f-8b80-7f1ee207a87b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:03.423535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65ca132a-4eb3-463f-8b80-7f1ee207a87b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:03.423981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65ca132a-4eb3-463f-8b80-7f1ee207a87b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:03.424756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65ca132a-4eb3-463f-8b80-7f1ee207a87b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:03.425186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65ca132a-4eb3-463f-8b80-7f1ee207a87b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:03.487618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-65ca132a-4eb3-463f-8b80-7f1ee207a87b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:03.495051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-65ca132a-4eb3-463f-8b80-7f1ee207a87b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081915 Jul 27 22:57:03.495607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 597/1202] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:03 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:03.707684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f8bc6a59-7827-455f-97a2-1ed161b8788d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:03.709838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f8bc6a59-7827-455f-97a2-1ed161b8788d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:03.715798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f8bc6a59-7827-455f-97a2-1ed161b8788d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:03.716240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f8bc6a59-7827-455f-97a2-1ed161b8788d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:03.717017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f8bc6a59-7827-455f-97a2-1ed161b8788d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:03.717444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f8bc6a59-7827-455f-97a2-1ed161b8788d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:03.745245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f8bc6a59-7827-455f-97a2-1ed161b8788d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042080 Jul 27 22:57:03.745789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 606/1203] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:04.034428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-05082250-6370-4b18-a8b5-39c7d8476184 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:04.036523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-05082250-6370-4b18-a8b5-39c7d8476184 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:04.042579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05082250-6370-4b18-a8b5-39c7d8476184 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:04.043022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05082250-6370-4b18-a8b5-39c7d8476184 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:04.043774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05082250-6370-4b18-a8b5-39c7d8476184 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:04.044212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05082250-6370-4b18-a8b5-39c7d8476184 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:04.072954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-05082250-6370-4b18-a8b5-39c7d8476184 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042647 Jul 27 22:57:04.073486 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 598/1204] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:04 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:04.368863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b86c626b-e36c-4028-b5ae-64a9d350a9b1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:04.371038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b86c626b-e36c-4028-b5ae-64a9d350a9b1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:04.377520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b86c626b-e36c-4028-b5ae-64a9d350a9b1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:04.377965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b86c626b-e36c-4028-b5ae-64a9d350a9b1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:04.378724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b86c626b-e36c-4028-b5ae-64a9d350a9b1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:04.379154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b86c626b-e36c-4028-b5ae-64a9d350a9b1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:04.406894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b86c626b-e36c-4028-b5ae-64a9d350a9b1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041556 Jul 27 22:57:04.407436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 607/1205] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:04 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:04.514958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a4764557-bc78-4946-b2f0-f9abf55ea825 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:04.515597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a4764557-bc78-4946-b2f0-f9abf55ea825 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:04.521734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4764557-bc78-4946-b2f0-f9abf55ea825 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:04.522180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4764557-bc78-4946-b2f0-f9abf55ea825 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:04.522965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4764557-bc78-4946-b2f0-f9abf55ea825 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:04.523398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4764557-bc78-4946-b2f0-f9abf55ea825 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:04.583634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a4764557-bc78-4946-b2f0-f9abf55ea825 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:04.591091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a4764557-bc78-4946-b2f0-f9abf55ea825 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079921 Jul 27 22:57:04.591649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 599/1206] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:04 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:04.757586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-403dea16-1584-4a3b-952d-d3f444078e75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:04.759705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-403dea16-1584-4a3b-952d-d3f444078e75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:04.766198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-403dea16-1584-4a3b-952d-d3f444078e75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:04.766640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-403dea16-1584-4a3b-952d-d3f444078e75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:04.767407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-403dea16-1584-4a3b-952d-d3f444078e75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:04.767834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-403dea16-1584-4a3b-952d-d3f444078e75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:04.797209 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-403dea16-1584-4a3b-952d-d3f444078e75 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043669 Jul 27 22:57:04.797765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 608/1207] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:04 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:05.085254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3e037423-bb3b-4a9f-af56-eae3072b7f8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:05.087408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3e037423-bb3b-4a9f-af56-eae3072b7f8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:05.093372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e037423-bb3b-4a9f-af56-eae3072b7f8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:05.093813 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e037423-bb3b-4a9f-af56-eae3072b7f8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:05.094565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e037423-bb3b-4a9f-af56-eae3072b7f8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:05.094996 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e037423-bb3b-4a9f-af56-eae3072b7f8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:05.122713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3e037423-bb3b-4a9f-af56-eae3072b7f8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041475 Jul 27 22:57:05.123245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 600/1208] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:05 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:05.518018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a381987b-476f-46d1-9fde-9748c2fd0841 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:05.520295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a381987b-476f-46d1-9fde-9748c2fd0841 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:05.526268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a381987b-476f-46d1-9fde-9748c2fd0841 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:05.526707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a381987b-476f-46d1-9fde-9748c2fd0841 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:05.527453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a381987b-476f-46d1-9fde-9748c2fd0841 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:05.527880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a381987b-476f-46d1-9fde-9748c2fd0841 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:05.555627 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a381987b-476f-46d1-9fde-9748c2fd0841 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140484 Jul 27 22:57:05.556184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 609/1209] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:05 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:05.612173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-beb04187-d613-42f6-8366-85a0b2171b73 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:05.612813 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-beb04187-d613-42f6-8366-85a0b2171b73 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:05.618772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-beb04187-d613-42f6-8366-85a0b2171b73 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:05.619218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-beb04187-d613-42f6-8366-85a0b2171b73 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:05.619970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-beb04187-d613-42f6-8366-85a0b2171b73 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:05.620408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-beb04187-d613-42f6-8366-85a0b2171b73 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:05.679362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-beb04187-d613-42f6-8366-85a0b2171b73 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:05.686906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-beb04187-d613-42f6-8366-85a0b2171b73 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078610 Jul 27 22:57:05.687459 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 601/1210] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:05 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:05.809435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e1b2fc49-9d7a-43c3-9b15-e5f8d3310214 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:05.811578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e1b2fc49-9d7a-43c3-9b15-e5f8d3310214 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:05.818213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1b2fc49-9d7a-43c3-9b15-e5f8d3310214 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:05.818638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1b2fc49-9d7a-43c3-9b15-e5f8d3310214 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:05.819399 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1b2fc49-9d7a-43c3-9b15-e5f8d3310214 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:05.819834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1b2fc49-9d7a-43c3-9b15-e5f8d3310214 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:05.848189 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e1b2fc49-9d7a-43c3-9b15-e5f8d3310214 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042724 Jul 27 22:57:05.848773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 610/1211] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:05 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:06.135348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-75c663fb-ff96-4236-b01a-658340b2587f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:06.137605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-75c663fb-ff96-4236-b01a-658340b2587f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:06.143670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75c663fb-ff96-4236-b01a-658340b2587f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:06.144119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75c663fb-ff96-4236-b01a-658340b2587f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:06.144914 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75c663fb-ff96-4236-b01a-658340b2587f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:06.145353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75c663fb-ff96-4236-b01a-658340b2587f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:06.174193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-75c663fb-ff96-4236-b01a-658340b2587f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042779 Jul 27 22:57:06.174749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 602/1212] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:06 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:06.567775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-97f2b0e0-286d-4eb7-a683-577aa00343dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:06.569942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-97f2b0e0-286d-4eb7-a683-577aa00343dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:06.576338 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97f2b0e0-286d-4eb7-a683-577aa00343dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:06.576810 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97f2b0e0-286d-4eb7-a683-577aa00343dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:06.577560 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97f2b0e0-286d-4eb7-a683-577aa00343dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:06.578588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97f2b0e0-286d-4eb7-a683-577aa00343dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:06.606154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-97f2b0e0-286d-4eb7-a683-577aa00343dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042343 Jul 27 22:57:06.606684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 611/1213] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:06 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:06.707829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-73ee270b-5939-4966-9119-003fa36a475c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:06.708426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-73ee270b-5939-4966-9119-003fa36a475c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:06.714377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73ee270b-5939-4966-9119-003fa36a475c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:06.714815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73ee270b-5939-4966-9119-003fa36a475c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:06.715560 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73ee270b-5939-4966-9119-003fa36a475c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:06.715986 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73ee270b-5939-4966-9119-003fa36a475c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:06.780331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-73ee270b-5939-4966-9119-003fa36a475c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:06.788124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-73ee270b-5939-4966-9119-003fa36a475c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084110 Jul 27 22:57:06.788709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 603/1214] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:06 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:06.861073 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8f0927f6-7872-4fcb-8f91-0f0fc0c775ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:06.863221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8f0927f6-7872-4fcb-8f91-0f0fc0c775ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:06.869257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f0927f6-7872-4fcb-8f91-0f0fc0c775ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:06.869703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f0927f6-7872-4fcb-8f91-0f0fc0c775ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:06.870489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f0927f6-7872-4fcb-8f91-0f0fc0c775ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:06.870922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f0927f6-7872-4fcb-8f91-0f0fc0c775ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:06.898947 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8f0927f6-7872-4fcb-8f91-0f0fc0c775ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042326 Jul 27 22:57:06.899488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 612/1215] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:07.186548 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-383ca2cf-7c24-4a92-8730-c12df1b12cce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:07.189317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-383ca2cf-7c24-4a92-8730-c12df1b12cce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:07.195191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-383ca2cf-7c24-4a92-8730-c12df1b12cce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:07.195627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-383ca2cf-7c24-4a92-8730-c12df1b12cce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:07.196371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-383ca2cf-7c24-4a92-8730-c12df1b12cce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:07.196819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-383ca2cf-7c24-4a92-8730-c12df1b12cce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:07.224776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-383ca2cf-7c24-4a92-8730-c12df1b12cce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042211 Jul 27 22:57:07.225312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 604/1216] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:07 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:07.618984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1386dc92-b05f-48f7-b08e-9011c4b13706 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:07.621153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1386dc92-b05f-48f7-b08e-9011c4b13706 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:07.627567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1386dc92-b05f-48f7-b08e-9011c4b13706 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:07.628010 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1386dc92-b05f-48f7-b08e-9011c4b13706 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:07.628794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1386dc92-b05f-48f7-b08e-9011c4b13706 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:07.629222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1386dc92-b05f-48f7-b08e-9011c4b13706 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:07.658991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1386dc92-b05f-48f7-b08e-9011c4b13706 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Jul 27 22:57:07.659628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 613/1217] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:07 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:07.809105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6f7f8c0c-3485-40e7-ae3c-495b7a7d269d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:07.809703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6f7f8c0c-3485-40e7-ae3c-495b7a7d269d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:07.815581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f7f8c0c-3485-40e7-ae3c-495b7a7d269d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:07.816016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f7f8c0c-3485-40e7-ae3c-495b7a7d269d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:07.816862 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f7f8c0c-3485-40e7-ae3c-495b7a7d269d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:07.817226 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f7f8c0c-3485-40e7-ae3c-495b7a7d269d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:07.880051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6f7f8c0c-3485-40e7-ae3c-495b7a7d269d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:07.887593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6f7f8c0c-3485-40e7-ae3c-495b7a7d269d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082398 Jul 27 22:57:07.888152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 605/1218] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:07 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:07.911878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1f814747-aa69-4954-8ecd-2544047951d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:07.914053 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1f814747-aa69-4954-8ecd-2544047951d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:07.919932 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f814747-aa69-4954-8ecd-2544047951d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:07.920386 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f814747-aa69-4954-8ecd-2544047951d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:07.921186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f814747-aa69-4954-8ecd-2544047951d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:07.921616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f814747-aa69-4954-8ecd-2544047951d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:07.950440 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1f814747-aa69-4954-8ecd-2544047951d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042575 Jul 27 22:57:07.951007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 614/1219] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:07 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:08.236646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-aabc0d7c-4d92-4a45-9c55-86db99b32570 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:08.238820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-aabc0d7c-4d92-4a45-9c55-86db99b32570 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:08.244828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aabc0d7c-4d92-4a45-9c55-86db99b32570 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:08.245278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aabc0d7c-4d92-4a45-9c55-86db99b32570 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:08.246036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aabc0d7c-4d92-4a45-9c55-86db99b32570 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:08.246468 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aabc0d7c-4d92-4a45-9c55-86db99b32570 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:08.275782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-aabc0d7c-4d92-4a45-9c55-86db99b32570 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043139 Jul 27 22:57:08.276333 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 606/1220] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:08 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:08.671200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0398da79-dc21-4de8-9f5f-9e5ab1e5d911 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:08.673894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0398da79-dc21-4de8-9f5f-9e5ab1e5d911 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:08.680351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0398da79-dc21-4de8-9f5f-9e5ab1e5d911 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:08.680834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0398da79-dc21-4de8-9f5f-9e5ab1e5d911 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:08.681595 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0398da79-dc21-4de8-9f5f-9e5ab1e5d911 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:08.682029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0398da79-dc21-4de8-9f5f-9e5ab1e5d911 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:08.710130 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0398da79-dc21-4de8-9f5f-9e5ab1e5d911 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043474 Jul 27 22:57:08.710680 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 615/1221] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:08 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:08.909276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-365537b5-0373-42ad-9c6e-e27bc4cd1521 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:08.909874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-365537b5-0373-42ad-9c6e-e27bc4cd1521 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:08.915768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-365537b5-0373-42ad-9c6e-e27bc4cd1521 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:08.916206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-365537b5-0373-42ad-9c6e-e27bc4cd1521 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:08.916975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-365537b5-0373-42ad-9c6e-e27bc4cd1521 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:08.917399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-365537b5-0373-42ad-9c6e-e27bc4cd1521 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:08.963210 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fe953d0c-5ea4-4ab4-ba6b-4718f1e77d3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:08.965324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fe953d0c-5ea4-4ab4-ba6b-4718f1e77d3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:08.972795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fe953d0c-5ea4-4ab4-ba6b-4718f1e77d3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:08.973373 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fe953d0c-5ea4-4ab4-ba6b-4718f1e77d3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:08.974254 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fe953d0c-5ea4-4ab4-ba6b-4718f1e77d3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:08.974781 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fe953d0c-5ea4-4ab4-ba6b-4718f1e77d3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:09.006822 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fe953d0c-5ea4-4ab4-ba6b-4718f1e77d3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047568 Jul 27 22:57:09.007406 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 616/1222] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:08 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:57:09.173352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-365537b5-0373-42ad-9c6e-e27bc4cd1521 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:09.180836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-365537b5-0373-42ad-9c6e-e27bc4cd1521 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.276035 Jul 27 22:57:09.181385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 607/1223] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:08 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:09.288104 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-039c4941-abcd-4b8a-a1f8-1f3d59ef5f72 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:09.290313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-039c4941-abcd-4b8a-a1f8-1f3d59ef5f72 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:09.296303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-039c4941-abcd-4b8a-a1f8-1f3d59ef5f72 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:09.296788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-039c4941-abcd-4b8a-a1f8-1f3d59ef5f72 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:09.297547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-039c4941-abcd-4b8a-a1f8-1f3d59ef5f72 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:09.297981 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-039c4941-abcd-4b8a-a1f8-1f3d59ef5f72 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:09.325907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-039c4941-abcd-4b8a-a1f8-1f3d59ef5f72 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041687 Jul 27 22:57:09.326738 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 617/1224] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:09 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:09.722573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8e037630-f046-4fd5-af37-ee432f058799 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:09.724758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8e037630-f046-4fd5-af37-ee432f058799 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:09.730949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e037630-f046-4fd5-af37-ee432f058799 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:09.731399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e037630-f046-4fd5-af37-ee432f058799 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:09.732155 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e037630-f046-4fd5-af37-ee432f058799 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:09.732608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e037630-f046-4fd5-af37-ee432f058799 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:09.760202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8e037630-f046-4fd5-af37-ee432f058799 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041593 Jul 27 22:57:09.760766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 608/1225] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:09 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:10.019302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1d9f16c0-6213-4938-92b0-1603dad7f535 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:10.021611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1d9f16c0-6213-4938-92b0-1603dad7f535 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:10.027915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1d9f16c0-6213-4938-92b0-1603dad7f535 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:10.028358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1d9f16c0-6213-4938-92b0-1603dad7f535 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:10.029150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1d9f16c0-6213-4938-92b0-1603dad7f535 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:10.029579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1d9f16c0-6213-4938-92b0-1603dad7f535 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:10.058606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1d9f16c0-6213-4938-92b0-1603dad7f535 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043200 Jul 27 22:57:10.059162 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 618/1226] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:10 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:10.201222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-35955aa9-d3f2-4524-8323-68d3f9a00186 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:10.201974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-35955aa9-d3f2-4524-8323-68d3f9a00186 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:10.207978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35955aa9-d3f2-4524-8323-68d3f9a00186 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:10.208427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35955aa9-d3f2-4524-8323-68d3f9a00186 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:10.209305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35955aa9-d3f2-4524-8323-68d3f9a00186 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:10.209736 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35955aa9-d3f2-4524-8323-68d3f9a00186 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:10.269253 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-35955aa9-d3f2-4524-8323-68d3f9a00186 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:10.276764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-35955aa9-d3f2-4524-8323-68d3f9a00186 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079399 Jul 27 22:57:10.277320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 609/1227] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:10 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:10.338996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bfc07695-9d92-403c-ac39-6b60595f7f5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:10.341173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bfc07695-9d92-403c-ac39-6b60595f7f5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:10.347624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bfc07695-9d92-403c-ac39-6b60595f7f5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:10.348068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bfc07695-9d92-403c-ac39-6b60595f7f5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:10.348861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bfc07695-9d92-403c-ac39-6b60595f7f5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:10.349301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bfc07695-9d92-403c-ac39-6b60595f7f5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:10.377778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bfc07695-9d92-403c-ac39-6b60595f7f5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042691 Jul 27 22:57:10.378316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 619/1228] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:10 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:10.772410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a9f4387f-bf30-40ce-8a29-7e4a032f05a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:10.774588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a9f4387f-bf30-40ce-8a29-7e4a032f05a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:10.780527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9f4387f-bf30-40ce-8a29-7e4a032f05a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:10.781588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9f4387f-bf30-40ce-8a29-7e4a032f05a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:10.782343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9f4387f-bf30-40ce-8a29-7e4a032f05a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:10.782775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9f4387f-bf30-40ce-8a29-7e4a032f05a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:10.798774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:10.812200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a9f4387f-bf30-40ce-8a29-7e4a032f05a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043678 Jul 27 22:57:10.812780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 610/1229] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:10 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:11.071387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b3f0aaac-2729-4a44-9207-6af3eb16f60d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:11.073582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b3f0aaac-2729-4a44-9207-6af3eb16f60d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:11.080747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3f0aaac-2729-4a44-9207-6af3eb16f60d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:11.081220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3f0aaac-2729-4a44-9207-6af3eb16f60d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:11.081966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3f0aaac-2729-4a44-9207-6af3eb16f60d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:11.082392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3f0aaac-2729-4a44-9207-6af3eb16f60d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:11.098215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:11.111014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b3f0aaac-2729-4a44-9207-6af3eb16f60d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043626 Jul 27 22:57:11.111561 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 620/1230] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:11 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:11.297871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6326e893-488b-4bb1-844e-2772813d9619 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:11.298478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6326e893-488b-4bb1-844e-2772813d9619 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:11.304492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6326e893-488b-4bb1-844e-2772813d9619 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:11.304963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6326e893-488b-4bb1-844e-2772813d9619 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:11.305714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6326e893-488b-4bb1-844e-2772813d9619 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:11.306145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6326e893-488b-4bb1-844e-2772813d9619 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:11.367843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6326e893-488b-4bb1-844e-2772813d9619 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:11.378146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6326e893-488b-4bb1-844e-2772813d9619 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084157 Jul 27 22:57:11.378707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 611/1231] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:11 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:11.388949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fdf4e32d-7793-4cbf-900a-74aff4b01338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:11.391082 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fdf4e32d-7793-4cbf-900a-74aff4b01338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:11.397046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdf4e32d-7793-4cbf-900a-74aff4b01338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:11.397488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdf4e32d-7793-4cbf-900a-74aff4b01338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:11.398236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdf4e32d-7793-4cbf-900a-74aff4b01338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:11.398662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdf4e32d-7793-4cbf-900a-74aff4b01338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:11.426792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fdf4e32d-7793-4cbf-900a-74aff4b01338 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041796 Jul 27 22:57:11.427326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 621/1232] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:11 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:11.823959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a5d60ef6-4e0b-45cc-9fc9-f094a494ff1f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:11.826147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a5d60ef6-4e0b-45cc-9fc9-f094a494ff1f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:11.832102 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a5d60ef6-4e0b-45cc-9fc9-f094a494ff1f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:11.832563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a5d60ef6-4e0b-45cc-9fc9-f094a494ff1f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:11.833329 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a5d60ef6-4e0b-45cc-9fc9-f094a494ff1f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:11.833764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a5d60ef6-4e0b-45cc-9fc9-f094a494ff1f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:11.862384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a5d60ef6-4e0b-45cc-9fc9-f094a494ff1f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042392 Jul 27 22:57:11.862926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 612/1233] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:11 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:12.123478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ce427087-1f56-4790-934f-221c59ab881d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:12.125664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ce427087-1f56-4790-934f-221c59ab881d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:12.132210 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce427087-1f56-4790-934f-221c59ab881d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:12.132703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce427087-1f56-4790-934f-221c59ab881d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:12.133533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce427087-1f56-4790-934f-221c59ab881d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:12.133964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce427087-1f56-4790-934f-221c59ab881d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:12.164659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ce427087-1f56-4790-934f-221c59ab881d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045195 Jul 27 22:57:12.165230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 622/1234] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:12.399612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-68dacda0-51d3-4808-a88c-b8c3919362f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:12.400575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-68dacda0-51d3-4808-a88c-b8c3919362f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:12.408049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68dacda0-51d3-4808-a88c-b8c3919362f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:12.408491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68dacda0-51d3-4808-a88c-b8c3919362f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:12.409284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68dacda0-51d3-4808-a88c-b8c3919362f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:12.409715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68dacda0-51d3-4808-a88c-b8c3919362f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:12.439096 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8ee57fb2-bf4b-4675-a680-da124f75024d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:12.441268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8ee57fb2-bf4b-4675-a680-da124f75024d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:12.447318 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8ee57fb2-bf4b-4675-a680-da124f75024d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:12.447759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8ee57fb2-bf4b-4675-a680-da124f75024d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:12.448631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8ee57fb2-bf4b-4675-a680-da124f75024d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:12.449141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8ee57fb2-bf4b-4675-a680-da124f75024d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:12.482821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8ee57fb2-bf4b-4675-a680-da124f75024d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048000 Jul 27 22:57:12.483248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-68dacda0-51d3-4808-a88c-b8c3919362f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:12.483750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 623/1235] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:12 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:12.491177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-68dacda0-51d3-4808-a88c-b8c3919362f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.096328 Jul 27 22:57:12.491825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 613/1236] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:12 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:12.874911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-224d2ab4-6e5f-4d6f-a8c5-c4f8b60206c4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:12.877713 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-224d2ab4-6e5f-4d6f-a8c5-c4f8b60206c4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:12.883717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-224d2ab4-6e5f-4d6f-a8c5-c4f8b60206c4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:12.884166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-224d2ab4-6e5f-4d6f-a8c5-c4f8b60206c4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:12.884939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-224d2ab4-6e5f-4d6f-a8c5-c4f8b60206c4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:12.885369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-224d2ab4-6e5f-4d6f-a8c5-c4f8b60206c4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:12.912487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-224d2ab4-6e5f-4d6f-a8c5-c4f8b60206c4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041733 Jul 27 22:57:12.913069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 624/1237] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:12 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:13.177679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-56b614d5-5ab0-4d4f-9691-377cda56b155 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:13.179806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-56b614d5-5ab0-4d4f-9691-377cda56b155 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:13.185871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56b614d5-5ab0-4d4f-9691-377cda56b155 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:13.186313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56b614d5-5ab0-4d4f-9691-377cda56b155 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:13.187716 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56b614d5-5ab0-4d4f-9691-377cda56b155 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:13.188154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56b614d5-5ab0-4d4f-9691-377cda56b155 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:13.216511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-56b614d5-5ab0-4d4f-9691-377cda56b155 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042792 Jul 27 22:57:13.217086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 614/1238] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:13.495152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fa885242-a246-4fd9-ac54-a6226b1bc809 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:13.497248 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fa885242-a246-4fd9-ac54-a6226b1bc809 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:13.503834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa885242-a246-4fd9-ac54-a6226b1bc809 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:13.504274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa885242-a246-4fd9-ac54-a6226b1bc809 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:13.505061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa885242-a246-4fd9-ac54-a6226b1bc809 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:13.505490 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fa885242-a246-4fd9-ac54-a6226b1bc809 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:13.513695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-095e54e1-1a59-40ee-b245-fa7638c79d16 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:13.514334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-095e54e1-1a59-40ee-b245-fa7638c79d16 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:13.520307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-095e54e1-1a59-40ee-b245-fa7638c79d16 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:13.520964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-095e54e1-1a59-40ee-b245-fa7638c79d16 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:13.521724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-095e54e1-1a59-40ee-b245-fa7638c79d16 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:13.522158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-095e54e1-1a59-40ee-b245-fa7638c79d16 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:13.534422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fa885242-a246-4fd9-ac54-a6226b1bc809 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043247 Jul 27 22:57:13.534973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 625/1239] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:13 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:13.585091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-095e54e1-1a59-40ee-b245-fa7638c79d16 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:13.592396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-095e54e1-1a59-40ee-b245-fa7638c79d16 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082462 Jul 27 22:57:13.592983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 615/1240] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:13 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:57:13.923925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7d5a911b-8dbb-43a5-b0ee-a4efc4c97fda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:13.926137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7d5a911b-8dbb-43a5-b0ee-a4efc4c97fda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:13.932111 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7d5a911b-8dbb-43a5-b0ee-a4efc4c97fda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:13.932583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7d5a911b-8dbb-43a5-b0ee-a4efc4c97fda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:13.933343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7d5a911b-8dbb-43a5-b0ee-a4efc4c97fda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:13.933769 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7d5a911b-8dbb-43a5-b0ee-a4efc4c97fda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:13.962088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7d5a911b-8dbb-43a5-b0ee-a4efc4c97fda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042163 Jul 27 22:57:13.962623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 626/1241] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:13 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:14.229845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3853d1b8-8951-42dd-8a44-121681089866 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:14.231946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3853d1b8-8951-42dd-8a44-121681089866 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:14.238011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3853d1b8-8951-42dd-8a44-121681089866 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:14.238453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3853d1b8-8951-42dd-8a44-121681089866 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:14.239213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3853d1b8-8951-42dd-8a44-121681089866 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:14.239644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3853d1b8-8951-42dd-8a44-121681089866 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:14.268397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3853d1b8-8951-42dd-8a44-121681089866 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042892 Jul 27 22:57:14.268973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 616/1242] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:14 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:14.547170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e7556157-36d0-4872-99ad-eab56062527a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:14.549388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e7556157-36d0-4872-99ad-eab56062527a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:14.556355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e7556157-36d0-4872-99ad-eab56062527a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:14.556843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e7556157-36d0-4872-99ad-eab56062527a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:14.557618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e7556157-36d0-4872-99ad-eab56062527a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:14.558081 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e7556157-36d0-4872-99ad-eab56062527a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:14.589566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e7556157-36d0-4872-99ad-eab56062527a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046831 Jul 27 22:57:14.590313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 627/1243] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:14 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:14.614399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-96019a7a-27e8-43d4-b9c8-6e51abda6777 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:14.615030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-96019a7a-27e8-43d4-b9c8-6e51abda6777 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:14.620990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96019a7a-27e8-43d4-b9c8-6e51abda6777 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:14.621422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96019a7a-27e8-43d4-b9c8-6e51abda6777 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:14.622170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96019a7a-27e8-43d4-b9c8-6e51abda6777 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:14.622593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96019a7a-27e8-43d4-b9c8-6e51abda6777 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:14.687040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-96019a7a-27e8-43d4-b9c8-6e51abda6777 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:14.695200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-96019a7a-27e8-43d4-b9c8-6e51abda6777 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084602 Jul 27 22:57:14.695758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 617/1244] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:14 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:14.974421 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5b3b76ae-0b71-4b97-9c63-0d1ec7b7cff6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:14.976606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5b3b76ae-0b71-4b97-9c63-0d1ec7b7cff6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:14.982876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b3b76ae-0b71-4b97-9c63-0d1ec7b7cff6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:14.983316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b3b76ae-0b71-4b97-9c63-0d1ec7b7cff6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:14.984077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b3b76ae-0b71-4b97-9c63-0d1ec7b7cff6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:14.984514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b3b76ae-0b71-4b97-9c63-0d1ec7b7cff6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:15.012536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5b3b76ae-0b71-4b97-9c63-0d1ec7b7cff6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042061 Jul 27 22:57:15.013105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 628/1245] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:14 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:15.280492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a076f8d3-c3a5-4f2c-8ed4-591ade12dd1e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:15.282658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a076f8d3-c3a5-4f2c-8ed4-591ade12dd1e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:15.288678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a076f8d3-c3a5-4f2c-8ed4-591ade12dd1e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:15.289118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a076f8d3-c3a5-4f2c-8ed4-591ade12dd1e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:15.289857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a076f8d3-c3a5-4f2c-8ed4-591ade12dd1e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:15.290281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a076f8d3-c3a5-4f2c-8ed4-591ade12dd1e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:15.319102 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a076f8d3-c3a5-4f2c-8ed4-591ade12dd1e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042617 Jul 27 22:57:15.319635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 618/1246] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:15 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:15.601736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-71a4ee8c-70ab-4a26-9d52-cf2b45c46c70 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:15.604146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-71a4ee8c-70ab-4a26-9d52-cf2b45c46c70 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:15.610632 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-71a4ee8c-70ab-4a26-9d52-cf2b45c46c70 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:15.611083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-71a4ee8c-70ab-4a26-9d52-cf2b45c46c70 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:15.611844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-71a4ee8c-70ab-4a26-9d52-cf2b45c46c70 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:15.612279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-71a4ee8c-70ab-4a26-9d52-cf2b45c46c70 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:15.641368 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-71a4ee8c-70ab-4a26-9d52-cf2b45c46c70 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042949 Jul 27 22:57:15.641911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 629/1247] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:15.716535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b638b04b-95ce-4925-b95a-c719e25ea56e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:15.717166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b638b04b-95ce-4925-b95a-c719e25ea56e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:15.723854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b638b04b-95ce-4925-b95a-c719e25ea56e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:15.724291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b638b04b-95ce-4925-b95a-c719e25ea56e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:15.725084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b638b04b-95ce-4925-b95a-c719e25ea56e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:15.725511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b638b04b-95ce-4925-b95a-c719e25ea56e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:15.785128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b638b04b-95ce-4925-b95a-c719e25ea56e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:15.792402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b638b04b-95ce-4925-b95a-c719e25ea56e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079680 Jul 27 22:57:15.792987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 619/1248] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:15 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:16.024545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c3c4dea8-99a0-4824-b52e-d2b9db16349e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:16.026694 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c3c4dea8-99a0-4824-b52e-d2b9db16349e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:16.032744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3c4dea8-99a0-4824-b52e-d2b9db16349e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:16.033197 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3c4dea8-99a0-4824-b52e-d2b9db16349e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:16.033961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3c4dea8-99a0-4824-b52e-d2b9db16349e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:16.034401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3c4dea8-99a0-4824-b52e-d2b9db16349e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:16.064380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c3c4dea8-99a0-4824-b52e-d2b9db16349e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 Jul 27 22:57:16.064968 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 630/1249] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:16 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:16.331331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5b338cbb-325c-4271-b2cb-53986d933604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:16.333477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5b338cbb-325c-4271-b2cb-53986d933604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:16.339421 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b338cbb-325c-4271-b2cb-53986d933604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:16.339862 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b338cbb-325c-4271-b2cb-53986d933604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:16.340650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b338cbb-325c-4271-b2cb-53986d933604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:16.341085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b338cbb-325c-4271-b2cb-53986d933604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:16.370084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5b338cbb-325c-4271-b2cb-53986d933604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042702 Jul 27 22:57:16.370620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 620/1250] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:16 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:16.652901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ea1bc155-9b16-4051-973e-3fcd9eff38bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:16.654953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ea1bc155-9b16-4051-973e-3fcd9eff38bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:16.661995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ea1bc155-9b16-4051-973e-3fcd9eff38bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:16.662433 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ea1bc155-9b16-4051-973e-3fcd9eff38bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:16.663211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ea1bc155-9b16-4051-973e-3fcd9eff38bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:16.663638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ea1bc155-9b16-4051-973e-3fcd9eff38bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:16.691172 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ea1bc155-9b16-4051-973e-3fcd9eff38bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042354 Jul 27 22:57:16.691699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 631/1251] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:16 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:16.812851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-456efef8-daef-436e-be93-1e644c820509 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:16.813489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-456efef8-daef-436e-be93-1e644c820509 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:16.821865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-456efef8-daef-436e-be93-1e644c820509 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:16.822306 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-456efef8-daef-436e-be93-1e644c820509 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:16.823068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-456efef8-daef-436e-be93-1e644c820509 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:16.823499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-456efef8-daef-436e-be93-1e644c820509 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:16.884298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-456efef8-daef-436e-be93-1e644c820509 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:16.892186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-456efef8-daef-436e-be93-1e644c820509 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083232 Jul 27 22:57:16.892761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 621/1252] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:16 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:17.076644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3d6a3565-2e09-467a-93b0-178f62d350c7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:17.079438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3d6a3565-2e09-467a-93b0-178f62d350c7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:17.085498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d6a3565-2e09-467a-93b0-178f62d350c7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:17.085948 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d6a3565-2e09-467a-93b0-178f62d350c7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:17.086708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d6a3565-2e09-467a-93b0-178f62d350c7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:17.087143 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d6a3565-2e09-467a-93b0-178f62d350c7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:17.114729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3d6a3565-2e09-467a-93b0-178f62d350c7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042085 Jul 27 22:57:17.115261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 632/1253] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:17 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:17.382594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2e231402-a2bf-432f-8d36-c1fb296417e5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:17.384652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2e231402-a2bf-432f-8d36-c1fb296417e5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:17.390530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e231402-a2bf-432f-8d36-c1fb296417e5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:17.391000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e231402-a2bf-432f-8d36-c1fb296417e5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:17.391740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e231402-a2bf-432f-8d36-c1fb296417e5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:17.392161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e231402-a2bf-432f-8d36-c1fb296417e5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:17.419584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2e231402-a2bf-432f-8d36-c1fb296417e5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041024 Jul 27 22:57:17.420114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 622/1254] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:17 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:17.703280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-79f5d97a-1bda-4c7f-9150-3b55de56193d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:17.705538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-79f5d97a-1bda-4c7f-9150-3b55de56193d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:17.711935 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-79f5d97a-1bda-4c7f-9150-3b55de56193d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:17.712389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-79f5d97a-1bda-4c7f-9150-3b55de56193d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:17.713198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-79f5d97a-1bda-4c7f-9150-3b55de56193d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:17.713635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-79f5d97a-1bda-4c7f-9150-3b55de56193d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:17.742956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-79f5d97a-1bda-4c7f-9150-3b55de56193d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Jul 27 22:57:17.743498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 633/1255] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:17 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:17.912111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-50785709-bd38-437e-87de-991fd7d1a455 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:17.912676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-50785709-bd38-437e-87de-991fd7d1a455 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:17.918631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-50785709-bd38-437e-87de-991fd7d1a455 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:17.919077 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-50785709-bd38-437e-87de-991fd7d1a455 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:17.919838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-50785709-bd38-437e-87de-991fd7d1a455 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:17.920271 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-50785709-bd38-437e-87de-991fd7d1a455 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:17.982022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-50785709-bd38-437e-87de-991fd7d1a455 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:17.990119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-50785709-bd38-437e-87de-991fd7d1a455 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081909 Jul 27 22:57:17.990680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 623/1256] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:17 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:18.126711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a2a9f74c-d281-4e88-9dce-6e9ca75ecdf5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:18.129014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a2a9f74c-d281-4e88-9dce-6e9ca75ecdf5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:18.135027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a2a9f74c-d281-4e88-9dce-6e9ca75ecdf5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:18.135466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a2a9f74c-d281-4e88-9dce-6e9ca75ecdf5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:18.136221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a2a9f74c-d281-4e88-9dce-6e9ca75ecdf5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:18.136681 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a2a9f74c-d281-4e88-9dce-6e9ca75ecdf5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:18.165733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a2a9f74c-d281-4e88-9dce-6e9ca75ecdf5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042825 Jul 27 22:57:18.166227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 634/1257] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:18 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:18.432305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0bbe33b8-2502-47a5-ba05-120ff3f08d3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:18.434364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0bbe33b8-2502-47a5-ba05-120ff3f08d3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:18.440965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0bbe33b8-2502-47a5-ba05-120ff3f08d3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:18.441400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0bbe33b8-2502-47a5-ba05-120ff3f08d3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:18.442145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0bbe33b8-2502-47a5-ba05-120ff3f08d3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:18.442573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0bbe33b8-2502-47a5-ba05-120ff3f08d3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:18.471032 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0bbe33b8-2502-47a5-ba05-120ff3f08d3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042775 Jul 27 22:57:18.471568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 624/1258] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:18.754954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0ed37c29-4cfb-47f4-ae8c-70c538d55c3b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:18.757102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0ed37c29-4cfb-47f4-ae8c-70c538d55c3b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:18.763061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ed37c29-4cfb-47f4-ae8c-70c538d55c3b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:18.763503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ed37c29-4cfb-47f4-ae8c-70c538d55c3b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:18.764251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ed37c29-4cfb-47f4-ae8c-70c538d55c3b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:18.764706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ed37c29-4cfb-47f4-ae8c-70c538d55c3b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:18.792655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0ed37c29-4cfb-47f4-ae8c-70c538d55c3b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041910 Jul 27 22:57:18.793186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 635/1259] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:18 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:19.011020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3f4fdd00-77a3-4d99-a2a8-ef9770afd523 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:19.011546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3f4fdd00-77a3-4d99-a2a8-ef9770afd523 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:19.018223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f4fdd00-77a3-4d99-a2a8-ef9770afd523 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:19.018665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f4fdd00-77a3-4d99-a2a8-ef9770afd523 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:19.019423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f4fdd00-77a3-4d99-a2a8-ef9770afd523 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:19.019857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f4fdd00-77a3-4d99-a2a8-ef9770afd523 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:19.084643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3f4fdd00-77a3-4d99-a2a8-ef9770afd523 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:19.091920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3f4fdd00-77a3-4d99-a2a8-ef9770afd523 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084811 Jul 27 22:57:19.092511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 625/1260] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:19 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:19.177641 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4a1a81ee-a1db-4a86-a8d5-15adbc18f7d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:19.179792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4a1a81ee-a1db-4a86-a8d5-15adbc18f7d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:19.185852 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4a1a81ee-a1db-4a86-a8d5-15adbc18f7d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:19.186300 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4a1a81ee-a1db-4a86-a8d5-15adbc18f7d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:19.187064 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4a1a81ee-a1db-4a86-a8d5-15adbc18f7d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:19.187511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4a1a81ee-a1db-4a86-a8d5-15adbc18f7d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:19.216018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4a1a81ee-a1db-4a86-a8d5-15adbc18f7d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042357 Jul 27 22:57:19.216636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 636/1261] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:19 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:19.483009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5ae79c20-de4b-4f2a-aedb-15cc3aa7b9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:19.485177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5ae79c20-de4b-4f2a-aedb-15cc3aa7b9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:19.491093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ae79c20-de4b-4f2a-aedb-15cc3aa7b9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:19.491527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ae79c20-de4b-4f2a-aedb-15cc3aa7b9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:19.492305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ae79c20-de4b-4f2a-aedb-15cc3aa7b9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:19.492770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ae79c20-de4b-4f2a-aedb-15cc3aa7b9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:19.521577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5ae79c20-de4b-4f2a-aedb-15cc3aa7b9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042647 Jul 27 22:57:19.522111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 626/1262] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:19 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:19.805157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-93a0ab00-a6eb-4452-be8a-6a0687eeefc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:19.807322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-93a0ab00-a6eb-4452-be8a-6a0687eeefc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:19.813845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-93a0ab00-a6eb-4452-be8a-6a0687eeefc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:19.814847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-93a0ab00-a6eb-4452-be8a-6a0687eeefc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:19.815605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-93a0ab00-a6eb-4452-be8a-6a0687eeefc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:19.816031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-93a0ab00-a6eb-4452-be8a-6a0687eeefc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:19.819603 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:19.844216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-93a0ab00-a6eb-4452-be8a-6a0687eeefc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042985 Jul 27 22:57:19.844782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 637/1263] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:19 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:20.113997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5a747fb4-17b2-48cf-9d87-eca3f7f03375 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:20.114606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5a747fb4-17b2-48cf-9d87-eca3f7f03375 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:20.120518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a747fb4-17b2-48cf-9d87-eca3f7f03375 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:20.120986 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a747fb4-17b2-48cf-9d87-eca3f7f03375 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:20.121735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a747fb4-17b2-48cf-9d87-eca3f7f03375 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:20.122165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a747fb4-17b2-48cf-9d87-eca3f7f03375 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:20.126053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:20.183580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5a747fb4-17b2-48cf-9d87-eca3f7f03375 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:20.191079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5a747fb4-17b2-48cf-9d87-eca3f7f03375 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081635 Jul 27 22:57:20.191638 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 627/1264] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:20 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:20.228219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4fd8f7ac-1b83-454e-80d7-9ccbded0499e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:20.230379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4fd8f7ac-1b83-454e-80d7-9ccbded0499e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:20.236984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4fd8f7ac-1b83-454e-80d7-9ccbded0499e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:20.237426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4fd8f7ac-1b83-454e-80d7-9ccbded0499e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:20.238172 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4fd8f7ac-1b83-454e-80d7-9ccbded0499e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:20.238599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4fd8f7ac-1b83-454e-80d7-9ccbded0499e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:20.266233 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4fd8f7ac-1b83-454e-80d7-9ccbded0499e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042192 Jul 27 22:57:20.266770 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 638/1265] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:20 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:20.534108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e0bf82cb-7776-48ae-b391-9fdbc6bad500 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:20.536153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e0bf82cb-7776-48ae-b391-9fdbc6bad500 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:20.542234 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e0bf82cb-7776-48ae-b391-9fdbc6bad500 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:20.542682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e0bf82cb-7776-48ae-b391-9fdbc6bad500 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:20.543442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e0bf82cb-7776-48ae-b391-9fdbc6bad500 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:20.543875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e0bf82cb-7776-48ae-b391-9fdbc6bad500 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:20.571472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e0bf82cb-7776-48ae-b391-9fdbc6bad500 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042034 Jul 27 22:57:20.572018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 628/1266] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:20.856606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-01826e10-b09c-4524-a539-1a19925b30d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:20.858797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-01826e10-b09c-4524-a539-1a19925b30d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:20.865314 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01826e10-b09c-4524-a539-1a19925b30d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:20.865766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01826e10-b09c-4524-a539-1a19925b30d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:20.866532 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01826e10-b09c-4524-a539-1a19925b30d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:20.866970 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01826e10-b09c-4524-a539-1a19925b30d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:20.895886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-01826e10-b09c-4524-a539-1a19925b30d5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043506 Jul 27 22:57:20.896427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 639/1267] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:20 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:21.211563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-27306cff-627e-4ed3-8b35-6549916db1a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:21.212168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-27306cff-627e-4ed3-8b35-6549916db1a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:21.218153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-27306cff-627e-4ed3-8b35-6549916db1a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:21.218596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-27306cff-627e-4ed3-8b35-6549916db1a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:21.219342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-27306cff-627e-4ed3-8b35-6549916db1a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:21.219768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-27306cff-627e-4ed3-8b35-6549916db1a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:21.278343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8912de58-e4c3-41c8-9742-be1d4da6c2c8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:21.279368 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-27306cff-627e-4ed3-8b35-6549916db1a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:21.280510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8912de58-e4c3-41c8-9742-be1d4da6c2c8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:21.286646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8912de58-e4c3-41c8-9742-be1d4da6c2c8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:21.287039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-27306cff-627e-4ed3-8b35-6549916db1a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079315 Jul 27 22:57:21.287184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8912de58-e4c3-41c8-9742-be1d4da6c2c8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:21.287599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 629/1268] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:21 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:21.287882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8912de58-e4c3-41c8-9742-be1d4da6c2c8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:21.288317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8912de58-e4c3-41c8-9742-be1d4da6c2c8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:21.317404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8912de58-e4c3-41c8-9742-be1d4da6c2c8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043055 Jul 27 22:57:21.317952 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 640/1269] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:21 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:21.583569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8f34ca0c-d6f6-40a0-b786-86bcd35e19c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:21.585752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8f34ca0c-d6f6-40a0-b786-86bcd35e19c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:21.591672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f34ca0c-d6f6-40a0-b786-86bcd35e19c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:21.592115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f34ca0c-d6f6-40a0-b786-86bcd35e19c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:21.592899 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f34ca0c-d6f6-40a0-b786-86bcd35e19c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:21.593330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f34ca0c-d6f6-40a0-b786-86bcd35e19c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:21.622290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8f34ca0c-d6f6-40a0-b786-86bcd35e19c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043216 Jul 27 22:57:21.622852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 630/1270] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:21 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:21.907446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cd14277a-8e85-4ab9-ac97-f006d6ce1bc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:21.909651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cd14277a-8e85-4ab9-ac97-f006d6ce1bc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:21.916005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd14277a-8e85-4ab9-ac97-f006d6ce1bc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:21.916445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd14277a-8e85-4ab9-ac97-f006d6ce1bc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:21.917224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd14277a-8e85-4ab9-ac97-f006d6ce1bc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:21.917653 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd14277a-8e85-4ab9-ac97-f006d6ce1bc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:21.946269 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cd14277a-8e85-4ab9-ac97-f006d6ce1bc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042842 Jul 27 22:57:21.946803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 641/1271] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:21 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:22.308262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-52ea7bd2-1c17-4935-8d9f-f2901501ce6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:22.308899 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-52ea7bd2-1c17-4935-8d9f-f2901501ce6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:22.314909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52ea7bd2-1c17-4935-8d9f-f2901501ce6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:22.315349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52ea7bd2-1c17-4935-8d9f-f2901501ce6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:22.316098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52ea7bd2-1c17-4935-8d9f-f2901501ce6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:22.316528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52ea7bd2-1c17-4935-8d9f-f2901501ce6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:22.329334 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fb2688da-c8ea-4a5d-bab5-5876e5baf081 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:22.331491 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fb2688da-c8ea-4a5d-bab5-5876e5baf081 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:22.337477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb2688da-c8ea-4a5d-bab5-5876e5baf081 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:22.337882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb2688da-c8ea-4a5d-bab5-5876e5baf081 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:22.338639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb2688da-c8ea-4a5d-bab5-5876e5baf081 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:22.339067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb2688da-c8ea-4a5d-bab5-5876e5baf081 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:22.368744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fb2688da-c8ea-4a5d-bab5-5876e5baf081 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043193 Jul 27 22:57:22.369306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 642/1272] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:22 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:22.378808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-52ea7bd2-1c17-4935-8d9f-f2901501ce6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:22.386346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-52ea7bd2-1c17-4935-8d9f-f2901501ce6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081944 Jul 27 22:57:22.386900 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 631/1273] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:22 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:22.635170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1ce5b984-0a1e-49a5-a1bb-62d6a1ce1c6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:22.637311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1ce5b984-0a1e-49a5-a1bb-62d6a1ce1c6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:22.643290 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ce5b984-0a1e-49a5-a1bb-62d6a1ce1c6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:22.643736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ce5b984-0a1e-49a5-a1bb-62d6a1ce1c6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:22.644488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ce5b984-0a1e-49a5-a1bb-62d6a1ce1c6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:22.644943 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ce5b984-0a1e-49a5-a1bb-62d6a1ce1c6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:22.672442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1ce5b984-0a1e-49a5-a1bb-62d6a1ce1c6c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041351 Jul 27 22:57:22.673077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 643/1274] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:22 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:22.958855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-304d871a-c34a-4d5c-97cb-92cb5c10efa8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:22.960990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-304d871a-c34a-4d5c-97cb-92cb5c10efa8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:22.967091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-304d871a-c34a-4d5c-97cb-92cb5c10efa8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:22.967534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-304d871a-c34a-4d5c-97cb-92cb5c10efa8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:22.968285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-304d871a-c34a-4d5c-97cb-92cb5c10efa8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:22.968762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-304d871a-c34a-4d5c-97cb-92cb5c10efa8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:22.996461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-304d871a-c34a-4d5c-97cb-92cb5c10efa8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042136 Jul 27 22:57:22.997033 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 632/1275] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:22 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:23.381051 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bca0dfde-eb85-4063-99ab-3b4b74b9f4d0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:23.383200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bca0dfde-eb85-4063-99ab-3b4b74b9f4d0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:23.389669 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bca0dfde-eb85-4063-99ab-3b4b74b9f4d0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:23.390109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bca0dfde-eb85-4063-99ab-3b4b74b9f4d0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:23.390863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bca0dfde-eb85-4063-99ab-3b4b74b9f4d0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:23.391294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bca0dfde-eb85-4063-99ab-3b4b74b9f4d0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:23.406594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f695029d-932d-423a-96ac-4cc3deca838e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:23.407206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f695029d-932d-423a-96ac-4cc3deca838e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:23.409128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:23.415433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f695029d-932d-423a-96ac-4cc3deca838e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:23.415885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f695029d-932d-423a-96ac-4cc3deca838e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:23.416680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f695029d-932d-423a-96ac-4cc3deca838e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:23.417118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f695029d-932d-423a-96ac-4cc3deca838e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:23.419956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bca0dfde-eb85-4063-99ab-3b4b74b9f4d0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043409 Jul 27 22:57:23.420704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 644/1276] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:23 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:23.480814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f695029d-932d-423a-96ac-4cc3deca838e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:23.488977 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f695029d-932d-423a-96ac-4cc3deca838e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.086076 Jul 27 22:57:23.489547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 633/1277] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:23 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:23.685484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a649e609-77d9-429e-a47d-466728682fdd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:23.687598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a649e609-77d9-429e-a47d-466728682fdd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:23.694275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a649e609-77d9-429e-a47d-466728682fdd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:23.694712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a649e609-77d9-429e-a47d-466728682fdd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:23.695462 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a649e609-77d9-429e-a47d-466728682fdd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:23.695890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a649e609-77d9-429e-a47d-466728682fdd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:23.723989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a649e609-77d9-429e-a47d-466728682fdd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042577 Jul 27 22:57:23.724528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 645/1278] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:23 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:24.016386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-433d032e-14bb-4c15-b9cd-fe2f30790c15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:24.018639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-433d032e-14bb-4c15-b9cd-fe2f30790c15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:24.025161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-433d032e-14bb-4c15-b9cd-fe2f30790c15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:24.025676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-433d032e-14bb-4c15-b9cd-fe2f30790c15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:24.026508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-433d032e-14bb-4c15-b9cd-fe2f30790c15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:24.027016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-433d032e-14bb-4c15-b9cd-fe2f30790c15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:24.057005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-433d032e-14bb-4c15-b9cd-fe2f30790c15 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044478 Jul 27 22:57:24.057561 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 634/1279] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:24 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:24.432816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1988b62f-6943-469d-989d-cfcc668e44d1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:24.434962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1988b62f-6943-469d-989d-cfcc668e44d1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:24.441885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1988b62f-6943-469d-989d-cfcc668e44d1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:24.442338 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1988b62f-6943-469d-989d-cfcc668e44d1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:24.443097 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1988b62f-6943-469d-989d-cfcc668e44d1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:24.443529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1988b62f-6943-469d-989d-cfcc668e44d1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:24.471649 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1988b62f-6943-469d-989d-cfcc668e44d1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042864 Jul 27 22:57:24.472191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 646/1280] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:24 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:24.509769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-85995470-7002-48e1-bdfc-c0c9603c37fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:24.510377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-85995470-7002-48e1-bdfc-c0c9603c37fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:24.516388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85995470-7002-48e1-bdfc-c0c9603c37fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:24.516873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85995470-7002-48e1-bdfc-c0c9603c37fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:24.518243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85995470-7002-48e1-bdfc-c0c9603c37fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:24.518849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85995470-7002-48e1-bdfc-c0c9603c37fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:24.580789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-85995470-7002-48e1-bdfc-c0c9603c37fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:24.588478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-85995470-7002-48e1-bdfc-c0c9603c37fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082510 Jul 27 22:57:24.589075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 635/1281] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:24 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:24.736890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3c23c6ff-5d4e-481b-bf3e-88993d46d952 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:24.739018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3c23c6ff-5d4e-481b-bf3e-88993d46d952 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:24.745138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c23c6ff-5d4e-481b-bf3e-88993d46d952 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:24.745584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c23c6ff-5d4e-481b-bf3e-88993d46d952 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:24.746343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c23c6ff-5d4e-481b-bf3e-88993d46d952 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:24.746777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c23c6ff-5d4e-481b-bf3e-88993d46d952 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:24.782340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3c23c6ff-5d4e-481b-bf3e-88993d46d952 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049591 Jul 27 22:57:24.782907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 647/1282] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:24 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:25.069947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a4385c6b-5908-4c9f-bb55-489951cfce5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:25.072113 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a4385c6b-5908-4c9f-bb55-489951cfce5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:25.078087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4385c6b-5908-4c9f-bb55-489951cfce5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:25.078527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4385c6b-5908-4c9f-bb55-489951cfce5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:25.079271 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4385c6b-5908-4c9f-bb55-489951cfce5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:25.079703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4385c6b-5908-4c9f-bb55-489951cfce5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:25.107909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a4385c6b-5908-4c9f-bb55-489951cfce5a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041813 Jul 27 22:57:25.108449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 636/1283] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:25 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:25.484363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1edbce28-7e65-4b5d-977c-0c507bf6f5ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:25.486510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1edbce28-7e65-4b5d-977c-0c507bf6f5ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:25.488902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:25.494258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1edbce28-7e65-4b5d-977c-0c507bf6f5ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:25.494703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1edbce28-7e65-4b5d-977c-0c507bf6f5ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:25.495458 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1edbce28-7e65-4b5d-977c-0c507bf6f5ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:25.495891 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1edbce28-7e65-4b5d-977c-0c507bf6f5ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:25.525256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1edbce28-7e65-4b5d-977c-0c507bf6f5ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044900 Jul 27 22:57:25.525796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 648/1284] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:25.609132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-81776edd-172f-48fc-8748-7c046fc642a2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:25.609729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-81776edd-172f-48fc-8748-7c046fc642a2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:25.616263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-81776edd-172f-48fc-8748-7c046fc642a2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:25.616733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-81776edd-172f-48fc-8748-7c046fc642a2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:25.617477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-81776edd-172f-48fc-8748-7c046fc642a2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:25.617905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-81776edd-172f-48fc-8748-7c046fc642a2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:25.678126 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-81776edd-172f-48fc-8748-7c046fc642a2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:25.685667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-81776edd-172f-48fc-8748-7c046fc642a2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080303 Jul 27 22:57:25.686215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 637/1285] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:25 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:25.794571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bb1204cc-1158-4cac-84ec-0a36779380ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:25.796768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bb1204cc-1158-4cac-84ec-0a36779380ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:25.803246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bb1204cc-1158-4cac-84ec-0a36779380ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:25.803689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bb1204cc-1158-4cac-84ec-0a36779380ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:25.804443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bb1204cc-1158-4cac-84ec-0a36779380ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:25.804900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bb1204cc-1158-4cac-84ec-0a36779380ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:25.833347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bb1204cc-1158-4cac-84ec-0a36779380ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042753 Jul 27 22:57:25.833896 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 649/1286] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:25 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:26.120429 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4a568c49-038e-44bf-ada5-50fa244da066 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:26.122651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4a568c49-038e-44bf-ada5-50fa244da066 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:26.128735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4a568c49-038e-44bf-ada5-50fa244da066 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:26.129948 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4a568c49-038e-44bf-ada5-50fa244da066 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:26.130710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4a568c49-038e-44bf-ada5-50fa244da066 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:26.131141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4a568c49-038e-44bf-ada5-50fa244da066 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:26.159880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4a568c49-038e-44bf-ada5-50fa244da066 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043555 Jul 27 22:57:26.160431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 638/1287] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:26 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:26.538364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2c897da8-edd8-4274-99ba-288f34997e53 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:26.540517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2c897da8-edd8-4274-99ba-288f34997e53 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:26.547011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2c897da8-edd8-4274-99ba-288f34997e53 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:26.547456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2c897da8-edd8-4274-99ba-288f34997e53 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:26.548216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2c897da8-edd8-4274-99ba-288f34997e53 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:26.548682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2c897da8-edd8-4274-99ba-288f34997e53 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:26.576610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2c897da8-edd8-4274-99ba-288f34997e53 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042200 Jul 27 22:57:26.577152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 650/1288] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:26 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:26.707141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6b1b5421-6207-483c-87fe-ccf96e07efe1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:26.707777 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6b1b5421-6207-483c-87fe-ccf96e07efe1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:26.713789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b1b5421-6207-483c-87fe-ccf96e07efe1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:26.714231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b1b5421-6207-483c-87fe-ccf96e07efe1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:26.714978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b1b5421-6207-483c-87fe-ccf96e07efe1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:26.715410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b1b5421-6207-483c-87fe-ccf96e07efe1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:26.778782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6b1b5421-6207-483c-87fe-ccf96e07efe1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:26.786292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6b1b5421-6207-483c-87fe-ccf96e07efe1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083565 Jul 27 22:57:26.786859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 639/1289] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:26 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:26.848102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b9648e68-a11e-4a37-a16d-02f1dbf2185c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:26.850563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b9648e68-a11e-4a37-a16d-02f1dbf2185c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:26.857586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b9648e68-a11e-4a37-a16d-02f1dbf2185c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:26.858037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b9648e68-a11e-4a37-a16d-02f1dbf2185c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:26.858814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b9648e68-a11e-4a37-a16d-02f1dbf2185c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:26.859242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b9648e68-a11e-4a37-a16d-02f1dbf2185c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:26.888065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b9648e68-a11e-4a37-a16d-02f1dbf2185c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045124 Jul 27 22:57:26.888634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 651/1290] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:26 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:27.171321 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-264ebdba-c5a5-4755-8b90-6bdf82b66015 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:27.174047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-264ebdba-c5a5-4755-8b90-6bdf82b66015 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:27.179982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-264ebdba-c5a5-4755-8b90-6bdf82b66015 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:27.180427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-264ebdba-c5a5-4755-8b90-6bdf82b66015 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:27.181266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-264ebdba-c5a5-4755-8b90-6bdf82b66015 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:27.181698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-264ebdba-c5a5-4755-8b90-6bdf82b66015 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:27.210942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-264ebdba-c5a5-4755-8b90-6bdf82b66015 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043539 Jul 27 22:57:27.211491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 640/1291] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:27 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:27.588351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bb76dfd5-30ee-4e92-9ea3-d7f2aea9524f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:27.590520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bb76dfd5-30ee-4e92-9ea3-d7f2aea9524f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:27.597523 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bb76dfd5-30ee-4e92-9ea3-d7f2aea9524f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:27.597962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bb76dfd5-30ee-4e92-9ea3-d7f2aea9524f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:27.598708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bb76dfd5-30ee-4e92-9ea3-d7f2aea9524f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:27.599138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bb76dfd5-30ee-4e92-9ea3-d7f2aea9524f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:27.628355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bb76dfd5-30ee-4e92-9ea3-d7f2aea9524f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043986 Jul 27 22:57:27.628926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 652/1292] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:27 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:27.810843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2715bdd8-a827-4a6a-ac5f-c3725a559978 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:27.811444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2715bdd8-a827-4a6a-ac5f-c3725a559978 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:27.817693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2715bdd8-a827-4a6a-ac5f-c3725a559978 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:27.818135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2715bdd8-a827-4a6a-ac5f-c3725a559978 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:27.818882 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2715bdd8-a827-4a6a-ac5f-c3725a559978 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:27.819339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2715bdd8-a827-4a6a-ac5f-c3725a559978 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:27.878417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2715bdd8-a827-4a6a-ac5f-c3725a559978 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:27.885676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2715bdd8-a827-4a6a-ac5f-c3725a559978 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078672 Jul 27 22:57:27.886227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 641/1293] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:27 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:27.900798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0df25af9-c7c3-4c60-944a-76db88031b6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:27.902930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0df25af9-c7c3-4c60-944a-76db88031b6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:27.909585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0df25af9-c7c3-4c60-944a-76db88031b6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:27.910030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0df25af9-c7c3-4c60-944a-76db88031b6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:27.910774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0df25af9-c7c3-4c60-944a-76db88031b6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:27.911208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0df25af9-c7c3-4c60-944a-76db88031b6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:27.934747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:27.939888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0df25af9-c7c3-4c60-944a-76db88031b6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043095 Jul 27 22:57:27.940427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 653/1294] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:27 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:28.223349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-25b5f9db-1801-4162-b873-34c3787e06eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:28.225525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-25b5f9db-1801-4162-b873-34c3787e06eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:28.231766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25b5f9db-1801-4162-b873-34c3787e06eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:28.232204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25b5f9db-1801-4162-b873-34c3787e06eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:28.232978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25b5f9db-1801-4162-b873-34c3787e06eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:28.233403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25b5f9db-1801-4162-b873-34c3787e06eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:28.261525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-25b5f9db-1801-4162-b873-34c3787e06eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042136 Jul 27 22:57:28.262064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 642/1295] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:28 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:28.640762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d0d5420d-fff7-45f8-a795-c6656f6ac3bf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:28.642977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d0d5420d-fff7-45f8-a795-c6656f6ac3bf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:28.649277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d0d5420d-fff7-45f8-a795-c6656f6ac3bf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:28.649745 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d0d5420d-fff7-45f8-a795-c6656f6ac3bf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:28.650495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d0d5420d-fff7-45f8-a795-c6656f6ac3bf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:28.650918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d0d5420d-fff7-45f8-a795-c6656f6ac3bf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:28.678951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d0d5420d-fff7-45f8-a795-c6656f6ac3bf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042348 Jul 27 22:57:28.679489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 654/1296] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:28 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:28.906716 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-76ff3037-eb7c-4bbd-8a17-0e528628d338 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:28.907264 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-76ff3037-eb7c-4bbd-8a17-0e528628d338 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:28.913255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76ff3037-eb7c-4bbd-8a17-0e528628d338 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:28.913692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76ff3037-eb7c-4bbd-8a17-0e528628d338 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:28.914438 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76ff3037-eb7c-4bbd-8a17-0e528628d338 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:28.914868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76ff3037-eb7c-4bbd-8a17-0e528628d338 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:28.951372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0a395777-88f3-4527-a9d1-6fc5659acd37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:28.953566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0a395777-88f3-4527-a9d1-6fc5659acd37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:28.959543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a395777-88f3-4527-a9d1-6fc5659acd37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:28.959977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a395777-88f3-4527-a9d1-6fc5659acd37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:28.960763 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a395777-88f3-4527-a9d1-6fc5659acd37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:28.961188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a395777-88f3-4527-a9d1-6fc5659acd37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:28.975005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-76ff3037-eb7c-4bbd-8a17-0e528628d338 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:28.978695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:28.983880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-76ff3037-eb7c-4bbd-8a17-0e528628d338 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081097 Jul 27 22:57:28.984567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 643/1297] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:28 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:28.991318 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0a395777-88f3-4527-a9d1-6fc5659acd37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043874 Jul 27 22:57:28.991871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 655/1298] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:28 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:57:29.273795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-85164d52-69a6-4cbf-a09a-4b8e40b16825 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:29.275838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-85164d52-69a6-4cbf-a09a-4b8e40b16825 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:29.281758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85164d52-69a6-4cbf-a09a-4b8e40b16825 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:29.282196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85164d52-69a6-4cbf-a09a-4b8e40b16825 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:29.283478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85164d52-69a6-4cbf-a09a-4b8e40b16825 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:29.283905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85164d52-69a6-4cbf-a09a-4b8e40b16825 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:29.312133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-85164d52-69a6-4cbf-a09a-4b8e40b16825 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042599 Jul 27 22:57:29.312695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 644/1299] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:29 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:29.691481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1ee105ce-9eab-4224-9481-48f87a1e473a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:29.693678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1ee105ce-9eab-4224-9481-48f87a1e473a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:29.700196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ee105ce-9eab-4224-9481-48f87a1e473a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:29.700692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ee105ce-9eab-4224-9481-48f87a1e473a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:29.701460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ee105ce-9eab-4224-9481-48f87a1e473a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:29.701895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ee105ce-9eab-4224-9481-48f87a1e473a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:29.730983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1ee105ce-9eab-4224-9481-48f87a1e473a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043977 Jul 27 22:57:29.731539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 656/1300] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:29 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:30.004265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e3f72f85-cbcf-4974-b073-d105c6cce3f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:30.005628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0f1ac9c2-5610-4b62-a2e6-06b31513a64f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:30.006239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0f1ac9c2-5610-4b62-a2e6-06b31513a64f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:30.006469 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e3f72f85-cbcf-4974-b073-d105c6cce3f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:30.012405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3f72f85-cbcf-4974-b073-d105c6cce3f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:30.012537 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f1ac9c2-5610-4b62-a2e6-06b31513a64f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:30.012889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3f72f85-cbcf-4974-b073-d105c6cce3f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:30.012999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f1ac9c2-5610-4b62-a2e6-06b31513a64f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:30.013650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3f72f85-cbcf-4974-b073-d105c6cce3f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:30.013757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f1ac9c2-5610-4b62-a2e6-06b31513a64f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:30.014085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3f72f85-cbcf-4974-b073-d105c6cce3f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:30.014190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f1ac9c2-5610-4b62-a2e6-06b31513a64f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:30.042646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e3f72f85-cbcf-4974-b073-d105c6cce3f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043031 Jul 27 22:57:30.043204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 645/1301] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:29 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:30.074930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0f1ac9c2-5610-4b62-a2e6-06b31513a64f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:30.082481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0f1ac9c2-5610-4b62-a2e6-06b31513a64f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081235 Jul 27 22:57:30.083036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 657/1302] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:30 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:57:30.324169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-00a87356-ef0b-4417-a40d-bea71a968e86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:30.326326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-00a87356-ef0b-4417-a40d-bea71a968e86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:30.332809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-00a87356-ef0b-4417-a40d-bea71a968e86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:30.333255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-00a87356-ef0b-4417-a40d-bea71a968e86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:30.334014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-00a87356-ef0b-4417-a40d-bea71a968e86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:30.334444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-00a87356-ef0b-4417-a40d-bea71a968e86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:30.363202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-00a87356-ef0b-4417-a40d-bea71a968e86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042959 Jul 27 22:57:30.363741 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 646/1303] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:30 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:30.743526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-76c40e83-1417-4d53-8813-419a9cafa5d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:30.745692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-76c40e83-1417-4d53-8813-419a9cafa5d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:30.752116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-76c40e83-1417-4d53-8813-419a9cafa5d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:30.752580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-76c40e83-1417-4d53-8813-419a9cafa5d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:30.753344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-76c40e83-1417-4d53-8813-419a9cafa5d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:30.753780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-76c40e83-1417-4d53-8813-419a9cafa5d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:30.785997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-76c40e83-1417-4d53-8813-419a9cafa5d8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046505 Jul 27 22:57:30.786544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 658/1304] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:30 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:31.055322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5440b4f6-35b4-43ba-b362-8a8c1a4f89eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:31.057526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5440b4f6-35b4-43ba-b362-8a8c1a4f89eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:31.063523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5440b4f6-35b4-43ba-b362-8a8c1a4f89eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:31.064537 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5440b4f6-35b4-43ba-b362-8a8c1a4f89eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:31.065314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5440b4f6-35b4-43ba-b362-8a8c1a4f89eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:31.065744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5440b4f6-35b4-43ba-b362-8a8c1a4f89eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:31.093112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5440b4f6-35b4-43ba-b362-8a8c1a4f89eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041760 Jul 27 22:57:31.093651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 647/1305] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:31 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:31.102810 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b64b5410-3c50-42e8-b3dc-58e4baacc999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:31.103407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b64b5410-3c50-42e8-b3dc-58e4baacc999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:31.109297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b64b5410-3c50-42e8-b3dc-58e4baacc999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:31.109766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b64b5410-3c50-42e8-b3dc-58e4baacc999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:31.110999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b64b5410-3c50-42e8-b3dc-58e4baacc999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:31.111437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b64b5410-3c50-42e8-b3dc-58e4baacc999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:31.174012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b64b5410-3c50-42e8-b3dc-58e4baacc999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:31.181396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b64b5410-3c50-42e8-b3dc-58e4baacc999 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082878 Jul 27 22:57:31.181949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 659/1306] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:31 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:31.376196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a38221b1-9b07-4d53-aca1-bc995f03fd46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:31.378398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a38221b1-9b07-4d53-aca1-bc995f03fd46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:31.384379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a38221b1-9b07-4d53-aca1-bc995f03fd46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:31.384864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a38221b1-9b07-4d53-aca1-bc995f03fd46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:31.385631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a38221b1-9b07-4d53-aca1-bc995f03fd46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:31.386068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a38221b1-9b07-4d53-aca1-bc995f03fd46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:31.414505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a38221b1-9b07-4d53-aca1-bc995f03fd46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042352 Jul 27 22:57:31.415045 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 648/1307] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:31 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:31.798284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8188fa8f-ed83-400c-ae37-ac94fe002a88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:31.800579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8188fa8f-ed83-400c-ae37-ac94fe002a88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:31.806985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8188fa8f-ed83-400c-ae37-ac94fe002a88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:31.807425 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8188fa8f-ed83-400c-ae37-ac94fe002a88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:31.808176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8188fa8f-ed83-400c-ae37-ac94fe002a88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:31.808631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8188fa8f-ed83-400c-ae37-ac94fe002a88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:31.836373 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8188fa8f-ed83-400c-ae37-ac94fe002a88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042261 Jul 27 22:57:31.836938 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 660/1308] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:31 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:32.105690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b0ff0a44-32ec-4335-8fb4-0c5f23bac9a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:32.107812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b0ff0a44-32ec-4335-8fb4-0c5f23bac9a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:32.113945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0ff0a44-32ec-4335-8fb4-0c5f23bac9a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:32.114393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0ff0a44-32ec-4335-8fb4-0c5f23bac9a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:32.115147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0ff0a44-32ec-4335-8fb4-0c5f23bac9a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:32.115612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0ff0a44-32ec-4335-8fb4-0c5f23bac9a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:32.144836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b0ff0a44-32ec-4335-8fb4-0c5f23bac9a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043184 Jul 27 22:57:32.145449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 649/1309] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:32 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:32.202328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-23d61538-2495-4a26-8f44-bc94fb5fc341 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:32.202929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-23d61538-2495-4a26-8f44-bc94fb5fc341 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:32.209616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23d61538-2495-4a26-8f44-bc94fb5fc341 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:32.210054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23d61538-2495-4a26-8f44-bc94fb5fc341 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:32.210801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23d61538-2495-4a26-8f44-bc94fb5fc341 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:32.211228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-23d61538-2495-4a26-8f44-bc94fb5fc341 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:32.270784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-23d61538-2495-4a26-8f44-bc94fb5fc341 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:32.278132 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-23d61538-2495-4a26-8f44-bc94fb5fc341 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079614 Jul 27 22:57:32.278716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 661/1310] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:32 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:32.427021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-090a6def-700e-48f9-97f2-b7a882c973c9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:32.429108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-090a6def-700e-48f9-97f2-b7a882c973c9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:32.435207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-090a6def-700e-48f9-97f2-b7a882c973c9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:32.435660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-090a6def-700e-48f9-97f2-b7a882c973c9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:32.436416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-090a6def-700e-48f9-97f2-b7a882c973c9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:32.436876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-090a6def-700e-48f9-97f2-b7a882c973c9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:32.465533 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-090a6def-700e-48f9-97f2-b7a882c973c9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042997 Jul 27 22:57:32.466071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 650/1311] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:32 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:32.849286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cdc5d725-7f59-460d-861e-3af54f7bfb57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:32.851453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cdc5d725-7f59-460d-861e-3af54f7bfb57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:32.857629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cdc5d725-7f59-460d-861e-3af54f7bfb57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:32.858072 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cdc5d725-7f59-460d-861e-3af54f7bfb57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:32.858821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cdc5d725-7f59-460d-861e-3af54f7bfb57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:32.859251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cdc5d725-7f59-460d-861e-3af54f7bfb57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:32.888336 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cdc5d725-7f59-460d-861e-3af54f7bfb57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043551 Jul 27 22:57:32.889222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 662/1312] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:32 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:33.157921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4ea34b9a-5b82-4be4-b667-082d28d22e0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:33.160026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4ea34b9a-5b82-4be4-b667-082d28d22e0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:33.166044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ea34b9a-5b82-4be4-b667-082d28d22e0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:33.166487 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ea34b9a-5b82-4be4-b667-082d28d22e0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:33.167239 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ea34b9a-5b82-4be4-b667-082d28d22e0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:33.167670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ea34b9a-5b82-4be4-b667-082d28d22e0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:33.196715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4ea34b9a-5b82-4be4-b667-082d28d22e0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042829 Jul 27 22:57:33.197254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 651/1313] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:33.342566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d9195dea-69f3-4c9e-99e1-97f7b4cb21dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:33.343178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d9195dea-69f3-4c9e-99e1-97f7b4cb21dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:33.349118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9195dea-69f3-4c9e-99e1-97f7b4cb21dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:33.349564 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9195dea-69f3-4c9e-99e1-97f7b4cb21dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:33.350323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9195dea-69f3-4c9e-99e1-97f7b4cb21dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:33.350763 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9195dea-69f3-4c9e-99e1-97f7b4cb21dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:33.410356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d9195dea-69f3-4c9e-99e1-97f7b4cb21dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:33.418007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d9195dea-69f3-4c9e-99e1-97f7b4cb21dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.123431 Jul 27 22:57:33.418560 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 663/1314] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:33 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:33.477640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0590fd02-f025-4d1e-8a00-7f1464cb5075 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:33.479746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0590fd02-f025-4d1e-8a00-7f1464cb5075 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:33.486574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0590fd02-f025-4d1e-8a00-7f1464cb5075 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:33.487022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0590fd02-f025-4d1e-8a00-7f1464cb5075 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:33.487898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0590fd02-f025-4d1e-8a00-7f1464cb5075 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:33.488377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0590fd02-f025-4d1e-8a00-7f1464cb5075 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:33.516188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0590fd02-f025-4d1e-8a00-7f1464cb5075 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042661 Jul 27 22:57:33.516757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 652/1315] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:33 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:33.901670 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-92baaef2-10e1-4a5f-b19b-6e42cda5c2ec tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:33.903844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-92baaef2-10e1-4a5f-b19b-6e42cda5c2ec tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:33.910989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-92baaef2-10e1-4a5f-b19b-6e42cda5c2ec tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:33.911381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-92baaef2-10e1-4a5f-b19b-6e42cda5c2ec tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:33.912168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-92baaef2-10e1-4a5f-b19b-6e42cda5c2ec tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:33.912624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-92baaef2-10e1-4a5f-b19b-6e42cda5c2ec tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:33.940221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-92baaef2-10e1-4a5f-b19b-6e42cda5c2ec tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042547 Jul 27 22:57:33.940787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 664/1316] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:33 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:34.209601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-55509ab5-3935-4752-af66-4f0dfa7ae919 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:34.211643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-55509ab5-3935-4752-af66-4f0dfa7ae919 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:34.217600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55509ab5-3935-4752-af66-4f0dfa7ae919 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:34.218037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55509ab5-3935-4752-af66-4f0dfa7ae919 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:34.218786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55509ab5-3935-4752-af66-4f0dfa7ae919 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:34.219215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55509ab5-3935-4752-af66-4f0dfa7ae919 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:34.246838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-55509ab5-3935-4752-af66-4f0dfa7ae919 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041258 Jul 27 22:57:34.247378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 653/1317] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:34 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:34.438320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-87d3c6ba-4da4-4fda-b162-cd9bef23c663 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:34.438940 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-87d3c6ba-4da4-4fda-b162-cd9bef23c663 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:34.444867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-87d3c6ba-4da4-4fda-b162-cd9bef23c663 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:34.445305 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-87d3c6ba-4da4-4fda-b162-cd9bef23c663 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:34.446051 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-87d3c6ba-4da4-4fda-b162-cd9bef23c663 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:34.446474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-87d3c6ba-4da4-4fda-b162-cd9bef23c663 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:34.508582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-87d3c6ba-4da4-4fda-b162-cd9bef23c663 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:34.515927 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-87d3c6ba-4da4-4fda-b162-cd9bef23c663 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081514 Jul 27 22:57:34.516475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 665/1318] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:34 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:34.529037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ace5dded-b6ba-4fb4-96cd-05503f21d721 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:34.531589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ace5dded-b6ba-4fb4-96cd-05503f21d721 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:34.538255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ace5dded-b6ba-4fb4-96cd-05503f21d721 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:34.538705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ace5dded-b6ba-4fb4-96cd-05503f21d721 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:34.539470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ace5dded-b6ba-4fb4-96cd-05503f21d721 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:34.539905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ace5dded-b6ba-4fb4-96cd-05503f21d721 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:34.568825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ace5dded-b6ba-4fb4-96cd-05503f21d721 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044239 Jul 27 22:57:34.569372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 654/1319] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:34 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:34.953068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fd1bbcdd-131a-4208-96bf-50b91667c4e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:34.955265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fd1bbcdd-131a-4208-96bf-50b91667c4e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:34.961658 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fd1bbcdd-131a-4208-96bf-50b91667c4e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:34.962102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fd1bbcdd-131a-4208-96bf-50b91667c4e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:34.962848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fd1bbcdd-131a-4208-96bf-50b91667c4e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:34.963279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fd1bbcdd-131a-4208-96bf-50b91667c4e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:34.992057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fd1bbcdd-131a-4208-96bf-50b91667c4e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042991 Jul 27 22:57:34.992678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 666/1320] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:34 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:35.259705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-995dd4fd-0b93-45ac-bfdc-cccc3b5e25b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:35.261787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-995dd4fd-0b93-45ac-bfdc-cccc3b5e25b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:35.267774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-995dd4fd-0b93-45ac-bfdc-cccc3b5e25b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:35.268220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-995dd4fd-0b93-45ac-bfdc-cccc3b5e25b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:35.269010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-995dd4fd-0b93-45ac-bfdc-cccc3b5e25b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:35.269448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-995dd4fd-0b93-45ac-bfdc-cccc3b5e25b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:35.297628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-995dd4fd-0b93-45ac-bfdc-cccc3b5e25b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041975 Jul 27 22:57:35.298789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 655/1321] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:35.538810 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-06fbce22-8d3b-4697-ac21-e37659ebc280 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:35.539413 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-06fbce22-8d3b-4697-ac21-e37659ebc280 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:35.545410 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06fbce22-8d3b-4697-ac21-e37659ebc280 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:35.545850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06fbce22-8d3b-4697-ac21-e37659ebc280 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:35.546602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06fbce22-8d3b-4697-ac21-e37659ebc280 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:35.547029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-06fbce22-8d3b-4697-ac21-e37659ebc280 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:35.580641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e840f6cc-faa3-454d-8253-c18cd977a7f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:35.582873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e840f6cc-faa3-454d-8253-c18cd977a7f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:35.589604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e840f6cc-faa3-454d-8253-c18cd977a7f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:35.590044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e840f6cc-faa3-454d-8253-c18cd977a7f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:35.590805 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e840f6cc-faa3-454d-8253-c18cd977a7f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:35.591234 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e840f6cc-faa3-454d-8253-c18cd977a7f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:35.609874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-06fbce22-8d3b-4697-ac21-e37659ebc280 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:35.617408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-06fbce22-8d3b-4697-ac21-e37659ebc280 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082453 Jul 27 22:57:35.617973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 667/1322] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:35 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:35.620982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e840f6cc-faa3-454d-8253-c18cd977a7f0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044479 Jul 27 22:57:35.621538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 656/1323] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:35 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:36.004925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1f1bbf75-a640-49ce-b268-c7bf71d13b15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:36.007006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1f1bbf75-a640-49ce-b268-c7bf71d13b15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:36.013477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f1bbf75-a640-49ce-b268-c7bf71d13b15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:36.013925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f1bbf75-a640-49ce-b268-c7bf71d13b15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:36.014709 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f1bbf75-a640-49ce-b268-c7bf71d13b15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:36.015145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f1bbf75-a640-49ce-b268-c7bf71d13b15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:36.043253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1f1bbf75-a640-49ce-b268-c7bf71d13b15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042930 Jul 27 22:57:36.043780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 668/1324] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:35 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:36.310615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-eb9ab0da-7111-40e5-adc2-7defda316944 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:36.312807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-eb9ab0da-7111-40e5-adc2-7defda316944 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:36.319424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb9ab0da-7111-40e5-adc2-7defda316944 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:36.319865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb9ab0da-7111-40e5-adc2-7defda316944 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:36.320649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb9ab0da-7111-40e5-adc2-7defda316944 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:36.321080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb9ab0da-7111-40e5-adc2-7defda316944 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:36.348453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-eb9ab0da-7111-40e5-adc2-7defda316944 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041852 Jul 27 22:57:36.349035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 657/1325] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:36.633107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ac92b3a2-8fbe-43b0-8dd3-7277c7b72344 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:36.635222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ac92b3a2-8fbe-43b0-8dd3-7277c7b72344 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:36.637636 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1ff7ae88-2470-449d-8759-f69d87bf7d14 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:36.638246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1ff7ae88-2470-449d-8759-f69d87bf7d14 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:36.641295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac92b3a2-8fbe-43b0-8dd3-7277c7b72344 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:36.641736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac92b3a2-8fbe-43b0-8dd3-7277c7b72344 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:36.642491 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac92b3a2-8fbe-43b0-8dd3-7277c7b72344 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:36.642919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac92b3a2-8fbe-43b0-8dd3-7277c7b72344 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:36.644270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ff7ae88-2470-449d-8759-f69d87bf7d14 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:36.644748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ff7ae88-2470-449d-8759-f69d87bf7d14 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:36.645680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ff7ae88-2470-449d-8759-f69d87bf7d14 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:36.646114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ff7ae88-2470-449d-8759-f69d87bf7d14 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:36.671575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ac92b3a2-8fbe-43b0-8dd3-7277c7b72344 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042567 Jul 27 22:57:36.672127 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 669/1326] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:36 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:36.705755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1ff7ae88-2470-449d-8759-f69d87bf7d14 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:36.713121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1ff7ae88-2470-449d-8759-f69d87bf7d14 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079246 Jul 27 22:57:36.713671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 658/1327] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:36 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:57:37.055503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0b2703f7-7744-4d41-9d44-f82f257d4942 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:37.057726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0b2703f7-7744-4d41-9d44-f82f257d4942 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:37.064139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b2703f7-7744-4d41-9d44-f82f257d4942 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:37.064618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b2703f7-7744-4d41-9d44-f82f257d4942 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:37.065394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b2703f7-7744-4d41-9d44-f82f257d4942 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:37.065831 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b2703f7-7744-4d41-9d44-f82f257d4942 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:37.082346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:37.094744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0b2703f7-7744-4d41-9d44-f82f257d4942 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043283 Jul 27 22:57:37.095288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 670/1328] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:37 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:37.361098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-64b0edd9-6dbc-4d73-8a26-a0bda61572ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:37.363216 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-64b0edd9-6dbc-4d73-8a26-a0bda61572ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:37.369302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64b0edd9-6dbc-4d73-8a26-a0bda61572ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:37.369743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64b0edd9-6dbc-4d73-8a26-a0bda61572ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:37.370485 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64b0edd9-6dbc-4d73-8a26-a0bda61572ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:37.370911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64b0edd9-6dbc-4d73-8a26-a0bda61572ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:37.400167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-64b0edd9-6dbc-4d73-8a26-a0bda61572ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043272 Jul 27 22:57:37.400723 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 659/1329] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:37.684494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7361bf46-6e18-4a18-a424-e4f90ae5541c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:37.686679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7361bf46-6e18-4a18-a424-e4f90ae5541c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:37.693904 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7361bf46-6e18-4a18-a424-e4f90ae5541c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:37.694355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7361bf46-6e18-4a18-a424-e4f90ae5541c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:37.695187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7361bf46-6e18-4a18-a424-e4f90ae5541c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:37.695657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7361bf46-6e18-4a18-a424-e4f90ae5541c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:37.724311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7361bf46-6e18-4a18-a424-e4f90ae5541c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043736 Jul 27 22:57:37.724919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 671/1330] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:37 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:37.733916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f5f2127a-7971-420e-b2b2-5e0d866df024 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:37.734525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f5f2127a-7971-420e-b2b2-5e0d866df024 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:37.741046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f5f2127a-7971-420e-b2b2-5e0d866df024 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:37.741496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f5f2127a-7971-420e-b2b2-5e0d866df024 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:37.742264 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f5f2127a-7971-420e-b2b2-5e0d866df024 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:37.742699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f5f2127a-7971-420e-b2b2-5e0d866df024 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:37.760850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:37.803379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f5f2127a-7971-420e-b2b2-5e0d866df024 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:37.810921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f5f2127a-7971-420e-b2b2-5e0d866df024 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080762 Jul 27 22:57:37.811479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 660/1331] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:37 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:38.107925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-731abeb4-9366-492c-8b63-56959c6b9f61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:38.110110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-731abeb4-9366-492c-8b63-56959c6b9f61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:38.117126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-731abeb4-9366-492c-8b63-56959c6b9f61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:38.117571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-731abeb4-9366-492c-8b63-56959c6b9f61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:38.118333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-731abeb4-9366-492c-8b63-56959c6b9f61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:38.118765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-731abeb4-9366-492c-8b63-56959c6b9f61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:38.148825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-731abeb4-9366-492c-8b63-56959c6b9f61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Jul 27 22:57:38.149425 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 672/1332] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:38 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:38.411912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cefdef61-acda-46e6-9912-6c5ad74698db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:38.414091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cefdef61-acda-46e6-9912-6c5ad74698db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:38.420152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cefdef61-acda-46e6-9912-6c5ad74698db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:38.420632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cefdef61-acda-46e6-9912-6c5ad74698db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:38.421395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cefdef61-acda-46e6-9912-6c5ad74698db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:38.421828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cefdef61-acda-46e6-9912-6c5ad74698db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:38.449675 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cefdef61-acda-46e6-9912-6c5ad74698db tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042303 Jul 27 22:57:38.450211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 661/1333] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:38 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:38.736429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-80d97e67-5445-421b-81df-8943d69cde4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:38.738601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-80d97e67-5445-421b-81df-8943d69cde4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:38.744721 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80d97e67-5445-421b-81df-8943d69cde4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:38.745170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80d97e67-5445-421b-81df-8943d69cde4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:38.745962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80d97e67-5445-421b-81df-8943d69cde4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:38.746397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80d97e67-5445-421b-81df-8943d69cde4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:38.776157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-80d97e67-5445-421b-81df-8943d69cde4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043752 Jul 27 22:57:38.776751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 673/1334] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:38 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:38.832440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-391988c8-1f2e-4b62-832a-8d84b6a07a6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:38.833625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-391988c8-1f2e-4b62-832a-8d84b6a07a6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:38.842136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-391988c8-1f2e-4b62-832a-8d84b6a07a6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:38.842600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-391988c8-1f2e-4b62-832a-8d84b6a07a6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:38.843365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-391988c8-1f2e-4b62-832a-8d84b6a07a6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:38.843977 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-391988c8-1f2e-4b62-832a-8d84b6a07a6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:38.905226 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-391988c8-1f2e-4b62-832a-8d84b6a07a6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:38.912734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-391988c8-1f2e-4b62-832a-8d84b6a07a6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.085537 Jul 27 22:57:38.913286 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 662/1335] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:38 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:39.162088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-babd523b-af7f-4fde-904b-af36313ec6d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:39.164276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-babd523b-af7f-4fde-904b-af36313ec6d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:39.170823 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-babd523b-af7f-4fde-904b-af36313ec6d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:39.171269 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-babd523b-af7f-4fde-904b-af36313ec6d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:39.172052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-babd523b-af7f-4fde-904b-af36313ec6d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:39.172492 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-babd523b-af7f-4fde-904b-af36313ec6d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:39.201935 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-babd523b-af7f-4fde-904b-af36313ec6d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043823 Jul 27 22:57:39.202483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 674/1336] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:39 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:39.461519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2a6a00d0-22fd-47f6-bd76-11b7c066eef8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:39.463570 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2a6a00d0-22fd-47f6-bd76-11b7c066eef8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:39.469514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2a6a00d0-22fd-47f6-bd76-11b7c066eef8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:39.470015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2a6a00d0-22fd-47f6-bd76-11b7c066eef8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:39.471335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2a6a00d0-22fd-47f6-bd76-11b7c066eef8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:39.471761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2a6a00d0-22fd-47f6-bd76-11b7c066eef8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:39.500179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2a6a00d0-22fd-47f6-bd76-11b7c066eef8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042706 Jul 27 22:57:39.500827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 663/1337] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:39.788920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ba8bcb1d-2418-4fda-9730-912ac434fc87 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:39.791068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ba8bcb1d-2418-4fda-9730-912ac434fc87 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:39.797070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba8bcb1d-2418-4fda-9730-912ac434fc87 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:39.797514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba8bcb1d-2418-4fda-9730-912ac434fc87 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:39.798267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba8bcb1d-2418-4fda-9730-912ac434fc87 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:39.798703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba8bcb1d-2418-4fda-9730-912ac434fc87 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:39.826534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ba8bcb1d-2418-4fda-9730-912ac434fc87 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041619 Jul 27 22:57:39.827067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 675/1338] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:39 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:39.933385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-91111b08-80c0-4472-9d5f-be22d32852c9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:39.933990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-91111b08-80c0-4472-9d5f-be22d32852c9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:39.939894 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-91111b08-80c0-4472-9d5f-be22d32852c9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:39.940332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-91111b08-80c0-4472-9d5f-be22d32852c9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:39.941108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-91111b08-80c0-4472-9d5f-be22d32852c9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:39.941542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-91111b08-80c0-4472-9d5f-be22d32852c9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:40.003785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-91111b08-80c0-4472-9d5f-be22d32852c9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:40.011152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-91111b08-80c0-4472-9d5f-be22d32852c9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081630 Jul 27 22:57:40.011710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 664/1339] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:39 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:40.214356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-69fdc7fe-012b-49a7-9f28-8102cc9a6c43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:40.216487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-69fdc7fe-012b-49a7-9f28-8102cc9a6c43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:40.222972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69fdc7fe-012b-49a7-9f28-8102cc9a6c43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:40.223407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69fdc7fe-012b-49a7-9f28-8102cc9a6c43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:40.224154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69fdc7fe-012b-49a7-9f28-8102cc9a6c43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:40.224602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69fdc7fe-012b-49a7-9f28-8102cc9a6c43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:40.252748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-69fdc7fe-012b-49a7-9f28-8102cc9a6c43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041806 Jul 27 22:57:40.253287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 676/1340] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:40 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:40.512044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6762b1b4-b86a-4bc0-8b9a-9c39b8493d1d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:40.514118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6762b1b4-b86a-4bc0-8b9a-9c39b8493d1d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:40.520894 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6762b1b4-b86a-4bc0-8b9a-9c39b8493d1d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:40.521339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6762b1b4-b86a-4bc0-8b9a-9c39b8493d1d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:40.522091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6762b1b4-b86a-4bc0-8b9a-9c39b8493d1d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:40.522522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6762b1b4-b86a-4bc0-8b9a-9c39b8493d1d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:40.550729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6762b1b4-b86a-4bc0-8b9a-9c39b8493d1d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042715 Jul 27 22:57:40.551266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 665/1341] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:40.839154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f1319941-9755-4fe6-8697-24a03976273d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:40.841341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f1319941-9755-4fe6-8697-24a03976273d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:40.847353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1319941-9755-4fe6-8697-24a03976273d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:40.847802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1319941-9755-4fe6-8697-24a03976273d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:40.848575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1319941-9755-4fe6-8697-24a03976273d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:40.849025 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1319941-9755-4fe6-8697-24a03976273d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:40.878234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f1319941-9755-4fe6-8697-24a03976273d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043030 Jul 27 22:57:40.878783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 677/1342] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:40 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:41.032330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-74a44440-06ee-40a3-8dd4-16c50e5374b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:41.032983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-74a44440-06ee-40a3-8dd4-16c50e5374b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:41.038912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-74a44440-06ee-40a3-8dd4-16c50e5374b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:41.039355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-74a44440-06ee-40a3-8dd4-16c50e5374b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:41.040107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-74a44440-06ee-40a3-8dd4-16c50e5374b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:41.040538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-74a44440-06ee-40a3-8dd4-16c50e5374b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:41.099824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-74a44440-06ee-40a3-8dd4-16c50e5374b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:41.107483 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-74a44440-06ee-40a3-8dd4-16c50e5374b5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078959 Jul 27 22:57:41.108038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 666/1343] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:41 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:41.264921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0b6242ed-86cf-46f5-818b-6efa358ada61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:41.267093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0b6242ed-86cf-46f5-818b-6efa358ada61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:41.274113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b6242ed-86cf-46f5-818b-6efa358ada61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:41.274547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b6242ed-86cf-46f5-818b-6efa358ada61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:41.275299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b6242ed-86cf-46f5-818b-6efa358ada61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:41.275753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b6242ed-86cf-46f5-818b-6efa358ada61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:41.303562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0b6242ed-86cf-46f5-818b-6efa358ada61 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042598 Jul 27 22:57:41.304093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 678/1344] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:41 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:41.360684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 22:57:41.360832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 22:57:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 22:57:41.562768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-06f315c4-6941-42e2-bd6f-fa18412b5a5f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:41.565526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-06f315c4-6941-42e2-bd6f-fa18412b5a5f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:41.571499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06f315c4-6941-42e2-bd6f-fa18412b5a5f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:41.571940 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06f315c4-6941-42e2-bd6f-fa18412b5a5f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:41.572730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06f315c4-6941-42e2-bd6f-fa18412b5a5f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:41.573164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06f315c4-6941-42e2-bd6f-fa18412b5a5f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:41.601202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-06f315c4-6941-42e2-bd6f-fa18412b5a5f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042324 Jul 27 22:57:41.601731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 667/1345] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:41.890719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-711a8b76-cd1c-4685-ae60-2a3e17fc6967 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:41.892914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-711a8b76-cd1c-4685-ae60-2a3e17fc6967 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:41.898855 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-711a8b76-cd1c-4685-ae60-2a3e17fc6967 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:41.899294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-711a8b76-cd1c-4685-ae60-2a3e17fc6967 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:41.900043 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-711a8b76-cd1c-4685-ae60-2a3e17fc6967 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:41.900469 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-711a8b76-cd1c-4685-ae60-2a3e17fc6967 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:41.931566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-711a8b76-cd1c-4685-ae60-2a3e17fc6967 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044781 Jul 27 22:57:41.932038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 679/1346] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:41 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:42.128031 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5d6d3ba2-742f-497a-b742-56cd9629ae0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:42.128757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5d6d3ba2-742f-497a-b742-56cd9629ae0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:42.137437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d6d3ba2-742f-497a-b742-56cd9629ae0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:42.137867 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d6d3ba2-742f-497a-b742-56cd9629ae0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:42.138623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d6d3ba2-742f-497a-b742-56cd9629ae0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:42.139050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d6d3ba2-742f-497a-b742-56cd9629ae0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:42.199483 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5d6d3ba2-742f-497a-b742-56cd9629ae0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:42.207186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5d6d3ba2-742f-497a-b742-56cd9629ae0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083220 Jul 27 22:57:42.207728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 668/1347] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:42 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:42.315571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f022c1dc-6951-40bb-8a22-090242723dd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:42.317754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f022c1dc-6951-40bb-8a22-090242723dd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:42.324205 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f022c1dc-6951-40bb-8a22-090242723dd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:42.324687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f022c1dc-6951-40bb-8a22-090242723dd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:42.325442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f022c1dc-6951-40bb-8a22-090242723dd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:42.325875 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f022c1dc-6951-40bb-8a22-090242723dd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:42.354952 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f022c1dc-6951-40bb-8a22-090242723dd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043383 Jul 27 22:57:42.355494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 680/1348] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:42 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:42.613805 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f99dc814-05fe-47bc-9b27-7290531d57d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:42.615904 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f99dc814-05fe-47bc-9b27-7290531d57d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:42.621905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f99dc814-05fe-47bc-9b27-7290531d57d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:42.622340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f99dc814-05fe-47bc-9b27-7290531d57d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:42.623119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f99dc814-05fe-47bc-9b27-7290531d57d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:42.623542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f99dc814-05fe-47bc-9b27-7290531d57d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:42.651909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f99dc814-05fe-47bc-9b27-7290531d57d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042207 Jul 27 22:57:42.652431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 669/1349] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:57:42.943920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5fb6768d-4874-419a-9814-07a29f346fe0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:42.946034 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5fb6768d-4874-419a-9814-07a29f346fe0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:42.952065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5fb6768d-4874-419a-9814-07a29f346fe0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:42.952514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5fb6768d-4874-419a-9814-07a29f346fe0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:42.953311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5fb6768d-4874-419a-9814-07a29f346fe0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:42.953748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5fb6768d-4874-419a-9814-07a29f346fe0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:42.981946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5fb6768d-4874-419a-9814-07a29f346fe0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042639 Jul 27 22:57:42.982492 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 681/1350] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:42 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:43.227363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-442b5483-e11e-424a-80ad-52f0fc240b79 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:43.228158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-442b5483-e11e-424a-80ad-52f0fc240b79 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:43.234224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-442b5483-e11e-424a-80ad-52f0fc240b79 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:43.234667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-442b5483-e11e-424a-80ad-52f0fc240b79 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:43.235423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-442b5483-e11e-424a-80ad-52f0fc240b79 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:43.235855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-442b5483-e11e-424a-80ad-52f0fc240b79 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:43.294836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-442b5483-e11e-424a-80ad-52f0fc240b79 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:43.302694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-442b5483-e11e-424a-80ad-52f0fc240b79 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079220 Jul 27 22:57:43.303247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 670/1351] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:43 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:43.368000 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dc6c05db-b756-4140-b9b5-0945f56ebf65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:43.370161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dc6c05db-b756-4140-b9b5-0945f56ebf65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:43.376514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc6c05db-b756-4140-b9b5-0945f56ebf65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:43.376987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc6c05db-b756-4140-b9b5-0945f56ebf65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:43.378423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc6c05db-b756-4140-b9b5-0945f56ebf65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:43.378855 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc6c05db-b756-4140-b9b5-0945f56ebf65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:43.406135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dc6c05db-b756-4140-b9b5-0945f56ebf65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042101 Jul 27 22:57:43.406689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 682/1352] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:43 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:43.664577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e9acbb0f-28a9-4c49-aa47-637146652486 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:43.666823 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e9acbb0f-28a9-4c49-aa47-637146652486 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:43.672925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9acbb0f-28a9-4c49-aa47-637146652486 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:43.673371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9acbb0f-28a9-4c49-aa47-637146652486 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:43.674118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9acbb0f-28a9-4c49-aa47-637146652486 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:43.674589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9acbb0f-28a9-4c49-aa47-637146652486 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:43.701966 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e9acbb0f-28a9-4c49-aa47-637146652486 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041382 Jul 27 22:57:43.702497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 671/1353] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:43.994679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dc15d467-a2bd-4509-9b88-fbb91864ccaa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:43.996849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dc15d467-a2bd-4509-9b88-fbb91864ccaa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:44.003200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc15d467-a2bd-4509-9b88-fbb91864ccaa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:44.003648 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc15d467-a2bd-4509-9b88-fbb91864ccaa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:44.004416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc15d467-a2bd-4509-9b88-fbb91864ccaa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:44.004893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc15d467-a2bd-4509-9b88-fbb91864ccaa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:44.032850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dc15d467-a2bd-4509-9b88-fbb91864ccaa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042221 Jul 27 22:57:44.033390 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 683/1354] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:43 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:44.323285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a2e5090a-5d81-4d33-a382-ae7c49ab7f17 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:44.323889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a2e5090a-5d81-4d33-a382-ae7c49ab7f17 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:44.329926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2e5090a-5d81-4d33-a382-ae7c49ab7f17 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:44.330370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2e5090a-5d81-4d33-a382-ae7c49ab7f17 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:44.331123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2e5090a-5d81-4d33-a382-ae7c49ab7f17 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:44.331555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2e5090a-5d81-4d33-a382-ae7c49ab7f17 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:44.393248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a2e5090a-5d81-4d33-a382-ae7c49ab7f17 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:44.400578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a2e5090a-5d81-4d33-a382-ae7c49ab7f17 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081261 Jul 27 22:57:44.401143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 672/1355] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:44 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:44.418711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7a0f57d2-c27f-4b40-9ee5-9b134e9a7fd2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:44.420883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7a0f57d2-c27f-4b40-9ee5-9b134e9a7fd2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:44.427756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a0f57d2-c27f-4b40-9ee5-9b134e9a7fd2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:44.428197 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a0f57d2-c27f-4b40-9ee5-9b134e9a7fd2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:44.428983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a0f57d2-c27f-4b40-9ee5-9b134e9a7fd2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:44.429416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7a0f57d2-c27f-4b40-9ee5-9b134e9a7fd2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:44.457484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7a0f57d2-c27f-4b40-9ee5-9b134e9a7fd2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042686 Jul 27 22:57:44.458025 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 684/1356] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:44 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:44.714912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b53f3d61-1baa-4ae9-8c25-9ddd0bbcd8a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:44.717006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b53f3d61-1baa-4ae9-8c25-9ddd0bbcd8a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:44.723389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b53f3d61-1baa-4ae9-8c25-9ddd0bbcd8a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:44.723825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b53f3d61-1baa-4ae9-8c25-9ddd0bbcd8a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:44.724597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b53f3d61-1baa-4ae9-8c25-9ddd0bbcd8a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:44.725025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b53f3d61-1baa-4ae9-8c25-9ddd0bbcd8a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:44.753146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b53f3d61-1baa-4ae9-8c25-9ddd0bbcd8a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042231 Jul 27 22:57:44.753708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 673/1357] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:44 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:45.045696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ad8d3fc3-52aa-44b4-83dd-f2e5300f40d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:45.047931 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ad8d3fc3-52aa-44b4-83dd-f2e5300f40d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:45.054442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad8d3fc3-52aa-44b4-83dd-f2e5300f40d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:45.054879 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad8d3fc3-52aa-44b4-83dd-f2e5300f40d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:45.055630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad8d3fc3-52aa-44b4-83dd-f2e5300f40d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:45.056058 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad8d3fc3-52aa-44b4-83dd-f2e5300f40d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:45.084188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ad8d3fc3-52aa-44b4-83dd-f2e5300f40d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042444 Jul 27 22:57:45.084745 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 685/1358] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:45 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:45.420968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a4b8b594-45e9-43db-a21a-c8f1660f5ab7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:45.421580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a4b8b594-45e9-43db-a21a-c8f1660f5ab7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:45.428353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4b8b594-45e9-43db-a21a-c8f1660f5ab7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:45.428832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4b8b594-45e9-43db-a21a-c8f1660f5ab7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:45.429584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4b8b594-45e9-43db-a21a-c8f1660f5ab7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:45.430010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4b8b594-45e9-43db-a21a-c8f1660f5ab7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:45.469535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-12ac3e8e-5907-49a5-8c93-8a1a84d6fbca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:45.472293 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-12ac3e8e-5907-49a5-8c93-8a1a84d6fbca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:45.479046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-12ac3e8e-5907-49a5-8c93-8a1a84d6fbca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:45.479487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-12ac3e8e-5907-49a5-8c93-8a1a84d6fbca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:45.480243 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-12ac3e8e-5907-49a5-8c93-8a1a84d6fbca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:45.480696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-12ac3e8e-5907-49a5-8c93-8a1a84d6fbca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:45.490100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a4b8b594-45e9-43db-a21a-c8f1660f5ab7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:45.497672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a4b8b594-45e9-43db-a21a-c8f1660f5ab7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080569 Jul 27 22:57:45.498235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 674/1359] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:45 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:45.510048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-12ac3e8e-5907-49a5-8c93-8a1a84d6fbca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044412 Jul 27 22:57:45.510786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 686/1360] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:45 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:45.765472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b54b7532-3fad-4aad-ad01-1cdc401587de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:45.767628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b54b7532-3fad-4aad-ad01-1cdc401587de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:45.774157 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b54b7532-3fad-4aad-ad01-1cdc401587de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:45.774605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b54b7532-3fad-4aad-ad01-1cdc401587de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:45.775362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b54b7532-3fad-4aad-ad01-1cdc401587de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:45.775796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b54b7532-3fad-4aad-ad01-1cdc401587de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:45.804090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b54b7532-3fad-4aad-ad01-1cdc401587de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042636 Jul 27 22:57:45.804649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 675/1361] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:45 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:46.096247 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3f02adfc-2ef8-48d1-b313-bf2e28a49dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:46.099050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3f02adfc-2ef8-48d1-b313-bf2e28a49dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:46.105356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3f02adfc-2ef8-48d1-b313-bf2e28a49dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:46.105811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3f02adfc-2ef8-48d1-b313-bf2e28a49dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:46.106573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3f02adfc-2ef8-48d1-b313-bf2e28a49dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:46.107041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3f02adfc-2ef8-48d1-b313-bf2e28a49dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:46.110712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:46.136189 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3f02adfc-2ef8-48d1-b313-bf2e28a49dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043888 Jul 27 22:57:46.136770 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 687/1362] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:46 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:46.517406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-144ecb10-d3e5-40e5-b4e6-83d7c0b84870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:46.517922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-144ecb10-d3e5-40e5-b4e6-83d7c0b84870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:46.521041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2a05d40a-443e-4141-b32e-e9b890448110 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:46.523188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2a05d40a-443e-4141-b32e-e9b890448110 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:46.524076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-144ecb10-d3e5-40e5-b4e6-83d7c0b84870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:46.524535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-144ecb10-d3e5-40e5-b4e6-83d7c0b84870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:46.525308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-144ecb10-d3e5-40e5-b4e6-83d7c0b84870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:46.525746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-144ecb10-d3e5-40e5-b4e6-83d7c0b84870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:46.529276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a05d40a-443e-4141-b32e-e9b890448110 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:46.529721 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a05d40a-443e-4141-b32e-e9b890448110 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:46.530483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a05d40a-443e-4141-b32e-e9b890448110 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:46.530971 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a05d40a-443e-4141-b32e-e9b890448110 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:46.559312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2a05d40a-443e-4141-b32e-e9b890448110 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042167 Jul 27 22:57:46.559871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 688/1363] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:46 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:46.586461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-144ecb10-d3e5-40e5-b4e6-83d7c0b84870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:46.593921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-144ecb10-d3e5-40e5-b4e6-83d7c0b84870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080488 Jul 27 22:57:46.594476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 676/1364] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:46 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:46.816980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-239f1c94-05eb-404f-86d2-ff93ead97f73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:46.819131 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-239f1c94-05eb-404f-86d2-ff93ead97f73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:46.825153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-239f1c94-05eb-404f-86d2-ff93ead97f73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:46.825599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-239f1c94-05eb-404f-86d2-ff93ead97f73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:46.826355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-239f1c94-05eb-404f-86d2-ff93ead97f73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:46.826783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-239f1c94-05eb-404f-86d2-ff93ead97f73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:46.854986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-239f1c94-05eb-404f-86d2-ff93ead97f73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042724 Jul 27 22:57:46.855527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 689/1365] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:47.148657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a1059037-7530-49ff-9810-1b1dd2556f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:47.150840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a1059037-7530-49ff-9810-1b1dd2556f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:47.157152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1059037-7530-49ff-9810-1b1dd2556f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:47.157600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1059037-7530-49ff-9810-1b1dd2556f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:47.158378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1059037-7530-49ff-9810-1b1dd2556f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:47.158810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1059037-7530-49ff-9810-1b1dd2556f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:47.162872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:47.188250 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a1059037-7530-49ff-9810-1b1dd2556f9a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043662 Jul 27 22:57:47.188831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 677/1366] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:47 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:47.571323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-91f0b1d0-1a63-4abd-8302-3a22f66cc580 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:47.573506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-91f0b1d0-1a63-4abd-8302-3a22f66cc580 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:47.579863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91f0b1d0-1a63-4abd-8302-3a22f66cc580 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:47.580304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91f0b1d0-1a63-4abd-8302-3a22f66cc580 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:47.581613 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91f0b1d0-1a63-4abd-8302-3a22f66cc580 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:47.582042 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91f0b1d0-1a63-4abd-8302-3a22f66cc580 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:47.610903 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-91f0b1d0-1a63-4abd-8302-3a22f66cc580 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043473 Jul 27 22:57:47.611609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 690/1367] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:47 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:47.615222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dc213f1a-6275-40a0-a6e0-f96b2cc0dbeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:47.615831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dc213f1a-6275-40a0-a6e0-f96b2cc0dbeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:47.622264 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc213f1a-6275-40a0-a6e0-f96b2cc0dbeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:47.622264 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc213f1a-6275-40a0-a6e0-f96b2cc0dbeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:47.623082 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc213f1a-6275-40a0-a6e0-f96b2cc0dbeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:47.623596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc213f1a-6275-40a0-a6e0-f96b2cc0dbeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:47.685289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dc213f1a-6275-40a0-a6e0-f96b2cc0dbeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:47.693191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dc213f1a-6275-40a0-a6e0-f96b2cc0dbeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082202 Jul 27 22:57:47.693743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 678/1368] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:47 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:57:47.867149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fdf94238-e821-4817-a8d5-8eb585f4b0a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:47.869326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fdf94238-e821-4817-a8d5-8eb585f4b0a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:47.875275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdf94238-e821-4817-a8d5-8eb585f4b0a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:47.875719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdf94238-e821-4817-a8d5-8eb585f4b0a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:47.876470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdf94238-e821-4817-a8d5-8eb585f4b0a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:47.876929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fdf94238-e821-4817-a8d5-8eb585f4b0a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:47.905865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fdf94238-e821-4817-a8d5-8eb585f4b0a6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042742 Jul 27 22:57:47.906408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 691/1369] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:48.200592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7b602f33-2764-4673-b10e-9df26000b51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:48.202725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7b602f33-2764-4673-b10e-9df26000b51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:48.208659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b602f33-2764-4673-b10e-9df26000b51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:48.209100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b602f33-2764-4673-b10e-9df26000b51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:48.209845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b602f33-2764-4673-b10e-9df26000b51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:48.210265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b602f33-2764-4673-b10e-9df26000b51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:48.238801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7b602f33-2764-4673-b10e-9df26000b51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042103 Jul 27 22:57:48.239346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 679/1370] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:48 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:48.623974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8f290748-bb34-4ee1-8072-a96b2eba0f8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:48.626227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8f290748-bb34-4ee1-8072-a96b2eba0f8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:48.632781 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f290748-bb34-4ee1-8072-a96b2eba0f8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:48.633225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f290748-bb34-4ee1-8072-a96b2eba0f8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:48.633982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f290748-bb34-4ee1-8072-a96b2eba0f8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:48.634413 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f290748-bb34-4ee1-8072-a96b2eba0f8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:48.662346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8f290748-bb34-4ee1-8072-a96b2eba0f8f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042742 Jul 27 22:57:48.662891 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 692/1371] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:48 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:48.714425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-666e0d03-2398-4ddc-af87-b61bfd15c594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:48.715024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-666e0d03-2398-4ddc-af87-b61bfd15c594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:48.720945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-666e0d03-2398-4ddc-af87-b61bfd15c594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:48.721387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-666e0d03-2398-4ddc-af87-b61bfd15c594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:48.722179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-666e0d03-2398-4ddc-af87-b61bfd15c594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:48.722604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-666e0d03-2398-4ddc-af87-b61bfd15c594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:48.787455 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-666e0d03-2398-4ddc-af87-b61bfd15c594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:48.794912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-666e0d03-2398-4ddc-af87-b61bfd15c594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084446 Jul 27 22:57:48.795489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 680/1372] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:48 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:48.918610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c9aaf73e-5b2f-403b-a510-eb5e7cb5f1f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:48.920681 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c9aaf73e-5b2f-403b-a510-eb5e7cb5f1f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:48.927114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c9aaf73e-5b2f-403b-a510-eb5e7cb5f1f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:48.927553 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c9aaf73e-5b2f-403b-a510-eb5e7cb5f1f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:48.928299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c9aaf73e-5b2f-403b-a510-eb5e7cb5f1f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:48.928759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c9aaf73e-5b2f-403b-a510-eb5e7cb5f1f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:48.956913 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c9aaf73e-5b2f-403b-a510-eb5e7cb5f1f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042359 Jul 27 22:57:48.957442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 693/1373] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:48 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:49.250631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8be8af31-7db5-47f1-bc19-38ae188f34c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:49.252718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8be8af31-7db5-47f1-bc19-38ae188f34c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:49.258654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8be8af31-7db5-47f1-bc19-38ae188f34c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:49.259095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8be8af31-7db5-47f1-bc19-38ae188f34c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:49.259840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8be8af31-7db5-47f1-bc19-38ae188f34c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:49.260265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8be8af31-7db5-47f1-bc19-38ae188f34c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:49.288127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8be8af31-7db5-47f1-bc19-38ae188f34c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041495 Jul 27 22:57:49.288679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 681/1374] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:49 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:49.674474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-16fac04b-b544-440c-aa79-ba2ed1a8932e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:49.676634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-16fac04b-b544-440c-aa79-ba2ed1a8932e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:49.683139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-16fac04b-b544-440c-aa79-ba2ed1a8932e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:49.683581 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-16fac04b-b544-440c-aa79-ba2ed1a8932e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:49.684359 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-16fac04b-b544-440c-aa79-ba2ed1a8932e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:49.684828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-16fac04b-b544-440c-aa79-ba2ed1a8932e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:49.712455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-16fac04b-b544-440c-aa79-ba2ed1a8932e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041936 Jul 27 22:57:49.713019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 694/1375] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:49 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:49.815765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4329f1ce-a9dc-44e7-ad88-768fb89466af tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:49.816428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4329f1ce-a9dc-44e7-ad88-768fb89466af tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:49.822393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4329f1ce-a9dc-44e7-ad88-768fb89466af tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:49.822830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4329f1ce-a9dc-44e7-ad88-768fb89466af tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:49.823572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4329f1ce-a9dc-44e7-ad88-768fb89466af tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:49.823996 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4329f1ce-a9dc-44e7-ad88-768fb89466af tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:49.883663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4329f1ce-a9dc-44e7-ad88-768fb89466af tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:49.890925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4329f1ce-a9dc-44e7-ad88-768fb89466af tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078954 Jul 27 22:57:49.891473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 682/1376] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:49 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:49.969299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3cb5e5cf-1597-4a3f-b2ac-95ee6401de83 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:49.971372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3cb5e5cf-1597-4a3f-b2ac-95ee6401de83 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:49.977363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3cb5e5cf-1597-4a3f-b2ac-95ee6401de83 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:49.978061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3cb5e5cf-1597-4a3f-b2ac-95ee6401de83 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:49.978819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3cb5e5cf-1597-4a3f-b2ac-95ee6401de83 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:49.979251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3cb5e5cf-1597-4a3f-b2ac-95ee6401de83 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:50.007716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3cb5e5cf-1597-4a3f-b2ac-95ee6401de83 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042599 Jul 27 22:57:50.008279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 695/1377] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:49 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:50.300636 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2979cdce-2668-435d-b819-0f31e51a4b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:50.302773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2979cdce-2668-435d-b819-0f31e51a4b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:50.304617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:50.309758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2979cdce-2668-435d-b819-0f31e51a4b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:50.310201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2979cdce-2668-435d-b819-0f31e51a4b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:50.310952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2979cdce-2668-435d-b819-0f31e51a4b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:50.311381 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2979cdce-2668-435d-b819-0f31e51a4b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:50.339759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2979cdce-2668-435d-b819-0f31e51a4b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043592 Jul 27 22:57:50.340293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 683/1378] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:50 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:50.725086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-295ebbac-d46d-4063-83e2-c66e599a57e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:50.727212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-295ebbac-d46d-4063-83e2-c66e599a57e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:50.734017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-295ebbac-d46d-4063-83e2-c66e599a57e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:50.734463 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-295ebbac-d46d-4063-83e2-c66e599a57e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:50.735230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-295ebbac-d46d-4063-83e2-c66e599a57e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:50.735663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-295ebbac-d46d-4063-83e2-c66e599a57e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:50.764183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-295ebbac-d46d-4063-83e2-c66e599a57e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043636 Jul 27 22:57:50.764755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 696/1379] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:50.911725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6c28eba2-a18b-467f-9ec3-408f7e7b0d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:50.912319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6c28eba2-a18b-467f-9ec3-408f7e7b0d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:50.918260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c28eba2-a18b-467f-9ec3-408f7e7b0d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:50.918717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c28eba2-a18b-467f-9ec3-408f7e7b0d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:50.919443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c28eba2-a18b-467f-9ec3-408f7e7b0d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:50.919869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c28eba2-a18b-467f-9ec3-408f7e7b0d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:50.978775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6c28eba2-a18b-467f-9ec3-408f7e7b0d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:50.986006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6c28eba2-a18b-467f-9ec3-408f7e7b0d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078587 Jul 27 22:57:50.986554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 684/1380] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:50 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:51.019860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bb20d356-4a5f-49b2-8621-f83d843fd729 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:51.022027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bb20d356-4a5f-49b2-8621-f83d843fd729 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:51.027990 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bb20d356-4a5f-49b2-8621-f83d843fd729 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:51.028437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bb20d356-4a5f-49b2-8621-f83d843fd729 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:51.029237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bb20d356-4a5f-49b2-8621-f83d843fd729 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:51.029668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bb20d356-4a5f-49b2-8621-f83d843fd729 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:51.058027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bb20d356-4a5f-49b2-8621-f83d843fd729 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042622 Jul 27 22:57:51.058581 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 697/1381] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:51 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:51.352458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-06688533-244c-476f-9a9d-a3def6589371 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:51.354866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-06688533-244c-476f-9a9d-a3def6589371 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:51.360977 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06688533-244c-476f-9a9d-a3def6589371 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:51.361415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06688533-244c-476f-9a9d-a3def6589371 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:51.362158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06688533-244c-476f-9a9d-a3def6589371 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:51.362865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06688533-244c-476f-9a9d-a3def6589371 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:51.391476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-06688533-244c-476f-9a9d-a3def6589371 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043035 Jul 27 22:57:51.392014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 685/1382] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:51 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:51.776377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9352ee62-fa74-4c8b-84d8-d210ad9c15fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:51.778558 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9352ee62-fa74-4c8b-84d8-d210ad9c15fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:51.780850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:51.786451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9352ee62-fa74-4c8b-84d8-d210ad9c15fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:51.786927 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9352ee62-fa74-4c8b-84d8-d210ad9c15fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:51.787695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9352ee62-fa74-4c8b-84d8-d210ad9c15fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:51.788156 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9352ee62-fa74-4c8b-84d8-d210ad9c15fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:51.817405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9352ee62-fa74-4c8b-84d8-d210ad9c15fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045038 Jul 27 22:57:51.817948 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 698/1383] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:51 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:52.008838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0a76c409-0997-495f-bc0e-8154662c7c3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:52.009382 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0a76c409-0997-495f-bc0e-8154662c7c3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:52.015242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a76c409-0997-495f-bc0e-8154662c7c3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:52.015684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a76c409-0997-495f-bc0e-8154662c7c3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:52.016496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a76c409-0997-495f-bc0e-8154662c7c3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:52.016979 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a76c409-0997-495f-bc0e-8154662c7c3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:52.071044 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4b2e8488-48ff-4dab-afaf-17d001febbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:52.073233 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4b2e8488-48ff-4dab-afaf-17d001febbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:52.076429 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0a76c409-0997-495f-bc0e-8154662c7c3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:52.079487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b2e8488-48ff-4dab-afaf-17d001febbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:52.079966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b2e8488-48ff-4dab-afaf-17d001febbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:52.080794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b2e8488-48ff-4dab-afaf-17d001febbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:52.081280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b2e8488-48ff-4dab-afaf-17d001febbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:52.084067 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0a76c409-0997-495f-bc0e-8154662c7c3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079191 Jul 27 22:57:52.084655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 686/1384] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:52 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:52.109520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4b2e8488-48ff-4dab-afaf-17d001febbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042567 Jul 27 22:57:52.110058 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 699/1385] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:52 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:57:52.403678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0a844eba-85d9-4d7e-a0e5-656c32beea76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:52.405822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0a844eba-85d9-4d7e-a0e5-656c32beea76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:52.412309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a844eba-85d9-4d7e-a0e5-656c32beea76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:52.412786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a844eba-85d9-4d7e-a0e5-656c32beea76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:52.413540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a844eba-85d9-4d7e-a0e5-656c32beea76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:52.413970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a844eba-85d9-4d7e-a0e5-656c32beea76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:52.442073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0a844eba-85d9-4d7e-a0e5-656c32beea76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042348 Jul 27 22:57:52.442608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 687/1386] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:52 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:52.829618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-329140eb-562c-4388-a816-cf43ac9483dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:52.832274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-329140eb-562c-4388-a816-cf43ac9483dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:52.838675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-329140eb-562c-4388-a816-cf43ac9483dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:52.839115 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-329140eb-562c-4388-a816-cf43ac9483dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:52.839863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-329140eb-562c-4388-a816-cf43ac9483dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:52.840290 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-329140eb-562c-4388-a816-cf43ac9483dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:52.868362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-329140eb-562c-4388-a816-cf43ac9483dc tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042738 Jul 27 22:57:52.868916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 700/1387] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:52 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:57:53.106115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-78bd2c01-5f06-4731-916a-8133a8271a9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:53.106719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-78bd2c01-5f06-4731-916a-8133a8271a9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:53.112731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78bd2c01-5f06-4731-916a-8133a8271a9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:53.113182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78bd2c01-5f06-4731-916a-8133a8271a9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:53.113958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78bd2c01-5f06-4731-916a-8133a8271a9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:53.114386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78bd2c01-5f06-4731-916a-8133a8271a9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:53.122450 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-20371a0f-e2ca-47c1-8793-2c6910d0e92f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:53.124664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-20371a0f-e2ca-47c1-8793-2c6910d0e92f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:53.131196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-20371a0f-e2ca-47c1-8793-2c6910d0e92f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:53.131647 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-20371a0f-e2ca-47c1-8793-2c6910d0e92f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:53.132658 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-20371a0f-e2ca-47c1-8793-2c6910d0e92f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:53.133105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-20371a0f-e2ca-47c1-8793-2c6910d0e92f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:53.163803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-20371a0f-e2ca-47c1-8793-2c6910d0e92f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045286 Jul 27 22:57:53.164682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 701/1388] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:53 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:57:53.177637 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-78bd2c01-5f06-4731-916a-8133a8271a9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:53.185132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-78bd2c01-5f06-4731-916a-8133a8271a9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083090 Jul 27 22:57:53.185680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 688/1389] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:53 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:53.453486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a24a0b95-38fb-4968-83b0-a722592f5ad6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:53.455640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a24a0b95-38fb-4968-83b0-a722592f5ad6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:53.461779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a24a0b95-38fb-4968-83b0-a722592f5ad6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:53.462225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a24a0b95-38fb-4968-83b0-a722592f5ad6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:53.462986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a24a0b95-38fb-4968-83b0-a722592f5ad6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:53.463419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a24a0b95-38fb-4968-83b0-a722592f5ad6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:53.492010 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a24a0b95-38fb-4968-83b0-a722592f5ad6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042529 Jul 27 22:57:53.492608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 702/1390] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:53 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:53.880605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-160ed1bd-c503-43b4-9d3b-af99605a49a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:53.882759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-160ed1bd-c503-43b4-9d3b-af99605a49a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:53.888816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-160ed1bd-c503-43b4-9d3b-af99605a49a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:53.889264 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-160ed1bd-c503-43b4-9d3b-af99605a49a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:53.890016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-160ed1bd-c503-43b4-9d3b-af99605a49a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:53.890447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-160ed1bd-c503-43b4-9d3b-af99605a49a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:53.918774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-160ed1bd-c503-43b4-9d3b-af99605a49a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042191 Jul 27 22:57:53.919318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 689/1391] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:53 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:54.175655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-98d26c96-2574-434b-b438-f783b457bf01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:54.177881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-98d26c96-2574-434b-b438-f783b457bf01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:54.184460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-98d26c96-2574-434b-b438-f783b457bf01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:54.184945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-98d26c96-2574-434b-b438-f783b457bf01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:54.185710 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-98d26c96-2574-434b-b438-f783b457bf01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:54.186147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-98d26c96-2574-434b-b438-f783b457bf01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:54.206678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-28dfd93d-95b7-436c-b2be-c8bd322a0bda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:54.207277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-28dfd93d-95b7-436c-b2be-c8bd322a0bda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:54.210872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:54.213791 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-28dfd93d-95b7-436c-b2be-c8bd322a0bda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:54.214229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-28dfd93d-95b7-436c-b2be-c8bd322a0bda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:54.214981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-28dfd93d-95b7-436c-b2be-c8bd322a0bda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:54.215402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-28dfd93d-95b7-436c-b2be-c8bd322a0bda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:54.216046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-98d26c96-2574-434b-b438-f783b457bf01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044501 Jul 27 22:57:54.216639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 703/1392] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:54 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:54.275507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-28dfd93d-95b7-436c-b2be-c8bd322a0bda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:54.282751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-28dfd93d-95b7-436c-b2be-c8bd322a0bda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080429 Jul 27 22:57:54.283301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 690/1393] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:54 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:54.506001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7415bd5b-a719-4547-9273-f49022347a4e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:54.508129 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7415bd5b-a719-4547-9273-f49022347a4e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:54.514374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7415bd5b-a719-4547-9273-f49022347a4e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:54.514824 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7415bd5b-a719-4547-9273-f49022347a4e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:54.515594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7415bd5b-a719-4547-9273-f49022347a4e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:54.516062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7415bd5b-a719-4547-9273-f49022347a4e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:54.546058 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7415bd5b-a719-4547-9273-f49022347a4e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044565 Jul 27 22:57:54.546615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 704/1394] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:54 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:54.931492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d2b86bdd-3f30-4814-8e50-c1b83c2aa216 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:54.933670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d2b86bdd-3f30-4814-8e50-c1b83c2aa216 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:54.939588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2b86bdd-3f30-4814-8e50-c1b83c2aa216 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:54.940029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2b86bdd-3f30-4814-8e50-c1b83c2aa216 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:54.941454 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2b86bdd-3f30-4814-8e50-c1b83c2aa216 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:54.941887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2b86bdd-3f30-4814-8e50-c1b83c2aa216 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:54.969095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d2b86bdd-3f30-4814-8e50-c1b83c2aa216 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041564 Jul 27 22:57:54.969627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 691/1395] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:54 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:55.228711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c2f348cb-97db-4fad-8dcf-90b651e4af3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:55.230798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c2f348cb-97db-4fad-8dcf-90b651e4af3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:55.237836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c2f348cb-97db-4fad-8dcf-90b651e4af3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:55.238287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c2f348cb-97db-4fad-8dcf-90b651e4af3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:55.239043 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c2f348cb-97db-4fad-8dcf-90b651e4af3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:55.239474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c2f348cb-97db-4fad-8dcf-90b651e4af3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:55.267133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c2f348cb-97db-4fad-8dcf-90b651e4af3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042748 Jul 27 22:57:55.267670 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 705/1396] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:55 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:55.303691 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-77e37eee-177f-4d16-a91d-2ffcd6f80374 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:55.304399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-77e37eee-177f-4d16-a91d-2ffcd6f80374 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:55.310361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-77e37eee-177f-4d16-a91d-2ffcd6f80374 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:55.310805 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-77e37eee-177f-4d16-a91d-2ffcd6f80374 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:55.311556 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-77e37eee-177f-4d16-a91d-2ffcd6f80374 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:55.311985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-77e37eee-177f-4d16-a91d-2ffcd6f80374 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:55.371710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-77e37eee-177f-4d16-a91d-2ffcd6f80374 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:55.379085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-77e37eee-177f-4d16-a91d-2ffcd6f80374 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079817 Jul 27 22:57:55.379639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 692/1397] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:55 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:55.558329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c83d10f3-4817-4003-afa6-f219968a1088 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:55.560512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c83d10f3-4817-4003-afa6-f219968a1088 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:55.566521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c83d10f3-4817-4003-afa6-f219968a1088 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:55.566967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c83d10f3-4817-4003-afa6-f219968a1088 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:55.567724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c83d10f3-4817-4003-afa6-f219968a1088 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:55.568156 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c83d10f3-4817-4003-afa6-f219968a1088 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:55.596442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c83d10f3-4817-4003-afa6-f219968a1088 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042066 Jul 27 22:57:55.597599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 706/1398] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:55 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:55.981827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-42e34fb6-0826-48d1-91a9-2dac6b500b38 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:55.983901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-42e34fb6-0826-48d1-91a9-2dac6b500b38 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:55.989983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42e34fb6-0826-48d1-91a9-2dac6b500b38 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:55.990428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42e34fb6-0826-48d1-91a9-2dac6b500b38 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:55.991181 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42e34fb6-0826-48d1-91a9-2dac6b500b38 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:55.991618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42e34fb6-0826-48d1-91a9-2dac6b500b38 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:56.015595 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:56.021417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-42e34fb6-0826-48d1-91a9-2dac6b500b38 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Jul 27 22:57:56.021981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 693/1399] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:55 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:56.279559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-330b3337-89a2-42b9-98ec-8bf504033418 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:56.281707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-330b3337-89a2-42b9-98ec-8bf504033418 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:56.288098 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-330b3337-89a2-42b9-98ec-8bf504033418 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:56.288567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-330b3337-89a2-42b9-98ec-8bf504033418 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:56.289335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-330b3337-89a2-42b9-98ec-8bf504033418 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:56.289763 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-330b3337-89a2-42b9-98ec-8bf504033418 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:56.320307 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-330b3337-89a2-42b9-98ec-8bf504033418 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044747 Jul 27 22:57:56.320921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 707/1400] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:56.399041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-10383b35-333e-42a2-aea8-670f87f97b2b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:56.399650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-10383b35-333e-42a2-aea8-670f87f97b2b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:56.405648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10383b35-333e-42a2-aea8-670f87f97b2b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:56.406093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10383b35-333e-42a2-aea8-670f87f97b2b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:56.406851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10383b35-333e-42a2-aea8-670f87f97b2b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:56.407280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10383b35-333e-42a2-aea8-670f87f97b2b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:56.466430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-10383b35-333e-42a2-aea8-670f87f97b2b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:56.473783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-10383b35-333e-42a2-aea8-670f87f97b2b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078895 Jul 27 22:57:56.474334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 694/1401] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:56 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:56.609434 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c302700f-412f-4aa0-94f7-0dc1b6df5fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:56.611600 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c302700f-412f-4aa0-94f7-0dc1b6df5fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:56.618276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c302700f-412f-4aa0-94f7-0dc1b6df5fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:56.618723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c302700f-412f-4aa0-94f7-0dc1b6df5fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:56.619483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c302700f-412f-4aa0-94f7-0dc1b6df5fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:56.619915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c302700f-412f-4aa0-94f7-0dc1b6df5fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:56.648213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c302700f-412f-4aa0-94f7-0dc1b6df5fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042764 Jul 27 22:57:56.648776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 708/1402] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:56 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:57.033623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-57b35680-d1c1-4423-99a0-36ce0abb6047 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:57.036273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-57b35680-d1c1-4423-99a0-36ce0abb6047 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:57.042335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-57b35680-d1c1-4423-99a0-36ce0abb6047 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:57.042770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-57b35680-d1c1-4423-99a0-36ce0abb6047 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:57.043513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-57b35680-d1c1-4423-99a0-36ce0abb6047 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:57.043978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-57b35680-d1c1-4423-99a0-36ce0abb6047 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:57.071672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-57b35680-d1c1-4423-99a0-36ce0abb6047 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042042 Jul 27 22:57:57.072216 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 695/1403] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:57 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:57.333320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-29c49e41-cf89-40b1-8a6b-a1ddbc0a6767 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:57.335443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-29c49e41-cf89-40b1-8a6b-a1ddbc0a6767 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:57.341946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-29c49e41-cf89-40b1-8a6b-a1ddbc0a6767 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:57.342385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-29c49e41-cf89-40b1-8a6b-a1ddbc0a6767 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:57.343136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-29c49e41-cf89-40b1-8a6b-a1ddbc0a6767 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:57.343564 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-29c49e41-cf89-40b1-8a6b-a1ddbc0a6767 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:57.372367 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-29c49e41-cf89-40b1-8a6b-a1ddbc0a6767 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043638 Jul 27 22:57:57.372943 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 709/1404] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:57 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:57.495536 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e91a913c-30bb-4592-baf5-344366c24dc7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:57.496139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e91a913c-30bb-4592-baf5-344366c24dc7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:57.502139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e91a913c-30bb-4592-baf5-344366c24dc7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:57.502586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e91a913c-30bb-4592-baf5-344366c24dc7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:57.503864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e91a913c-30bb-4592-baf5-344366c24dc7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:57.504296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e91a913c-30bb-4592-baf5-344366c24dc7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:57.565901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e91a913c-30bb-4592-baf5-344366c24dc7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:57.573259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e91a913c-30bb-4592-baf5-344366c24dc7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081563 Jul 27 22:57:57.573816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 696/1405] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:57 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:57.660355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c4f0da04-cd40-41d7-a377-abcd58989dc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:57.662461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c4f0da04-cd40-41d7-a377-abcd58989dc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:57.668807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4f0da04-cd40-41d7-a377-abcd58989dc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:57.668936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4f0da04-cd40-41d7-a377-abcd58989dc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:57.669605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4f0da04-cd40-41d7-a377-abcd58989dc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:57.670029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4f0da04-cd40-41d7-a377-abcd58989dc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:57.698759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c4f0da04-cd40-41d7-a377-abcd58989dc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042430 Jul 27 22:57:57.699297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 710/1406] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:57 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:58.083873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-52ee9425-607b-42b1-808c-100422afe67d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:58.086065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-52ee9425-607b-42b1-808c-100422afe67d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:58.092055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52ee9425-607b-42b1-808c-100422afe67d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:58.092505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52ee9425-607b-42b1-808c-100422afe67d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:58.093289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52ee9425-607b-42b1-808c-100422afe67d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:58.093730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52ee9425-607b-42b1-808c-100422afe67d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:58.121910 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-52ee9425-607b-42b1-808c-100422afe67d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042600 Jul 27 22:57:58.122455 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 697/1407] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:58 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:58.385225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b86459ff-7021-4d7f-b625-d170a42f9de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:58.387307 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b86459ff-7021-4d7f-b625-d170a42f9de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:58.394538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b86459ff-7021-4d7f-b625-d170a42f9de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:58.394977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b86459ff-7021-4d7f-b625-d170a42f9de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:58.395725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b86459ff-7021-4d7f-b625-d170a42f9de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:58.396148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b86459ff-7021-4d7f-b625-d170a42f9de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:58.423836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b86459ff-7021-4d7f-b625-d170a42f9de7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042716 Jul 27 22:57:58.424370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 711/1408] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:58.594470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bca8002c-dfe1-4f59-9b80-6ea77ac910b6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:58.595067 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bca8002c-dfe1-4f59-9b80-6ea77ac910b6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:58.601154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bca8002c-dfe1-4f59-9b80-6ea77ac910b6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:58.601589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bca8002c-dfe1-4f59-9b80-6ea77ac910b6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:58.602332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bca8002c-dfe1-4f59-9b80-6ea77ac910b6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:58.603027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bca8002c-dfe1-4f59-9b80-6ea77ac910b6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:58.662976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bca8002c-dfe1-4f59-9b80-6ea77ac910b6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:58.670235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bca8002c-dfe1-4f59-9b80-6ea77ac910b6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079650 Jul 27 22:57:58.670786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 698/1409] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:58 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:58.711433 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2a7673e8-2862-470f-9cec-548c751c3fa7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:58.714071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2a7673e8-2862-470f-9cec-548c751c3fa7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:58.719932 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a7673e8-2862-470f-9cec-548c751c3fa7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:58.720379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a7673e8-2862-470f-9cec-548c751c3fa7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:58.721165 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a7673e8-2862-470f-9cec-548c751c3fa7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:58.721655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a7673e8-2862-470f-9cec-548c751c3fa7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:58.750565 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2a7673e8-2862-470f-9cec-548c751c3fa7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043040 Jul 27 22:57:58.751108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 712/1410] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:58 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:59.134105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d901a87b-50d7-4f1d-ae7c-24e1c4ca9f36 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:59.136232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d901a87b-50d7-4f1d-ae7c-24e1c4ca9f36 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:59.142275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d901a87b-50d7-4f1d-ae7c-24e1c4ca9f36 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:59.142715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d901a87b-50d7-4f1d-ae7c-24e1c4ca9f36 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:59.143474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d901a87b-50d7-4f1d-ae7c-24e1c4ca9f36 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:59.143901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d901a87b-50d7-4f1d-ae7c-24e1c4ca9f36 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:59.172957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d901a87b-50d7-4f1d-ae7c-24e1c4ca9f36 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042768 Jul 27 22:57:59.173520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 699/1411] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:59 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:57:59.435914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c166d78e-4ff4-416f-aae2-1a3c846c2626 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:59.438005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c166d78e-4ff4-416f-aae2-1a3c846c2626 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:59.444474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c166d78e-4ff4-416f-aae2-1a3c846c2626 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:59.444956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c166d78e-4ff4-416f-aae2-1a3c846c2626 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:59.445719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c166d78e-4ff4-416f-aae2-1a3c846c2626 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:59.446153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c166d78e-4ff4-416f-aae2-1a3c846c2626 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:59.475904 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c166d78e-4ff4-416f-aae2-1a3c846c2626 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044066 Jul 27 22:57:59.476456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 713/1412] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:57:59 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:57:59.691793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-11770b1e-dd2b-4ceb-9341-febb9afde7a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:59.692343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-11770b1e-dd2b-4ceb-9341-febb9afde7a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:59.698394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11770b1e-dd2b-4ceb-9341-febb9afde7a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:59.698839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11770b1e-dd2b-4ceb-9341-febb9afde7a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:59.699595 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11770b1e-dd2b-4ceb-9341-febb9afde7a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:59.700033 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11770b1e-dd2b-4ceb-9341-febb9afde7a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:59.759446 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-11770b1e-dd2b-4ceb-9341-febb9afde7a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:57:59.763331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-63560b42-93a0-46d6-9540-d64879d1c1f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:57:59.765558 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-63560b42-93a0-46d6-9540-d64879d1c1f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:57:59.766978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-11770b1e-dd2b-4ceb-9341-febb9afde7a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079550 Jul 27 22:57:59.767542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 700/1413] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:57:59 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:57:59.782183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63560b42-93a0-46d6-9540-d64879d1c1f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:59.782629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63560b42-93a0-46d6-9540-d64879d1c1f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:59.783393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63560b42-93a0-46d6-9540-d64879d1c1f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:57:59.783828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63560b42-93a0-46d6-9540-d64879d1c1f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:57:59.811668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-63560b42-93a0-46d6-9540-d64879d1c1f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052256 Jul 27 22:57:59.812204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 714/1414] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:57:59 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:58:00.186390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5dbf83de-91a5-4e4b-9135-cb6ad6638540 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:00.188493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5dbf83de-91a5-4e4b-9135-cb6ad6638540 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:00.195974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5dbf83de-91a5-4e4b-9135-cb6ad6638540 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:00.196414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5dbf83de-91a5-4e4b-9135-cb6ad6638540 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:00.197196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5dbf83de-91a5-4e4b-9135-cb6ad6638540 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:00.197621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5dbf83de-91a5-4e4b-9135-cb6ad6638540 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:00.366266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5dbf83de-91a5-4e4b-9135-cb6ad6638540 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183756 Jul 27 22:58:00.366803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 701/1415] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:00 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:00.489181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c7e0d001-e00d-49c3-9dbb-f457c864e263 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:00.491256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c7e0d001-e00d-49c3-9dbb-f457c864e263 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:00.497617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c7e0d001-e00d-49c3-9dbb-f457c864e263 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:00.498056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c7e0d001-e00d-49c3-9dbb-f457c864e263 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:00.498802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c7e0d001-e00d-49c3-9dbb-f457c864e263 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:00.499229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c7e0d001-e00d-49c3-9dbb-f457c864e263 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:00.527831 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c7e0d001-e00d-49c3-9dbb-f457c864e263 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043411 Jul 27 22:58:00.528370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 715/1416] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:00 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:00.788788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fe0a2cff-9900-4354-8170-38c5d51c3fd3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:00.789426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fe0a2cff-9900-4354-8170-38c5d51c3fd3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:00.795319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fe0a2cff-9900-4354-8170-38c5d51c3fd3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:00.795787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fe0a2cff-9900-4354-8170-38c5d51c3fd3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:00.796541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fe0a2cff-9900-4354-8170-38c5d51c3fd3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:00.796991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fe0a2cff-9900-4354-8170-38c5d51c3fd3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:00.823365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a6930b05-5d7b-4a7b-bf7d-c20c4d122137 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:00.825551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a6930b05-5d7b-4a7b-bf7d-c20c4d122137 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:00.832107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a6930b05-5d7b-4a7b-bf7d-c20c4d122137 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:00.832572 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a6930b05-5d7b-4a7b-bf7d-c20c4d122137 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:00.833343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a6930b05-5d7b-4a7b-bf7d-c20c4d122137 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:00.833782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a6930b05-5d7b-4a7b-bf7d-c20c4d122137 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:00.858214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fe0a2cff-9900-4354-8170-38c5d51c3fd3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:00.863377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a6930b05-5d7b-4a7b-bf7d-c20c4d122137 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Jul 27 22:58:00.863939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 716/1417] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:00 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:58:00.865608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fe0a2cff-9900-4354-8170-38c5d51c3fd3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080626 Jul 27 22:58:00.866225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 702/1418] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:00 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:01.378988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8d0f4589-b923-4c57-ac0c-5c2f30c5870e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:01.381164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8d0f4589-b923-4c57-ac0c-5c2f30c5870e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:01.387213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d0f4589-b923-4c57-ac0c-5c2f30c5870e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:01.387659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d0f4589-b923-4c57-ac0c-5c2f30c5870e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:01.388417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d0f4589-b923-4c57-ac0c-5c2f30c5870e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:01.388889 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d0f4589-b923-4c57-ac0c-5c2f30c5870e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:01.417085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8d0f4589-b923-4c57-ac0c-5c2f30c5870e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042429 Jul 27 22:58:01.417558 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 717/1419] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:01 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:01.539732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-43373250-fd69-4bec-930e-5a2154663fc2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:01.541903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-43373250-fd69-4bec-930e-5a2154663fc2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:01.547939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43373250-fd69-4bec-930e-5a2154663fc2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:01.548385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43373250-fd69-4bec-930e-5a2154663fc2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:01.549179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43373250-fd69-4bec-930e-5a2154663fc2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:01.550128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43373250-fd69-4bec-930e-5a2154663fc2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:01.578363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-43373250-fd69-4bec-930e-5a2154663fc2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042594 Jul 27 22:58:01.578896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 703/1420] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:01 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:01.875359 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-59126b4b-7ebc-42a1-9baa-1b76003288c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:01.877517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-59126b4b-7ebc-42a1-9baa-1b76003288c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:01.884514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-59126b4b-7ebc-42a1-9baa-1b76003288c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:01.884989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-59126b4b-7ebc-42a1-9baa-1b76003288c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:01.885372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-df90a5b5-9e76-4c91-a159-d859fb665988 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:01.885775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-59126b4b-7ebc-42a1-9baa-1b76003288c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:01.885981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-df90a5b5-9e76-4c91-a159-d859fb665988 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:01.886188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-59126b4b-7ebc-42a1-9baa-1b76003288c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:01.891826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df90a5b5-9e76-4c91-a159-d859fb665988 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:01.892266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df90a5b5-9e76-4c91-a159-d859fb665988 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:01.893059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df90a5b5-9e76-4c91-a159-d859fb665988 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:01.893488 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df90a5b5-9e76-4c91-a159-d859fb665988 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:01.915239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-59126b4b-7ebc-42a1-9baa-1b76003288c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043822 Jul 27 22:58:01.915788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 718/1421] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:01 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:01.955928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-df90a5b5-9e76-4c91-a159-d859fb665988 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:01.963395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-df90a5b5-9e76-4c91-a159-d859fb665988 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081786 Jul 27 22:58:01.963945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 704/1422] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:01 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:58:02.429404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ebafc2bd-d17e-4b0d-9d34-1881288959a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:02.431656 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ebafc2bd-d17e-4b0d-9d34-1881288959a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:02.437675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebafc2bd-d17e-4b0d-9d34-1881288959a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:02.438123 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebafc2bd-d17e-4b0d-9d34-1881288959a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:02.438882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebafc2bd-d17e-4b0d-9d34-1881288959a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:02.439315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebafc2bd-d17e-4b0d-9d34-1881288959a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:02.467021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ebafc2bd-d17e-4b0d-9d34-1881288959a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041603 Jul 27 22:58:02.467554 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 719/1423] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:02 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:02.590486 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-481a40ce-1470-4c2d-b106-f781fe55b55a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:02.592619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-481a40ce-1470-4c2d-b106-f781fe55b55a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:02.599124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-481a40ce-1470-4c2d-b106-f781fe55b55a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:02.599566 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-481a40ce-1470-4c2d-b106-f781fe55b55a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:02.600318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-481a40ce-1470-4c2d-b106-f781fe55b55a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:02.600778 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-481a40ce-1470-4c2d-b106-f781fe55b55a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:02.628786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-481a40ce-1470-4c2d-b106-f781fe55b55a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042195 Jul 27 22:58:02.629320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 705/1424] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:02 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:02.927848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-368db423-845d-43cb-8a11-6691b0ea97de tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:02.930016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-368db423-845d-43cb-8a11-6691b0ea97de tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:02.936467 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-368db423-845d-43cb-8a11-6691b0ea97de tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:02.936946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-368db423-845d-43cb-8a11-6691b0ea97de tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:02.937703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-368db423-845d-43cb-8a11-6691b0ea97de tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:02.938136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-368db423-845d-43cb-8a11-6691b0ea97de tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:02.954173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:02.967965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-368db423-845d-43cb-8a11-6691b0ea97de tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044672 Jul 27 22:58:02.968524 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 720/1425] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:02 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:02.984709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d31b5d0a-f9df-40c4-ac56-d1ee88480237 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:02.985309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d31b5d0a-f9df-40c4-ac56-d1ee88480237 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:02.991793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d31b5d0a-f9df-40c4-ac56-d1ee88480237 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:02.992227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d31b5d0a-f9df-40c4-ac56-d1ee88480237 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:02.993023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d31b5d0a-f9df-40c4-ac56-d1ee88480237 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:02.993448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d31b5d0a-f9df-40c4-ac56-d1ee88480237 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:03.052426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d31b5d0a-f9df-40c4-ac56-d1ee88480237 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:03.059786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d31b5d0a-f9df-40c4-ac56-d1ee88480237 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078945 Jul 27 22:58:03.060342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 706/1426] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:02 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:03.480136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9fec92c8-13ae-42ca-bce6-29a2f5ae9a17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:03.482354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9fec92c8-13ae-42ca-bce6-29a2f5ae9a17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:03.488423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9fec92c8-13ae-42ca-bce6-29a2f5ae9a17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:03.488900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9fec92c8-13ae-42ca-bce6-29a2f5ae9a17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:03.489661 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9fec92c8-13ae-42ca-bce6-29a2f5ae9a17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:03.490098 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9fec92c8-13ae-42ca-bce6-29a2f5ae9a17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:03.519181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9fec92c8-13ae-42ca-bce6-29a2f5ae9a17 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042686 Jul 27 22:58:03.519722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 721/1427] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:03 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:03.640877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-afd8b697-0cab-4787-8333-626092e4860b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:03.643003 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-afd8b697-0cab-4787-8333-626092e4860b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:03.649530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afd8b697-0cab-4787-8333-626092e4860b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:03.649961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afd8b697-0cab-4787-8333-626092e4860b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:03.650706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afd8b697-0cab-4787-8333-626092e4860b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:03.651131 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afd8b697-0cab-4787-8333-626092e4860b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:03.679002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-afd8b697-0cab-4787-8333-626092e4860b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041972 Jul 27 22:58:03.679537 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 707/1428] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:03.981162 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-61b13cbf-d6c5-467a-8f01-cb5d5f4e84e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:03.983374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-61b13cbf-d6c5-467a-8f01-cb5d5f4e84e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:03.990284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-61b13cbf-d6c5-467a-8f01-cb5d5f4e84e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:03.990729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-61b13cbf-d6c5-467a-8f01-cb5d5f4e84e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:03.991484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-61b13cbf-d6c5-467a-8f01-cb5d5f4e84e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:03.991916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-61b13cbf-d6c5-467a-8f01-cb5d5f4e84e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:04.020403 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-61b13cbf-d6c5-467a-8f01-cb5d5f4e84e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043469 Jul 27 22:58:04.020972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 722/1429] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:03 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:04.080005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-18515e35-5697-45ae-a5b1-db28b1f219de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:04.080640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-18515e35-5697-45ae-a5b1-db28b1f219de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:04.086638 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18515e35-5697-45ae-a5b1-db28b1f219de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:04.087078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18515e35-5697-45ae-a5b1-db28b1f219de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:04.087823 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18515e35-5697-45ae-a5b1-db28b1f219de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:04.088249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18515e35-5697-45ae-a5b1-db28b1f219de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:04.152328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-18515e35-5697-45ae-a5b1-db28b1f219de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:04.160684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-18515e35-5697-45ae-a5b1-db28b1f219de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084330 Jul 27 22:58:04.161242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 708/1430] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:04 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:04.531444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a4d736c9-a81b-4e4b-bc23-6758c0d2dd12 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:04.533644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a4d736c9-a81b-4e4b-bc23-6758c0d2dd12 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:04.540349 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a4d736c9-a81b-4e4b-bc23-6758c0d2dd12 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:04.540942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a4d736c9-a81b-4e4b-bc23-6758c0d2dd12 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:04.542523 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a4d736c9-a81b-4e4b-bc23-6758c0d2dd12 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:04.542968 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a4d736c9-a81b-4e4b-bc23-6758c0d2dd12 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:04.571748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a4d736c9-a81b-4e4b-bc23-6758c0d2dd12 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044344 Jul 27 22:58:04.572272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 723/1431] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:04 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:04.691066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6b353748-cef5-4698-9018-19ab1c8accde tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:04.693209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6b353748-cef5-4698-9018-19ab1c8accde tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:04.699140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b353748-cef5-4698-9018-19ab1c8accde tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:04.699576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b353748-cef5-4698-9018-19ab1c8accde tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:04.700320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b353748-cef5-4698-9018-19ab1c8accde tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:04.700772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b353748-cef5-4698-9018-19ab1c8accde tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:04.730174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6b353748-cef5-4698-9018-19ab1c8accde tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043082 Jul 27 22:58:04.730707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 709/1432] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:04 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:05.032246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8d890c3d-8ec1-4aee-b986-817758a42cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:05.034463 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8d890c3d-8ec1-4aee-b986-817758a42cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:05.040860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d890c3d-8ec1-4aee-b986-817758a42cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:05.041303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d890c3d-8ec1-4aee-b986-817758a42cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:05.042049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d890c3d-8ec1-4aee-b986-817758a42cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:05.042474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d890c3d-8ec1-4aee-b986-817758a42cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:05.070801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8d890c3d-8ec1-4aee-b986-817758a42cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042494 Jul 27 22:58:05.071334 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 724/1433] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:05 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:05.181345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6133504d-c888-4ef7-a6cb-ae5aef5e287a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:05.181948 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6133504d-c888-4ef7-a6cb-ae5aef5e287a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:05.187912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6133504d-c888-4ef7-a6cb-ae5aef5e287a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:05.188349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6133504d-c888-4ef7-a6cb-ae5aef5e287a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:05.189133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6133504d-c888-4ef7-a6cb-ae5aef5e287a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:05.189561 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6133504d-c888-4ef7-a6cb-ae5aef5e287a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:05.207756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:05.250829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6133504d-c888-4ef7-a6cb-ae5aef5e287a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:05.258655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6133504d-c888-4ef7-a6cb-ae5aef5e287a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081284 Jul 27 22:58:05.259206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 710/1434] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:05 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:05.583627 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1cccf891-699e-4a9a-86cb-2222d166675e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:05.585883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1cccf891-699e-4a9a-86cb-2222d166675e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:05.591897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1cccf891-699e-4a9a-86cb-2222d166675e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:05.592355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1cccf891-699e-4a9a-86cb-2222d166675e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:05.593159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1cccf891-699e-4a9a-86cb-2222d166675e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:05.593598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1cccf891-699e-4a9a-86cb-2222d166675e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:05.622037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1cccf891-699e-4a9a-86cb-2222d166675e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042929 Jul 27 22:58:05.622579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 725/1435] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:05 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:05.742528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d5138ddc-cfe0-45a8-b0c7-e41d5f33c328 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:05.744677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d5138ddc-cfe0-45a8-b0c7-e41d5f33c328 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:05.750678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d5138ddc-cfe0-45a8-b0c7-e41d5f33c328 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:05.751125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d5138ddc-cfe0-45a8-b0c7-e41d5f33c328 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:05.751885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d5138ddc-cfe0-45a8-b0c7-e41d5f33c328 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:05.752320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d5138ddc-cfe0-45a8-b0c7-e41d5f33c328 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:05.781408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d5138ddc-cfe0-45a8-b0c7-e41d5f33c328 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042865 Jul 27 22:58:05.781951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 711/1436] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:05 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:06.082922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c1aa4b3a-8bb7-4cc2-8689-2b9fb6de1cfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:06.085114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c1aa4b3a-8bb7-4cc2-8689-2b9fb6de1cfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:06.091513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c1aa4b3a-8bb7-4cc2-8689-2b9fb6de1cfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:06.091962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c1aa4b3a-8bb7-4cc2-8689-2b9fb6de1cfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:06.092763 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c1aa4b3a-8bb7-4cc2-8689-2b9fb6de1cfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:06.093201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c1aa4b3a-8bb7-4cc2-8689-2b9fb6de1cfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:06.121831 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c1aa4b3a-8bb7-4cc2-8689-2b9fb6de1cfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042848 Jul 27 22:58:06.122373 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 726/1437] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:06 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:06.281112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6bf7e37b-b6dc-4147-81be-70925770b484 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:06.281724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6bf7e37b-b6dc-4147-81be-70925770b484 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:06.287784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bf7e37b-b6dc-4147-81be-70925770b484 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:06.288231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bf7e37b-b6dc-4147-81be-70925770b484 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:06.289031 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bf7e37b-b6dc-4147-81be-70925770b484 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:06.289465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bf7e37b-b6dc-4147-81be-70925770b484 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:06.353175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6bf7e37b-b6dc-4147-81be-70925770b484 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:06.360597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6bf7e37b-b6dc-4147-81be-70925770b484 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083274 Jul 27 22:58:06.361151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 712/1438] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:06 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:06.633586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-316ac62b-31bd-468c-b485-368a98440699 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:06.635680 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-316ac62b-31bd-468c-b485-368a98440699 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:06.641725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-316ac62b-31bd-468c-b485-368a98440699 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:06.642175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-316ac62b-31bd-468c-b485-368a98440699 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:06.642937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-316ac62b-31bd-468c-b485-368a98440699 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:06.643380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-316ac62b-31bd-468c-b485-368a98440699 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:06.671092 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-316ac62b-31bd-468c-b485-368a98440699 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041601 Jul 27 22:58:06.671637 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 727/1439] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:06 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:06.797785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5a76a3ef-2dc3-4dbf-8d36-91a9abe05eb9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:06.799894 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5a76a3ef-2dc3-4dbf-8d36-91a9abe05eb9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:06.805886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a76a3ef-2dc3-4dbf-8d36-91a9abe05eb9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:06.806322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a76a3ef-2dc3-4dbf-8d36-91a9abe05eb9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:06.807066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a76a3ef-2dc3-4dbf-8d36-91a9abe05eb9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:06.807491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a76a3ef-2dc3-4dbf-8d36-91a9abe05eb9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:06.836417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5a76a3ef-2dc3-4dbf-8d36-91a9abe05eb9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042533 Jul 27 22:58:06.836994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 713/1440] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:07.134636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a0233b56-d532-450e-8114-f76e6171053c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:07.136823 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a0233b56-d532-450e-8114-f76e6171053c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:07.143295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a0233b56-d532-450e-8114-f76e6171053c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:07.143738 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a0233b56-d532-450e-8114-f76e6171053c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:07.144494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a0233b56-d532-450e-8114-f76e6171053c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:07.144955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a0233b56-d532-450e-8114-f76e6171053c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:07.174028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a0233b56-d532-450e-8114-f76e6171053c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043350 Jul 27 22:58:07.175131 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 728/1441] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:07 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:07.380728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-44785b52-64aa-42a9-9d44-8269f12306bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:07.381354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-44785b52-64aa-42a9-9d44-8269f12306bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:07.387353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44785b52-64aa-42a9-9d44-8269f12306bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:07.387720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44785b52-64aa-42a9-9d44-8269f12306bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:07.388462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44785b52-64aa-42a9-9d44-8269f12306bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:07.388918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-44785b52-64aa-42a9-9d44-8269f12306bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:07.448047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-44785b52-64aa-42a9-9d44-8269f12306bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:07.455323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-44785b52-64aa-42a9-9d44-8269f12306bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078428 Jul 27 22:58:07.455876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 714/1442] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:07 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:07.457814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 22:58:07.458088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 22:58:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 22:58:07.684366 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8a46a839-5d13-4c6c-ac65-78c866129eed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:07.686564 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8a46a839-5d13-4c6c-ac65-78c866129eed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:07.692633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8a46a839-5d13-4c6c-ac65-78c866129eed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:07.693078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8a46a839-5d13-4c6c-ac65-78c866129eed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:07.693834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8a46a839-5d13-4c6c-ac65-78c866129eed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:07.694268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8a46a839-5d13-4c6c-ac65-78c866129eed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:07.723460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8a46a839-5d13-4c6c-ac65-78c866129eed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043150 Jul 27 22:58:07.723994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 729/1443] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:07 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:07.848959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-43357574-8e66-4d69-8f74-e7fbab65a903 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:07.851070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-43357574-8e66-4d69-8f74-e7fbab65a903 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:07.857235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43357574-8e66-4d69-8f74-e7fbab65a903 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:07.857668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43357574-8e66-4d69-8f74-e7fbab65a903 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:07.858408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43357574-8e66-4d69-8f74-e7fbab65a903 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:07.858831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43357574-8e66-4d69-8f74-e7fbab65a903 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:07.886543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-43357574-8e66-4d69-8f74-e7fbab65a903 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042158 Jul 27 22:58:07.887070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 715/1444] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:07 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:08.187005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-334e6d53-bc07-44df-a3f5-75cd763318b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:08.189220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-334e6d53-bc07-44df-a3f5-75cd763318b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:08.196130 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-334e6d53-bc07-44df-a3f5-75cd763318b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:08.196593 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-334e6d53-bc07-44df-a3f5-75cd763318b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:08.197348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-334e6d53-bc07-44df-a3f5-75cd763318b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:08.197775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-334e6d53-bc07-44df-a3f5-75cd763318b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:08.225880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-334e6d53-bc07-44df-a3f5-75cd763318b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042949 Jul 27 22:58:08.226409 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 730/1445] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:08 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:08.475707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d35dc4bd-6131-4539-9331-cf82aa2fb417 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:08.476288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d35dc4bd-6131-4539-9331-cf82aa2fb417 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:08.482496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d35dc4bd-6131-4539-9331-cf82aa2fb417 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:08.482935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d35dc4bd-6131-4539-9331-cf82aa2fb417 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:08.483722 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d35dc4bd-6131-4539-9331-cf82aa2fb417 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:08.484154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d35dc4bd-6131-4539-9331-cf82aa2fb417 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:08.543166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d35dc4bd-6131-4539-9331-cf82aa2fb417 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:08.551087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d35dc4bd-6131-4539-9331-cf82aa2fb417 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078838 Jul 27 22:58:08.551837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 716/1446] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:08 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:08.735200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c2f1e519-740b-4323-9636-325b2a10767b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:08.737321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c2f1e519-740b-4323-9636-325b2a10767b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:08.743913 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c2f1e519-740b-4323-9636-325b2a10767b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:08.744362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c2f1e519-740b-4323-9636-325b2a10767b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:08.745155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c2f1e519-740b-4323-9636-325b2a10767b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:08.745617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c2f1e519-740b-4323-9636-325b2a10767b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:08.772997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c2f1e519-740b-4323-9636-325b2a10767b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041920 Jul 27 22:58:08.773533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 731/1447] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:08 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:08.897932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-70a594cb-fbf2-4cb3-831e-4c338e0d5ec8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:08.900071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-70a594cb-fbf2-4cb3-831e-4c338e0d5ec8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:08.906051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70a594cb-fbf2-4cb3-831e-4c338e0d5ec8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:08.906492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70a594cb-fbf2-4cb3-831e-4c338e0d5ec8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:08.907269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70a594cb-fbf2-4cb3-831e-4c338e0d5ec8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:08.907694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70a594cb-fbf2-4cb3-831e-4c338e0d5ec8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:08.936065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-70a594cb-fbf2-4cb3-831e-4c338e0d5ec8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042100 Jul 27 22:58:08.936612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 717/1448] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:08 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:09.238470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2eb3f9b3-3b36-4a88-bb84-97a0741f2bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:09.240631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2eb3f9b3-3b36-4a88-bb84-97a0741f2bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:09.246995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2eb3f9b3-3b36-4a88-bb84-97a0741f2bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:09.247436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2eb3f9b3-3b36-4a88-bb84-97a0741f2bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:09.248186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2eb3f9b3-3b36-4a88-bb84-97a0741f2bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:09.248639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2eb3f9b3-3b36-4a88-bb84-97a0741f2bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:09.277597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2eb3f9b3-3b36-4a88-bb84-97a0741f2bd8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043066 Jul 27 22:58:09.278136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 732/1449] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:09 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:58:09.571380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c3309d6f-d72f-4555-bd90-f82d35220551 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:09.571981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c3309d6f-d72f-4555-bd90-f82d35220551 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:09.577985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3309d6f-d72f-4555-bd90-f82d35220551 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:09.578429 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3309d6f-d72f-4555-bd90-f82d35220551 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:09.579204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3309d6f-d72f-4555-bd90-f82d35220551 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:09.579629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3309d6f-d72f-4555-bd90-f82d35220551 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:09.640911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c3309d6f-d72f-4555-bd90-f82d35220551 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:09.649058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c3309d6f-d72f-4555-bd90-f82d35220551 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081447 Jul 27 22:58:09.649620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 718/1450] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:09 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:58:09.784964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c3f8b133-12a2-4235-bb20-b10e96549a07 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:09.787142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c3f8b133-12a2-4235-bb20-b10e96549a07 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:09.793288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3f8b133-12a2-4235-bb20-b10e96549a07 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:09.793717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3f8b133-12a2-4235-bb20-b10e96549a07 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:09.794474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3f8b133-12a2-4235-bb20-b10e96549a07 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:09.795089 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3f8b133-12a2-4235-bb20-b10e96549a07 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:09.824391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c3f8b133-12a2-4235-bb20-b10e96549a07 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043361 Jul 27 22:58:09.824898 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 733/1451] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:09 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:09.948136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-de1b703c-8ce4-4d17-886f-05ddd04c590e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:09.950332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-de1b703c-8ce4-4d17-886f-05ddd04c590e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:09.956641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de1b703c-8ce4-4d17-886f-05ddd04c590e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:09.957094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de1b703c-8ce4-4d17-886f-05ddd04c590e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:09.957865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de1b703c-8ce4-4d17-886f-05ddd04c590e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:09.958296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de1b703c-8ce4-4d17-886f-05ddd04c590e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:09.989618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-de1b703c-8ce4-4d17-886f-05ddd04c590e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045442 Jul 27 22:58:09.990194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 719/1452] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:09 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:58:10.290098 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-52e840cf-2682-40a6-8068-df22ce91766f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:10.292246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-52e840cf-2682-40a6-8068-df22ce91766f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:10.298534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52e840cf-2682-40a6-8068-df22ce91766f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:10.298982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52e840cf-2682-40a6-8068-df22ce91766f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:10.299737 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52e840cf-2682-40a6-8068-df22ce91766f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:10.300165 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52e840cf-2682-40a6-8068-df22ce91766f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:10.328876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-52e840cf-2682-40a6-8068-df22ce91766f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042607 Jul 27 22:58:10.329432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 734/1453] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:10 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:10.669527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8b6a1570-2761-45f2-a9ad-d1497dff8939 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:10.670128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8b6a1570-2761-45f2-a9ad-d1497dff8939 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:10.676007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b6a1570-2761-45f2-a9ad-d1497dff8939 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:10.676445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b6a1570-2761-45f2-a9ad-d1497dff8939 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:10.677224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b6a1570-2761-45f2-a9ad-d1497dff8939 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:10.677652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b6a1570-2761-45f2-a9ad-d1497dff8939 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:10.739751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8b6a1570-2761-45f2-a9ad-d1497dff8939 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:10.747071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8b6a1570-2761-45f2-a9ad-d1497dff8939 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081352 Jul 27 22:58:10.747612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 720/1454] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:10 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:10.837151 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dfdf0314-b8ab-4dac-9bb6-625a3fd0e224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:10.845147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dfdf0314-b8ab-4dac-9bb6-625a3fd0e224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:10.851836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfdf0314-b8ab-4dac-9bb6-625a3fd0e224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:10.852280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfdf0314-b8ab-4dac-9bb6-625a3fd0e224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:10.853332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfdf0314-b8ab-4dac-9bb6-625a3fd0e224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:10.853762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfdf0314-b8ab-4dac-9bb6-625a3fd0e224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:10.885054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dfdf0314-b8ab-4dac-9bb6-625a3fd0e224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051803 Jul 27 22:58:10.886397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 735/1455] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:10 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:11.002440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a270bb8b-e6d3-44a9-b951-54e4b8cd04a1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:11.005121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a270bb8b-e6d3-44a9-b951-54e4b8cd04a1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:11.011154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a270bb8b-e6d3-44a9-b951-54e4b8cd04a1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:11.011578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a270bb8b-e6d3-44a9-b951-54e4b8cd04a1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:11.012332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a270bb8b-e6d3-44a9-b951-54e4b8cd04a1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:11.012793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a270bb8b-e6d3-44a9-b951-54e4b8cd04a1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:11.042345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a270bb8b-e6d3-44a9-b951-54e4b8cd04a1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043821 Jul 27 22:58:11.042905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 721/1456] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:10 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:11.340627 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c5b27c2a-151f-4f58-85a0-15cdfba0d514 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:11.342815 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c5b27c2a-151f-4f58-85a0-15cdfba0d514 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:11.349221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c5b27c2a-151f-4f58-85a0-15cdfba0d514 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:11.349663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c5b27c2a-151f-4f58-85a0-15cdfba0d514 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:11.350412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c5b27c2a-151f-4f58-85a0-15cdfba0d514 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:11.350840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c5b27c2a-151f-4f58-85a0-15cdfba0d514 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:11.381610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c5b27c2a-151f-4f58-85a0-15cdfba0d514 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044936 Jul 27 22:58:11.382156 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 736/1457] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:11 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:11.767079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8de1776b-5d42-4853-964c-e29902f4d94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:11.767684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8de1776b-5d42-4853-964c-e29902f4d94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:11.773802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8de1776b-5d42-4853-964c-e29902f4d94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:11.774249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8de1776b-5d42-4853-964c-e29902f4d94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:11.775013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8de1776b-5d42-4853-964c-e29902f4d94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:11.775477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8de1776b-5d42-4853-964c-e29902f4d94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:11.835453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8de1776b-5d42-4853-964c-e29902f4d94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:11.842974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8de1776b-5d42-4853-964c-e29902f4d94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079751 Jul 27 22:58:11.843532 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 722/1458] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:11 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:11.898061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-912629fc-05ad-4835-bbb9-df65bd40ad75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:11.900245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-912629fc-05ad-4835-bbb9-df65bd40ad75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:11.906436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-912629fc-05ad-4835-bbb9-df65bd40ad75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:11.906882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-912629fc-05ad-4835-bbb9-df65bd40ad75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:11.907649 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-912629fc-05ad-4835-bbb9-df65bd40ad75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:11.908972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-912629fc-05ad-4835-bbb9-df65bd40ad75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:11.913454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:11.940454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-912629fc-05ad-4835-bbb9-df65bd40ad75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046689 Jul 27 22:58:11.941028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 737/1459] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:11 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:12.057867 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9b7c1de4-aec3-4b37-8397-f5be2ce4b0f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:12.060013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9b7c1de4-aec3-4b37-8397-f5be2ce4b0f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:12.066308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9b7c1de4-aec3-4b37-8397-f5be2ce4b0f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:12.066745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9b7c1de4-aec3-4b37-8397-f5be2ce4b0f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:12.067498 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9b7c1de4-aec3-4b37-8397-f5be2ce4b0f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:12.067921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9b7c1de4-aec3-4b37-8397-f5be2ce4b0f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:12.098904 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9b7c1de4-aec3-4b37-8397-f5be2ce4b0f3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047369 Jul 27 22:58:12.099452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 723/1460] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:12.393844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0dffa639-616e-47f9-b742-c0c5bca0c592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:12.397858 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0dffa639-616e-47f9-b742-c0c5bca0c592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:12.404432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0dffa639-616e-47f9-b742-c0c5bca0c592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:12.404903 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0dffa639-616e-47f9-b742-c0c5bca0c592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:12.405734 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0dffa639-616e-47f9-b742-c0c5bca0c592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:12.406166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0dffa639-616e-47f9-b742-c0c5bca0c592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:12.440459 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0dffa639-616e-47f9-b742-c0c5bca0c592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050466 Jul 27 22:58:12.441542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 738/1461] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:12 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:12.822319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 22:58:12.822906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 22:58:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 22:58:12.864928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a4ee05e7-8688-46c0-a2cb-4ec4121d5ff3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:12.865528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a4ee05e7-8688-46c0-a2cb-4ec4121d5ff3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:12.871461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4ee05e7-8688-46c0-a2cb-4ec4121d5ff3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:12.871901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4ee05e7-8688-46c0-a2cb-4ec4121d5ff3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:12.872670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4ee05e7-8688-46c0-a2cb-4ec4121d5ff3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:12.873094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4ee05e7-8688-46c0-a2cb-4ec4121d5ff3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:12.932681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a4ee05e7-8688-46c0-a2cb-4ec4121d5ff3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:12.940029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a4ee05e7-8688-46c0-a2cb-4ec4121d5ff3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079404 Jul 27 22:58:12.940602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 724/1462] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:12 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:12.952422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e6072b6a-9f74-46fd-bead-e2167c22bebe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:12.954659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e6072b6a-9f74-46fd-bead-e2167c22bebe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:12.960730 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e6072b6a-9f74-46fd-bead-e2167c22bebe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:12.961176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e6072b6a-9f74-46fd-bead-e2167c22bebe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:12.961937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e6072b6a-9f74-46fd-bead-e2167c22bebe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:12.962369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e6072b6a-9f74-46fd-bead-e2167c22bebe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:12.991536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e6072b6a-9f74-46fd-bead-e2167c22bebe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042650 Jul 27 22:58:12.992392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 739/1463] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:12 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:13.111408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6cccb435-5ce4-4b63-b0f6-98e1ca81f6c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:13.114153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6cccb435-5ce4-4b63-b0f6-98e1ca81f6c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:13.120134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6cccb435-5ce4-4b63-b0f6-98e1ca81f6c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:13.120596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6cccb435-5ce4-4b63-b0f6-98e1ca81f6c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:13.121349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6cccb435-5ce4-4b63-b0f6-98e1ca81f6c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:13.121776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6cccb435-5ce4-4b63-b0f6-98e1ca81f6c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:13.149643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6cccb435-5ce4-4b63-b0f6-98e1ca81f6c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042224 Jul 27 22:58:13.150185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 725/1464] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:13.454101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-53c9cfe2-66ec-4012-af12-5045c8af2ed2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:13.456169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-53c9cfe2-66ec-4012-af12-5045c8af2ed2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:13.462597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-53c9cfe2-66ec-4012-af12-5045c8af2ed2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:13.463041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-53c9cfe2-66ec-4012-af12-5045c8af2ed2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:13.463792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-53c9cfe2-66ec-4012-af12-5045c8af2ed2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:13.464222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-53c9cfe2-66ec-4012-af12-5045c8af2ed2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:13.493725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-53c9cfe2-66ec-4012-af12-5045c8af2ed2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043664 Jul 27 22:58:13.494267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 740/1465] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:13 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:13.961968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e5cfff34-cf3d-46fe-b064-eb8d27ab4b7c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:13.962568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e5cfff34-cf3d-46fe-b064-eb8d27ab4b7c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:13.968453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5cfff34-cf3d-46fe-b064-eb8d27ab4b7c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:13.968926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5cfff34-cf3d-46fe-b064-eb8d27ab4b7c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:13.969667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5cfff34-cf3d-46fe-b064-eb8d27ab4b7c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:13.970091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5cfff34-cf3d-46fe-b064-eb8d27ab4b7c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:14.005575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-528cdf79-4794-482c-8cfb-20ea9e8fcfb2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:14.008167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-528cdf79-4794-482c-8cfb-20ea9e8fcfb2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:14.014288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-528cdf79-4794-482c-8cfb-20ea9e8fcfb2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:14.014730 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-528cdf79-4794-482c-8cfb-20ea9e8fcfb2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:14.015495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-528cdf79-4794-482c-8cfb-20ea9e8fcfb2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:14.015929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-528cdf79-4794-482c-8cfb-20ea9e8fcfb2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:14.030073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e5cfff34-cf3d-46fe-b064-eb8d27ab4b7c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:14.038042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e5cfff34-cf3d-46fe-b064-eb8d27ab4b7c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079907 Jul 27 22:58:14.038593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 726/1466] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:13 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:14.044691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-528cdf79-4794-482c-8cfb-20ea9e8fcfb2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042984 Jul 27 22:58:14.045236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 741/1467] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:14 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:58:14.162037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b42b65b6-a04e-468d-8340-645b367661fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:14.164202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b42b65b6-a04e-468d-8340-645b367661fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:14.170302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b42b65b6-a04e-468d-8340-645b367661fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:14.170747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b42b65b6-a04e-468d-8340-645b367661fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:14.171502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b42b65b6-a04e-468d-8340-645b367661fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:14.171934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b42b65b6-a04e-468d-8340-645b367661fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:14.176008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:14.200388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b42b65b6-a04e-468d-8340-645b367661fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043095 Jul 27 22:58:14.200959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 727/1468] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:14 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:14.505861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-394a45cd-6780-4c6c-9cbf-5ba397125426 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:14.507989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-394a45cd-6780-4c6c-9cbf-5ba397125426 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:14.514937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-394a45cd-6780-4c6c-9cbf-5ba397125426 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:14.515378 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-394a45cd-6780-4c6c-9cbf-5ba397125426 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:14.516128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-394a45cd-6780-4c6c-9cbf-5ba397125426 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:14.516576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-394a45cd-6780-4c6c-9cbf-5ba397125426 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:14.545620 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-394a45cd-6780-4c6c-9cbf-5ba397125426 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043765 Jul 27 22:58:14.546166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 742/1469] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:14 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:15.057089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-35d641f7-1f92-4bd7-87b5-3333d548e417 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:15.058891 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8145cd66-2ea1-41ab-be03-c7e5bb621496 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:15.059221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-35d641f7-1f92-4bd7-87b5-3333d548e417 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:15.059497 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8145cd66-2ea1-41ab-be03-c7e5bb621496 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:15.065247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d641f7-1f92-4bd7-87b5-3333d548e417 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:15.065441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8145cd66-2ea1-41ab-be03-c7e5bb621496 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:15.065685 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d641f7-1f92-4bd7-87b5-3333d548e417 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:15.065887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8145cd66-2ea1-41ab-be03-c7e5bb621496 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:15.066650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8145cd66-2ea1-41ab-be03-c7e5bb621496 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:15.067084 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8145cd66-2ea1-41ab-be03-c7e5bb621496 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:15.067345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d641f7-1f92-4bd7-87b5-3333d548e417 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:15.067776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d641f7-1f92-4bd7-87b5-3333d548e417 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:15.096238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-35d641f7-1f92-4bd7-87b5-3333d548e417 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043030 Jul 27 22:58:15.096815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 728/1470] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:15 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:15.131959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8145cd66-2ea1-41ab-be03-c7e5bb621496 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:15.139507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8145cd66-2ea1-41ab-be03-c7e5bb621496 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084395 Jul 27 22:58:15.140062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 743/1471] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:15 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:58:15.213127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0193b834-4462-4e77-b12c-92f33ac72476 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:15.215267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0193b834-4462-4e77-b12c-92f33ac72476 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:15.221390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0193b834-4462-4e77-b12c-92f33ac72476 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:15.221835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0193b834-4462-4e77-b12c-92f33ac72476 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:15.223221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0193b834-4462-4e77-b12c-92f33ac72476 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:15.223651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0193b834-4462-4e77-b12c-92f33ac72476 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:15.251475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0193b834-4462-4e77-b12c-92f33ac72476 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042308 Jul 27 22:58:15.252008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 729/1472] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:15 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:15.558266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8f208b68-de88-4093-adf9-c8703108afce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:15.560393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8f208b68-de88-4093-adf9-c8703108afce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:15.567828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f208b68-de88-4093-adf9-c8703108afce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:15.568275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f208b68-de88-4093-adf9-c8703108afce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:15.569073 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f208b68-de88-4093-adf9-c8703108afce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:15.569504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f208b68-de88-4093-adf9-c8703108afce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:15.599490 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8f208b68-de88-4093-adf9-c8703108afce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045155 Jul 27 22:58:15.600044 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 744/1473] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:16.109518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e4458d27-3f83-4889-8378-a4e5edb56743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:16.111651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e4458d27-3f83-4889-8378-a4e5edb56743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:16.118252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4458d27-3f83-4889-8378-a4e5edb56743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:16.118696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4458d27-3f83-4889-8378-a4e5edb56743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:16.119448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4458d27-3f83-4889-8378-a4e5edb56743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:16.119878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4458d27-3f83-4889-8378-a4e5edb56743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:16.147418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e4458d27-3f83-4889-8378-a4e5edb56743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041825 Jul 27 22:58:16.147987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 730/1474] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:16 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:16.160925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f92ac832-de06-4026-aa21-95731675ec7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:16.161533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f92ac832-de06-4026-aa21-95731675ec7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:16.167499 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f92ac832-de06-4026-aa21-95731675ec7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:16.167941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f92ac832-de06-4026-aa21-95731675ec7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:16.168742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f92ac832-de06-4026-aa21-95731675ec7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:16.169173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f92ac832-de06-4026-aa21-95731675ec7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:16.229358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f92ac832-de06-4026-aa21-95731675ec7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:16.236840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f92ac832-de06-4026-aa21-95731675ec7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080281 Jul 27 22:58:16.237397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 745/1475] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:16 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:58:16.263384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-020005d7-2779-4453-8a44-3ea339abaddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:16.265576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-020005d7-2779-4453-8a44-3ea339abaddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:16.271496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-020005d7-2779-4453-8a44-3ea339abaddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:16.271963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-020005d7-2779-4453-8a44-3ea339abaddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:16.272749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-020005d7-2779-4453-8a44-3ea339abaddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:16.273184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-020005d7-2779-4453-8a44-3ea339abaddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:16.302345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-020005d7-2779-4453-8a44-3ea339abaddb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042913 Jul 27 22:58:16.303059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 731/1476] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:16 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:16.612040 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9a34732f-5f08-4e74-9d9a-8a1d6e4bf7d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:16.614238 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9a34732f-5f08-4e74-9d9a-8a1d6e4bf7d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:16.620804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a34732f-5f08-4e74-9d9a-8a1d6e4bf7d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:16.621253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a34732f-5f08-4e74-9d9a-8a1d6e4bf7d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:16.622015 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a34732f-5f08-4e74-9d9a-8a1d6e4bf7d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:16.622449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a34732f-5f08-4e74-9d9a-8a1d6e4bf7d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:16.651085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9a34732f-5f08-4e74-9d9a-8a1d6e4bf7d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043034 Jul 27 22:58:16.651628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 746/1477] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:16 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:17.159759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c54d6d9c-d57b-4d40-b3a4-9834d5811bf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:17.161928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c54d6d9c-d57b-4d40-b3a4-9834d5811bf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:17.167918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c54d6d9c-d57b-4d40-b3a4-9834d5811bf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:17.168358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c54d6d9c-d57b-4d40-b3a4-9834d5811bf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:17.169221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c54d6d9c-d57b-4d40-b3a4-9834d5811bf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:17.169654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c54d6d9c-d57b-4d40-b3a4-9834d5811bf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:17.197704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c54d6d9c-d57b-4d40-b3a4-9834d5811bf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041942 Jul 27 22:58:17.198243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 732/1478] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:17 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:17.258335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bdebfa30-0490-42ab-82b6-d4be6d48411f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:17.258937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bdebfa30-0490-42ab-82b6-d4be6d48411f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:17.264905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bdebfa30-0490-42ab-82b6-d4be6d48411f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:17.265347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bdebfa30-0490-42ab-82b6-d4be6d48411f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:17.266095 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bdebfa30-0490-42ab-82b6-d4be6d48411f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:17.266634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bdebfa30-0490-42ab-82b6-d4be6d48411f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:17.314513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-aa5e78c1-5398-4419-bf85-8a3a1b95662a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:17.317296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-aa5e78c1-5398-4419-bf85-8a3a1b95662a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:17.319093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:17.324757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa5e78c1-5398-4419-bf85-8a3a1b95662a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:17.325048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa5e78c1-5398-4419-bf85-8a3a1b95662a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:17.325802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa5e78c1-5398-4419-bf85-8a3a1b95662a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:17.326232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa5e78c1-5398-4419-bf85-8a3a1b95662a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:17.326748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bdebfa30-0490-42ab-82b6-d4be6d48411f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:17.334236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bdebfa30-0490-42ab-82b6-d4be6d48411f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079732 Jul 27 22:58:17.334796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 747/1479] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:17 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:17.355111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-aa5e78c1-5398-4419-bf85-8a3a1b95662a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044482 Jul 27 22:58:17.355833 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 733/1480] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:17 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:58:17.663545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-417cf6d3-384d-4816-a3f2-e0333da8ece2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:17.665744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-417cf6d3-384d-4816-a3f2-e0333da8ece2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:17.668006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:17.673496 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-417cf6d3-384d-4816-a3f2-e0333da8ece2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:17.673942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-417cf6d3-384d-4816-a3f2-e0333da8ece2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:17.674703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-417cf6d3-384d-4816-a3f2-e0333da8ece2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:17.675133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-417cf6d3-384d-4816-a3f2-e0333da8ece2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:17.703874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-417cf6d3-384d-4816-a3f2-e0333da8ece2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Jul 27 22:58:17.704364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 748/1481] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:17 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:18.210432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ddfc160e-69a4-4198-b60c-ff7cba39adf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:18.212593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ddfc160e-69a4-4198-b60c-ff7cba39adf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:18.218612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ddfc160e-69a4-4198-b60c-ff7cba39adf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:18.219082 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ddfc160e-69a4-4198-b60c-ff7cba39adf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:18.219801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ddfc160e-69a4-4198-b60c-ff7cba39adf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:18.220231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ddfc160e-69a4-4198-b60c-ff7cba39adf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:18.248315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ddfc160e-69a4-4198-b60c-ff7cba39adf8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042287 Jul 27 22:58:18.248820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 734/1482] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:18 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:18.355356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e3643b28-afcd-4789-9179-44475994fc11 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:18.355955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e3643b28-afcd-4789-9179-44475994fc11 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:18.362124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e3643b28-afcd-4789-9179-44475994fc11 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:18.362567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e3643b28-afcd-4789-9179-44475994fc11 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:18.363323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e3643b28-afcd-4789-9179-44475994fc11 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:18.363749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e3643b28-afcd-4789-9179-44475994fc11 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:18.367164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-378c1da4-a838-444d-bddc-56841d707d59 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:18.369401 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-378c1da4-a838-444d-bddc-56841d707d59 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:18.375307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-378c1da4-a838-444d-bddc-56841d707d59 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:18.375755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-378c1da4-a838-444d-bddc-56841d707d59 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:18.376511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-378c1da4-a838-444d-bddc-56841d707d59 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:18.376968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-378c1da4-a838-444d-bddc-56841d707d59 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:18.407078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-378c1da4-a838-444d-bddc-56841d707d59 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043527 Jul 27 22:58:18.407656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 735/1483] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:58:18.426331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e3643b28-afcd-4789-9179-44475994fc11 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:18.433751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e3643b28-afcd-4789-9179-44475994fc11 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082497 Jul 27 22:58:18.434313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 749/1484] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:18 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:18.715912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d59129e8-3112-42c7-a7f9-7f52f81b90f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:18.718114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d59129e8-3112-42c7-a7f9-7f52f81b90f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:18.724036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d59129e8-3112-42c7-a7f9-7f52f81b90f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:18.724481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d59129e8-3112-42c7-a7f9-7f52f81b90f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:18.725267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d59129e8-3112-42c7-a7f9-7f52f81b90f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:18.725702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d59129e8-3112-42c7-a7f9-7f52f81b90f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:18.754685 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d59129e8-3112-42c7-a7f9-7f52f81b90f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042748 Jul 27 22:58:18.755215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 736/1485] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:18 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:19.260529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6f8111f0-2389-4cef-93a5-827708edc0e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:19.262720 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6f8111f0-2389-4cef-93a5-827708edc0e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:19.268873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f8111f0-2389-4cef-93a5-827708edc0e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:19.269311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f8111f0-2389-4cef-93a5-827708edc0e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:19.270185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f8111f0-2389-4cef-93a5-827708edc0e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:19.270609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f8111f0-2389-4cef-93a5-827708edc0e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:19.299178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6f8111f0-2389-4cef-93a5-827708edc0e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042653 Jul 27 22:58:19.299913 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 750/1486] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:19 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:19.418821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-18d7c15c-a536-4654-a7f5-586353b7171b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:19.420915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-18d7c15c-a536-4654-a7f5-586353b7171b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:19.427424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18d7c15c-a536-4654-a7f5-586353b7171b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:19.427865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18d7c15c-a536-4654-a7f5-586353b7171b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:19.428627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18d7c15c-a536-4654-a7f5-586353b7171b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:19.429056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18d7c15c-a536-4654-a7f5-586353b7171b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:19.454777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f3d4e360-6f25-4a8c-85b6-8d99832c29a5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:19.455393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f3d4e360-6f25-4a8c-85b6-8d99832c29a5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:19.456507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-18d7c15c-a536-4654-a7f5-586353b7171b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041735 Jul 27 22:58:19.457600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 737/1487] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:19 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:19.462357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3d4e360-6f25-4a8c-85b6-8d99832c29a5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:19.462800 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3d4e360-6f25-4a8c-85b6-8d99832c29a5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:19.463563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3d4e360-6f25-4a8c-85b6-8d99832c29a5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:19.463991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3d4e360-6f25-4a8c-85b6-8d99832c29a5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:19.527054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f3d4e360-6f25-4a8c-85b6-8d99832c29a5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:19.534573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f3d4e360-6f25-4a8c-85b6-8d99832c29a5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083616 Jul 27 22:58:19.535757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 751/1488] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:19 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:58:19.766932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-153beb24-2881-4b6e-8383-c88bda664b9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:19.769125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-153beb24-2881-4b6e-8383-c88bda664b9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:19.775604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-153beb24-2881-4b6e-8383-c88bda664b9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:19.776050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-153beb24-2881-4b6e-8383-c88bda664b9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:19.776871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-153beb24-2881-4b6e-8383-c88bda664b9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:19.777304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-153beb24-2881-4b6e-8383-c88bda664b9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:19.805674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-153beb24-2881-4b6e-8383-c88bda664b9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042753 Jul 27 22:58:19.806207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 738/1489] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:19 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:20.311749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4733408b-046c-4145-8499-f5a88ed516f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:20.313942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4733408b-046c-4145-8499-f5a88ed516f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:20.319906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4733408b-046c-4145-8499-f5a88ed516f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:20.320352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4733408b-046c-4145-8499-f5a88ed516f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:20.321147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4733408b-046c-4145-8499-f5a88ed516f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:20.321580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4733408b-046c-4145-8499-f5a88ed516f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:20.349958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4733408b-046c-4145-8499-f5a88ed516f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042194 Jul 27 22:58:20.350526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 752/1490] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:20 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:20.469476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9901406d-457a-4be7-abf9-4d0a93e8987e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:20.471665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9901406d-457a-4be7-abf9-4d0a93e8987e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:20.478762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9901406d-457a-4be7-abf9-4d0a93e8987e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:20.479200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9901406d-457a-4be7-abf9-4d0a93e8987e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:20.479946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9901406d-457a-4be7-abf9-4d0a93e8987e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:20.480370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9901406d-457a-4be7-abf9-4d0a93e8987e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:20.509561 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9901406d-457a-4be7-abf9-4d0a93e8987e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043983 Jul 27 22:58:20.510101 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 739/1491] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:20.555005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-45f29ce8-f388-4f2a-b639-6e020e1c5b61 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:20.555615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-45f29ce8-f388-4f2a-b639-6e020e1c5b61 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:20.563191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45f29ce8-f388-4f2a-b639-6e020e1c5b61 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:20.563640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45f29ce8-f388-4f2a-b639-6e020e1c5b61 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:20.564406 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45f29ce8-f388-4f2a-b639-6e020e1c5b61 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:20.564866 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45f29ce8-f388-4f2a-b639-6e020e1c5b61 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:20.625552 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-45f29ce8-f388-4f2a-b639-6e020e1c5b61 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:20.629487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:20.634634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-45f29ce8-f388-4f2a-b639-6e020e1c5b61 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083428 Jul 27 22:58:20.635200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 753/1492] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:20 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:20.818287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c271f6f7-9a33-4801-8c88-d72756ada51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:20.820408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c271f6f7-9a33-4801-8c88-d72756ada51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:20.826334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c271f6f7-9a33-4801-8c88-d72756ada51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:20.826770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c271f6f7-9a33-4801-8c88-d72756ada51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:20.827513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c271f6f7-9a33-4801-8c88-d72756ada51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:20.827937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c271f6f7-9a33-4801-8c88-d72756ada51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:20.856292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c271f6f7-9a33-4801-8c88-d72756ada51d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Jul 27 22:58:20.856850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 740/1493] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:20 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:21.361885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2aaf6b79-1e0c-48d7-87b8-9c78c434b09e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:21.364687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2aaf6b79-1e0c-48d7-87b8-9c78c434b09e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:21.370868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2aaf6b79-1e0c-48d7-87b8-9c78c434b09e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:21.371312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2aaf6b79-1e0c-48d7-87b8-9c78c434b09e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:21.372064 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2aaf6b79-1e0c-48d7-87b8-9c78c434b09e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:21.372497 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2aaf6b79-1e0c-48d7-87b8-9c78c434b09e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:21.400699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2aaf6b79-1e0c-48d7-87b8-9c78c434b09e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042879 Jul 27 22:58:21.401240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 754/1494] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:21 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:21.521818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bc626d58-f477-4fe7-ab02-302f87abd222 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:21.523981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bc626d58-f477-4fe7-ab02-302f87abd222 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:21.530004 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bc626d58-f477-4fe7-ab02-302f87abd222 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:21.530450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bc626d58-f477-4fe7-ab02-302f87abd222 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:21.531211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bc626d58-f477-4fe7-ab02-302f87abd222 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:21.531639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bc626d58-f477-4fe7-ab02-302f87abd222 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:21.560748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bc626d58-f477-4fe7-ab02-302f87abd222 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042917 Jul 27 22:58:21.561304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 741/1495] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:21 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:21.655014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-63098337-85d5-435c-b205-fbba2e892fb4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:21.655559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-63098337-85d5-435c-b205-fbba2e892fb4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:21.662561 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63098337-85d5-435c-b205-fbba2e892fb4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:21.663004 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63098337-85d5-435c-b205-fbba2e892fb4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:21.663755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63098337-85d5-435c-b205-fbba2e892fb4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:21.664184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63098337-85d5-435c-b205-fbba2e892fb4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:21.724890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-63098337-85d5-435c-b205-fbba2e892fb4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:21.732537 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-63098337-85d5-435c-b205-fbba2e892fb4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081376 Jul 27 22:58:21.733124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 755/1496] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:21 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:21.868315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ecb7881b-e81d-49a4-ade1-19a5f808f592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:21.870488 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ecb7881b-e81d-49a4-ade1-19a5f808f592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:21.876449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ecb7881b-e81d-49a4-ade1-19a5f808f592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:21.876923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ecb7881b-e81d-49a4-ade1-19a5f808f592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:21.877677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ecb7881b-e81d-49a4-ade1-19a5f808f592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:21.878106 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ecb7881b-e81d-49a4-ade1-19a5f808f592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:21.906034 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ecb7881b-e81d-49a4-ade1-19a5f808f592 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041636 Jul 27 22:58:21.906499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 742/1497] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:21 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:22.413009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4be173ac-e3c3-4dc9-ad47-f5c7c5366e58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:22.415211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4be173ac-e3c3-4dc9-ad47-f5c7c5366e58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:22.421356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4be173ac-e3c3-4dc9-ad47-f5c7c5366e58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:22.421801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4be173ac-e3c3-4dc9-ad47-f5c7c5366e58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:22.422567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4be173ac-e3c3-4dc9-ad47-f5c7c5366e58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:22.423000 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4be173ac-e3c3-4dc9-ad47-f5c7c5366e58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:22.450911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4be173ac-e3c3-4dc9-ad47-f5c7c5366e58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041847 Jul 27 22:58:22.451454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 756/1498] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:22 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:22.573782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-237a55d9-f7db-48e1-9a9f-5d38b6580c5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:22.575905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-237a55d9-f7db-48e1-9a9f-5d38b6580c5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:22.582062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-237a55d9-f7db-48e1-9a9f-5d38b6580c5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:22.582502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-237a55d9-f7db-48e1-9a9f-5d38b6580c5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:22.583244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-237a55d9-f7db-48e1-9a9f-5d38b6580c5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:22.583671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-237a55d9-f7db-48e1-9a9f-5d38b6580c5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:22.607552 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:22.612364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-237a55d9-f7db-48e1-9a9f-5d38b6580c5e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042727 Jul 27 22:58:22.612937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 743/1499] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:22 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:22.752447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4f8d1984-45e5-49a8-a0e7-ce34d513e753 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:22.753014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4f8d1984-45e5-49a8-a0e7-ce34d513e753 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:22.760128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4f8d1984-45e5-49a8-a0e7-ce34d513e753 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:22.760579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4f8d1984-45e5-49a8-a0e7-ce34d513e753 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:22.761331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4f8d1984-45e5-49a8-a0e7-ce34d513e753 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:22.761757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4f8d1984-45e5-49a8-a0e7-ce34d513e753 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:22.821756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4f8d1984-45e5-49a8-a0e7-ce34d513e753 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:22.829155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4f8d1984-45e5-49a8-a0e7-ce34d513e753 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080589 Jul 27 22:58:22.829713 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 757/1500] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:22 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:22.918505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8d252e59-e35a-420b-a9ae-262f5de28b6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:22.920673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8d252e59-e35a-420b-a9ae-262f5de28b6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:22.927262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8d252e59-e35a-420b-a9ae-262f5de28b6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:22.927708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8d252e59-e35a-420b-a9ae-262f5de28b6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:22.928456 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8d252e59-e35a-420b-a9ae-262f5de28b6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:22.928905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8d252e59-e35a-420b-a9ae-262f5de28b6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:22.956048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8d252e59-e35a-420b-a9ae-262f5de28b6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041840 Jul 27 22:58:22.956599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 744/1501] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:22 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:23.462964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9d89ffd6-2bb9-4694-8aa0-8a8ab6b7f167 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:23.465166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9d89ffd6-2bb9-4694-8aa0-8a8ab6b7f167 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:23.471112 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d89ffd6-2bb9-4694-8aa0-8a8ab6b7f167 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:23.471547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d89ffd6-2bb9-4694-8aa0-8a8ab6b7f167 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:23.472292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d89ffd6-2bb9-4694-8aa0-8a8ab6b7f167 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:23.473405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d89ffd6-2bb9-4694-8aa0-8a8ab6b7f167 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:23.500846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9d89ffd6-2bb9-4694-8aa0-8a8ab6b7f167 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041847 Jul 27 22:58:23.501390 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 758/1502] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:23 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:23.624102 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5ebf5b65-1767-46b2-97cb-1bf99ada2639 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:23.626245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5ebf5b65-1767-46b2-97cb-1bf99ada2639 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:23.632731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ebf5b65-1767-46b2-97cb-1bf99ada2639 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:23.633168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ebf5b65-1767-46b2-97cb-1bf99ada2639 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:23.633908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ebf5b65-1767-46b2-97cb-1bf99ada2639 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:23.634332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ebf5b65-1767-46b2-97cb-1bf99ada2639 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:23.662206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5ebf5b65-1767-46b2-97cb-1bf99ada2639 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042021 Jul 27 22:58:23.662729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 745/1503] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:23 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:23.849580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-94ede0e0-f5e6-4580-9779-e7824eb97fbd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:23.850191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-94ede0e0-f5e6-4580-9779-e7824eb97fbd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:23.856942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94ede0e0-f5e6-4580-9779-e7824eb97fbd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:23.857385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94ede0e0-f5e6-4580-9779-e7824eb97fbd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:23.858141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94ede0e0-f5e6-4580-9779-e7824eb97fbd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:23.858576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94ede0e0-f5e6-4580-9779-e7824eb97fbd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:23.920897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-94ede0e0-f5e6-4580-9779-e7824eb97fbd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:23.928333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-94ede0e0-f5e6-4580-9779-e7824eb97fbd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082676 Jul 27 22:58:23.928993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 759/1504] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:23 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:23.968088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9f0ab753-4ab7-43d5-9b8e-811c20e8ec3c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:23.970263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9f0ab753-4ab7-43d5-9b8e-811c20e8ec3c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:23.976171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f0ab753-4ab7-43d5-9b8e-811c20e8ec3c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:23.976651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f0ab753-4ab7-43d5-9b8e-811c20e8ec3c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:23.977405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f0ab753-4ab7-43d5-9b8e-811c20e8ec3c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:23.978105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f0ab753-4ab7-43d5-9b8e-811c20e8ec3c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:24.006792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9f0ab753-4ab7-43d5-9b8e-811c20e8ec3c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042583 Jul 27 22:58:24.007321 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 746/1505] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:23 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:24.513377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-83c7e3d4-4ff0-47c3-92c6-85993a688fd4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:24.515443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-83c7e3d4-4ff0-47c3-92c6-85993a688fd4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:24.521480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83c7e3d4-4ff0-47c3-92c6-85993a688fd4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:24.521926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83c7e3d4-4ff0-47c3-92c6-85993a688fd4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:24.522680 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83c7e3d4-4ff0-47c3-92c6-85993a688fd4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:24.523118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83c7e3d4-4ff0-47c3-92c6-85993a688fd4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:24.553777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-83c7e3d4-4ff0-47c3-92c6-85993a688fd4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Jul 27 22:58:24.554351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 760/1506] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:24 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:24.673731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-45177dd4-e5e9-487f-8858-468d07d151a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:24.676515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-45177dd4-e5e9-487f-8858-468d07d151a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:24.682547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45177dd4-e5e9-487f-8858-468d07d151a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:24.682990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45177dd4-e5e9-487f-8858-468d07d151a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:24.683734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45177dd4-e5e9-487f-8858-468d07d151a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:24.684165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45177dd4-e5e9-487f-8858-468d07d151a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:24.712107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-45177dd4-e5e9-487f-8858-468d07d151a7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042334 Jul 27 22:58:24.712657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 747/1507] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:24 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:58:24.950009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-17e7f865-1b44-48a7-a841-2c2a9d86f3fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:24.950640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-17e7f865-1b44-48a7-a841-2c2a9d86f3fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:24.957624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-17e7f865-1b44-48a7-a841-2c2a9d86f3fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:24.958070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-17e7f865-1b44-48a7-a841-2c2a9d86f3fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:24.958825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-17e7f865-1b44-48a7-a841-2c2a9d86f3fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:24.959285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-17e7f865-1b44-48a7-a841-2c2a9d86f3fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:25.018439 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9b33dd1a-aec6-462e-bb11-9c5776085be4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:25.018578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-17e7f865-1b44-48a7-a841-2c2a9d86f3fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:25.021172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9b33dd1a-aec6-462e-bb11-9c5776085be4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:25.026470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-17e7f865-1b44-48a7-a841-2c2a9d86f3fc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080294 Jul 27 22:58:25.027027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9b33dd1a-aec6-462e-bb11-9c5776085be4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:25.027160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 761/1508] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:24 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:25.027479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9b33dd1a-aec6-462e-bb11-9c5776085be4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:25.028242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9b33dd1a-aec6-462e-bb11-9c5776085be4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:25.028705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9b33dd1a-aec6-462e-bb11-9c5776085be4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:25.058572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9b33dd1a-aec6-462e-bb11-9c5776085be4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Jul 27 22:58:25.059118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 748/1509] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:25 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:58:25.565563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c8dd1d98-6c43-4b48-95c7-f2bc3adf4359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:25.568349 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c8dd1d98-6c43-4b48-95c7-f2bc3adf4359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:25.574371 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8dd1d98-6c43-4b48-95c7-f2bc3adf4359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:25.574815 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8dd1d98-6c43-4b48-95c7-f2bc3adf4359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:25.575571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8dd1d98-6c43-4b48-95c7-f2bc3adf4359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:25.576004 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8dd1d98-6c43-4b48-95c7-f2bc3adf4359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:25.606825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c8dd1d98-6c43-4b48-95c7-f2bc3adf4359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045118 Jul 27 22:58:25.607372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 762/1510] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:25.723367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-480e2e9d-3c97-4fc6-801f-18e544a47def tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:25.725534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-480e2e9d-3c97-4fc6-801f-18e544a47def tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:25.731792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-480e2e9d-3c97-4fc6-801f-18e544a47def tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:25.732238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-480e2e9d-3c97-4fc6-801f-18e544a47def tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:25.733028 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-480e2e9d-3c97-4fc6-801f-18e544a47def tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:25.733462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-480e2e9d-3c97-4fc6-801f-18e544a47def tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:25.762597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-480e2e9d-3c97-4fc6-801f-18e544a47def tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043158 Jul 27 22:58:25.763129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 749/1511] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:25 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:26.047131 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c3fb9e8b-aee3-47dd-83a3-9d6cda53c3e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:26.047798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c3fb9e8b-aee3-47dd-83a3-9d6cda53c3e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:26.054663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3fb9e8b-aee3-47dd-83a3-9d6cda53c3e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:26.055102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3fb9e8b-aee3-47dd-83a3-9d6cda53c3e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:26.055850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3fb9e8b-aee3-47dd-83a3-9d6cda53c3e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:26.056278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3fb9e8b-aee3-47dd-83a3-9d6cda53c3e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:26.070721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7b052e78-9ea0-450b-ae22-3bdf3747d2a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:26.072924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7b052e78-9ea0-450b-ae22-3bdf3747d2a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:26.078803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b052e78-9ea0-450b-ae22-3bdf3747d2a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:26.079250 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b052e78-9ea0-450b-ae22-3bdf3747d2a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:26.080009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b052e78-9ea0-450b-ae22-3bdf3747d2a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:26.080446 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b052e78-9ea0-450b-ae22-3bdf3747d2a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:26.109935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7b052e78-9ea0-450b-ae22-3bdf3747d2a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043150 Jul 27 22:58:26.110492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 750/1512] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:26 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:58:26.117977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c3fb9e8b-aee3-47dd-83a3-9d6cda53c3e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:26.125383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c3fb9e8b-aee3-47dd-83a3-9d6cda53c3e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082147 Jul 27 22:58:26.125929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 763/1513] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:26 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:26.619260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ecc613c7-ade0-467d-addb-38459499a571 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:26.621354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ecc613c7-ade0-467d-addb-38459499a571 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:26.627351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ecc613c7-ade0-467d-addb-38459499a571 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:26.627798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ecc613c7-ade0-467d-addb-38459499a571 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:26.628579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ecc613c7-ade0-467d-addb-38459499a571 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:26.629523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ecc613c7-ade0-467d-addb-38459499a571 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:26.657674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ecc613c7-ade0-467d-addb-38459499a571 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042427 Jul 27 22:58:26.658233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 751/1514] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:26 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:26.775191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cb629fa2-fac3-4852-8a28-aa2fc2425e89 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:26.777369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cb629fa2-fac3-4852-8a28-aa2fc2425e89 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:26.783342 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb629fa2-fac3-4852-8a28-aa2fc2425e89 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:26.783778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb629fa2-fac3-4852-8a28-aa2fc2425e89 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:26.784567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb629fa2-fac3-4852-8a28-aa2fc2425e89 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:26.784994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb629fa2-fac3-4852-8a28-aa2fc2425e89 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:26.812963 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cb629fa2-fac3-4852-8a28-aa2fc2425e89 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041354 Jul 27 22:58:26.813498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 764/1515] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:26 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:58:27.122738 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9e234570-3e48-428f-a23e-f42920e8010f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:27.124923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9e234570-3e48-428f-a23e-f42920e8010f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:27.131435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9e234570-3e48-428f-a23e-f42920e8010f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:27.131880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9e234570-3e48-428f-a23e-f42920e8010f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:27.132671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9e234570-3e48-428f-a23e-f42920e8010f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:27.133112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9e234570-3e48-428f-a23e-f42920e8010f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:27.152052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-697f7293-9296-45ec-b017-5669d97b0eba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:27.152694 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-697f7293-9296-45ec-b017-5669d97b0eba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:27.159182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-697f7293-9296-45ec-b017-5669d97b0eba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:27.159633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-697f7293-9296-45ec-b017-5669d97b0eba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:27.160439 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-697f7293-9296-45ec-b017-5669d97b0eba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:27.160901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-697f7293-9296-45ec-b017-5669d97b0eba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:27.162548 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9e234570-3e48-428f-a23e-f42920e8010f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043758 Jul 27 22:58:27.163294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 752/1516] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:27 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:27.221228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-697f7293-9296-45ec-b017-5669d97b0eba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:27.228869 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-697f7293-9296-45ec-b017-5669d97b0eba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082701 Jul 27 22:58:27.229435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 765/1517] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:27 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:58:27.669981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5980f45b-eb69-4175-8695-fb1f282f721c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:27.672138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5980f45b-eb69-4175-8695-fb1f282f721c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:27.678722 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5980f45b-eb69-4175-8695-fb1f282f721c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:27.679165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5980f45b-eb69-4175-8695-fb1f282f721c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:27.679913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5980f45b-eb69-4175-8695-fb1f282f721c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:27.680339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5980f45b-eb69-4175-8695-fb1f282f721c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:27.708516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5980f45b-eb69-4175-8695-fb1f282f721c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042522 Jul 27 22:58:27.709088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 753/1518] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:27 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:27.825825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d10a1ca9-af72-450e-9ea1-7cdd21b437ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:27.827992 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d10a1ca9-af72-450e-9ea1-7cdd21b437ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:27.834519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d10a1ca9-af72-450e-9ea1-7cdd21b437ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:27.834963 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d10a1ca9-af72-450e-9ea1-7cdd21b437ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:27.835721 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d10a1ca9-af72-450e-9ea1-7cdd21b437ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:27.836150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d10a1ca9-af72-450e-9ea1-7cdd21b437ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:27.864495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d10a1ca9-af72-450e-9ea1-7cdd21b437ba tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042733 Jul 27 22:58:27.865059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 766/1519] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:27 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:28.175021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d50a7921-72a1-417a-9f4a-373ae77ea0fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:28.177204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d50a7921-72a1-417a-9f4a-373ae77ea0fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:28.183150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d50a7921-72a1-417a-9f4a-373ae77ea0fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:28.183588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d50a7921-72a1-417a-9f4a-373ae77ea0fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:28.184329 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d50a7921-72a1-417a-9f4a-373ae77ea0fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:28.184786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d50a7921-72a1-417a-9f4a-373ae77ea0fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:28.213141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d50a7921-72a1-417a-9f4a-373ae77ea0fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042301 Jul 27 22:58:28.213671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 754/1520] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:28 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:28.250022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0710ef76-191a-4233-9ed3-659136035227 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:28.250634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0710ef76-191a-4233-9ed3-659136035227 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:28.257059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0710ef76-191a-4233-9ed3-659136035227 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:28.257503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0710ef76-191a-4233-9ed3-659136035227 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:28.258260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0710ef76-191a-4233-9ed3-659136035227 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:28.258790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0710ef76-191a-4233-9ed3-659136035227 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:28.321873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0710ef76-191a-4233-9ed3-659136035227 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:28.329304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0710ef76-191a-4233-9ed3-659136035227 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083134 Jul 27 22:58:28.329862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 767/1521] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:28 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:28.720681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5d7da039-beb1-4eca-a1a8-5b9703830161 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:28.723473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5d7da039-beb1-4eca-a1a8-5b9703830161 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:28.729678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d7da039-beb1-4eca-a1a8-5b9703830161 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:28.730117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d7da039-beb1-4eca-a1a8-5b9703830161 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:28.730858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d7da039-beb1-4eca-a1a8-5b9703830161 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:28.731282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d7da039-beb1-4eca-a1a8-5b9703830161 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:28.758497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5d7da039-beb1-4eca-a1a8-5b9703830161 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041816 Jul 27 22:58:28.759025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 755/1522] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:28 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:28.876695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3bc04ba3-56a3-418e-bd88-f63c15e455ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:28.879366 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3bc04ba3-56a3-418e-bd88-f63c15e455ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:28.885367 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3bc04ba3-56a3-418e-bd88-f63c15e455ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:28.885813 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3bc04ba3-56a3-418e-bd88-f63c15e455ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:28.886568 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3bc04ba3-56a3-418e-bd88-f63c15e455ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:28.887005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3bc04ba3-56a3-418e-bd88-f63c15e455ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:28.918298 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3bc04ba3-56a3-418e-bd88-f63c15e455ab tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045601 Jul 27 22:58:28.918850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 768/1523] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:28 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:29.225223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-eaf3a8d5-585b-41bb-96e4-f5d11dac8d9f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:29.227359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-eaf3a8d5-585b-41bb-96e4-f5d11dac8d9f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:29.233598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eaf3a8d5-585b-41bb-96e4-f5d11dac8d9f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:29.234046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eaf3a8d5-585b-41bb-96e4-f5d11dac8d9f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:29.234798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eaf3a8d5-585b-41bb-96e4-f5d11dac8d9f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:29.235232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eaf3a8d5-585b-41bb-96e4-f5d11dac8d9f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:29.263958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-eaf3a8d5-585b-41bb-96e4-f5d11dac8d9f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042650 Jul 27 22:58:29.264492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 756/1524] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:29 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:29.350442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-48d6b602-ddcf-4d18-a116-ec516450f87c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:29.351050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-48d6b602-ddcf-4d18-a116-ec516450f87c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:29.357718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48d6b602-ddcf-4d18-a116-ec516450f87c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:29.358192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48d6b602-ddcf-4d18-a116-ec516450f87c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:29.358955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48d6b602-ddcf-4d18-a116-ec516450f87c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:29.359530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48d6b602-ddcf-4d18-a116-ec516450f87c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:29.418944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-48d6b602-ddcf-4d18-a116-ec516450f87c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:29.427008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-48d6b602-ddcf-4d18-a116-ec516450f87c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081098 Jul 27 22:58:29.431074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 769/1525] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:29 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:29.770557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-166f4cb7-c9c0-47da-a2e2-f4c640e7af3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:29.773333 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-166f4cb7-c9c0-47da-a2e2-f4c640e7af3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:29.779630 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-166f4cb7-c9c0-47da-a2e2-f4c640e7af3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:29.780072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-166f4cb7-c9c0-47da-a2e2-f4c640e7af3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:29.780868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-166f4cb7-c9c0-47da-a2e2-f4c640e7af3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:29.781303 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-166f4cb7-c9c0-47da-a2e2-f4c640e7af3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:29.809161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-166f4cb7-c9c0-47da-a2e2-f4c640e7af3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042473 Jul 27 22:58:29.809715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 757/1526] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:29 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:29.931025 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cbc8c30a-1234-4105-b596-7b9693722183 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:29.933437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cbc8c30a-1234-4105-b596-7b9693722183 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:29.939845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cbc8c30a-1234-4105-b596-7b9693722183 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:29.940254 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cbc8c30a-1234-4105-b596-7b9693722183 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:29.941040 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cbc8c30a-1234-4105-b596-7b9693722183 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:29.942119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cbc8c30a-1234-4105-b596-7b9693722183 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:29.960567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:29.973552 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cbc8c30a-1234-4105-b596-7b9693722183 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046996 Jul 27 22:58:29.974103 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 770/1527] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:29 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:30.275583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4d9e947d-cba7-433f-9eab-d64aa5adcac6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:30.277667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4d9e947d-cba7-433f-9eab-d64aa5adcac6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:30.283621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d9e947d-cba7-433f-9eab-d64aa5adcac6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:30.284073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d9e947d-cba7-433f-9eab-d64aa5adcac6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:30.284891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d9e947d-cba7-433f-9eab-d64aa5adcac6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:30.285322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d9e947d-cba7-433f-9eab-d64aa5adcac6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:30.313119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4d9e947d-cba7-433f-9eab-d64aa5adcac6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041575 Jul 27 22:58:30.313654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 758/1528] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:30 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:30.455217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-91568c65-80d7-4dc9-9bee-c18e65076914 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:30.455818 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-91568c65-80d7-4dc9-9bee-c18e65076914 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:30.462499 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91568c65-80d7-4dc9-9bee-c18e65076914 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:30.462938 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91568c65-80d7-4dc9-9bee-c18e65076914 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:30.463689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91568c65-80d7-4dc9-9bee-c18e65076914 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:30.464116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91568c65-80d7-4dc9-9bee-c18e65076914 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:30.524743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-91568c65-80d7-4dc9-9bee-c18e65076914 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:30.532202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-91568c65-80d7-4dc9-9bee-c18e65076914 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080905 Jul 27 22:58:30.532726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 771/1529] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:30 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:30.821334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-64532845-97d3-4f3d-b425-567e472fc67f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:30.823451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-64532845-97d3-4f3d-b425-567e472fc67f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:30.829460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64532845-97d3-4f3d-b425-567e472fc67f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:30.829896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64532845-97d3-4f3d-b425-567e472fc67f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:30.830640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64532845-97d3-4f3d-b425-567e472fc67f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:30.831065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64532845-97d3-4f3d-b425-567e472fc67f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:30.859400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-64532845-97d3-4f3d-b425-567e472fc67f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042046 Jul 27 22:58:30.859935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 759/1530] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:30 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:30.985302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4475c00e-f826-4157-86b2-e8054c0b7211 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:30.987440 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4475c00e-f826-4157-86b2-e8054c0b7211 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:30.993387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4475c00e-f826-4157-86b2-e8054c0b7211 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:30.993826 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4475c00e-f826-4157-86b2-e8054c0b7211 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:30.994574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4475c00e-f826-4157-86b2-e8054c0b7211 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:30.995000 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4475c00e-f826-4157-86b2-e8054c0b7211 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:31.023539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4475c00e-f826-4157-86b2-e8054c0b7211 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042256 Jul 27 22:58:31.024069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 772/1531] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:31.326038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9a75a40d-5a8c-4558-9320-986fadd2fe6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:31.328214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9a75a40d-5a8c-4558-9320-986fadd2fe6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:31.334877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a75a40d-5a8c-4558-9320-986fadd2fe6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:31.335321 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a75a40d-5a8c-4558-9320-986fadd2fe6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:31.336080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a75a40d-5a8c-4558-9320-986fadd2fe6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:31.336515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a75a40d-5a8c-4558-9320-986fadd2fe6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:31.352643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:31.365619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9a75a40d-5a8c-4558-9320-986fadd2fe6d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043596 Jul 27 22:58:31.366200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 760/1532] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:31 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:31.553521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a05492ca-17d8-4e34-8810-a0480e0b530c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:31.554133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a05492ca-17d8-4e34-8810-a0480e0b530c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:31.560594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a05492ca-17d8-4e34-8810-a0480e0b530c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:31.561040 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a05492ca-17d8-4e34-8810-a0480e0b530c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:31.561795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a05492ca-17d8-4e34-8810-a0480e0b530c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:31.562225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a05492ca-17d8-4e34-8810-a0480e0b530c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:31.622530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a05492ca-17d8-4e34-8810-a0480e0b530c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:31.630533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a05492ca-17d8-4e34-8810-a0480e0b530c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081375 Jul 27 22:58:31.631093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 773/1533] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:31 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:31.871591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4df89720-48e6-4476-981d-485f45dfef5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:31.873683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4df89720-48e6-4476-981d-485f45dfef5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:31.879707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4df89720-48e6-4476-981d-485f45dfef5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:31.880146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4df89720-48e6-4476-981d-485f45dfef5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:31.880928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4df89720-48e6-4476-981d-485f45dfef5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:31.881359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4df89720-48e6-4476-981d-485f45dfef5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:31.908624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4df89720-48e6-4476-981d-485f45dfef5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041033 Jul 27 22:58:31.909162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 761/1534] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:31 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:32.036069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-03d63f75-ed26-4c6e-bf2a-217a7565ca4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:32.038256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-03d63f75-ed26-4c6e-bf2a-217a7565ca4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:32.044217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-03d63f75-ed26-4c6e-bf2a-217a7565ca4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:32.044693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-03d63f75-ed26-4c6e-bf2a-217a7565ca4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:32.045443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-03d63f75-ed26-4c6e-bf2a-217a7565ca4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:32.045875 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-03d63f75-ed26-4c6e-bf2a-217a7565ca4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:32.074106 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-03d63f75-ed26-4c6e-bf2a-217a7565ca4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042475 Jul 27 22:58:32.074642 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 774/1535] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:32 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:32.378153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-62619ff1-9ce4-4759-b139-5308006e5870 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:32.380291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-62619ff1-9ce4-4759-b139-5308006e5870 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:32.386318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62619ff1-9ce4-4759-b139-5308006e5870 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:32.386764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62619ff1-9ce4-4759-b139-5308006e5870 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:32.387517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62619ff1-9ce4-4759-b139-5308006e5870 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:32.387954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62619ff1-9ce4-4759-b139-5308006e5870 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:32.416627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-62619ff1-9ce4-4759-b139-5308006e5870 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042350 Jul 27 22:58:32.417097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 762/1536] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:32 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:32.651326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-62205f3d-9876-4f2c-a63c-f6b442743eb6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:32.651966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-62205f3d-9876-4f2c-a63c-f6b442743eb6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:32.659490 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-62205f3d-9876-4f2c-a63c-f6b442743eb6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:32.659939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-62205f3d-9876-4f2c-a63c-f6b442743eb6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:32.660756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-62205f3d-9876-4f2c-a63c-f6b442743eb6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:32.661195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-62205f3d-9876-4f2c-a63c-f6b442743eb6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:32.724251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-62205f3d-9876-4f2c-a63c-f6b442743eb6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:32.731966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-62205f3d-9876-4f2c-a63c-f6b442743eb6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084471 Jul 27 22:58:32.732531 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 775/1537] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:32 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:32.926528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8db3cdbe-4031-46c3-b379-da4adcfd76d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:32.928705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8db3cdbe-4031-46c3-b379-da4adcfd76d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:32.934690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8db3cdbe-4031-46c3-b379-da4adcfd76d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:32.935137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8db3cdbe-4031-46c3-b379-da4adcfd76d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:32.935885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8db3cdbe-4031-46c3-b379-da4adcfd76d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:32.936322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8db3cdbe-4031-46c3-b379-da4adcfd76d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:32.964621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8db3cdbe-4031-46c3-b379-da4adcfd76d3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047053 Jul 27 22:58:32.965162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 763/1538] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:32 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:33.088743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0ff4bcd1-3f47-4c6d-a750-899cef45b593 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:33.091222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0ff4bcd1-3f47-4c6d-a750-899cef45b593 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:33.097402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ff4bcd1-3f47-4c6d-a750-899cef45b593 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:33.097891 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ff4bcd1-3f47-4c6d-a750-899cef45b593 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:33.098670 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ff4bcd1-3f47-4c6d-a750-899cef45b593 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:33.099101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ff4bcd1-3f47-4c6d-a750-899cef45b593 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:33.127724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0ff4bcd1-3f47-4c6d-a750-899cef45b593 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044706 Jul 27 22:58:33.128275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 776/1539] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:33.429477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e2c27fd7-a76b-4342-8c0c-9d3ca3523f35 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:33.431592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e2c27fd7-a76b-4342-8c0c-9d3ca3523f35 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:33.437535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2c27fd7-a76b-4342-8c0c-9d3ca3523f35 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:33.437979 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2c27fd7-a76b-4342-8c0c-9d3ca3523f35 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:33.438726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2c27fd7-a76b-4342-8c0c-9d3ca3523f35 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:33.439158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2c27fd7-a76b-4342-8c0c-9d3ca3523f35 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:33.466653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e2c27fd7-a76b-4342-8c0c-9d3ca3523f35 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041883 Jul 27 22:58:33.467183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 764/1540] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:33 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:33.752562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8cb2749f-246f-453a-b375-01d000e94133 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:33.753188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8cb2749f-246f-453a-b375-01d000e94133 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:33.759862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8cb2749f-246f-453a-b375-01d000e94133 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:33.760304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8cb2749f-246f-453a-b375-01d000e94133 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:33.761093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8cb2749f-246f-453a-b375-01d000e94133 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:33.761524 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8cb2749f-246f-453a-b375-01d000e94133 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:33.822191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8cb2749f-246f-453a-b375-01d000e94133 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:33.829576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8cb2749f-246f-453a-b375-01d000e94133 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080924 Jul 27 22:58:33.830126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 777/1541] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:33 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:33.976825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6d1e81ff-ca78-4e2e-a187-80e4f3e54786 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:33.979801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6d1e81ff-ca78-4e2e-a187-80e4f3e54786 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:33.985792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d1e81ff-ca78-4e2e-a187-80e4f3e54786 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:33.986233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d1e81ff-ca78-4e2e-a187-80e4f3e54786 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:33.986981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d1e81ff-ca78-4e2e-a187-80e4f3e54786 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:33.987406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d1e81ff-ca78-4e2e-a187-80e4f3e54786 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:34.014447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6d1e81ff-ca78-4e2e-a187-80e4f3e54786 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041642 Jul 27 22:58:34.014980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 765/1542] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:33 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:34.140375 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bd92265b-df63-4b05-95ea-41c4b8b035ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:34.142819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bd92265b-df63-4b05-95ea-41c4b8b035ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:34.149559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bd92265b-df63-4b05-95ea-41c4b8b035ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:34.150170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bd92265b-df63-4b05-95ea-41c4b8b035ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:34.151150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bd92265b-df63-4b05-95ea-41c4b8b035ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:34.151691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bd92265b-df63-4b05-95ea-41c4b8b035ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:34.186333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bd92265b-df63-4b05-95ea-41c4b8b035ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049853 Jul 27 22:58:34.187194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 778/1543] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:34 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:34.479600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-49c3376b-8fd8-4bea-9016-aea5ee7ab569 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:34.482318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-49c3376b-8fd8-4bea-9016-aea5ee7ab569 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:34.488371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49c3376b-8fd8-4bea-9016-aea5ee7ab569 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:34.488864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49c3376b-8fd8-4bea-9016-aea5ee7ab569 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:34.489625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49c3376b-8fd8-4bea-9016-aea5ee7ab569 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:34.490062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49c3376b-8fd8-4bea-9016-aea5ee7ab569 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:34.517872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-49c3376b-8fd8-4bea-9016-aea5ee7ab569 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042508 Jul 27 22:58:34.518417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 766/1544] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:34 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:34.851419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1f04f093-2f4e-4bde-98bd-e62dfc9775ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:34.852033 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1f04f093-2f4e-4bde-98bd-e62dfc9775ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:34.858883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f04f093-2f4e-4bde-98bd-e62dfc9775ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:34.859324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f04f093-2f4e-4bde-98bd-e62dfc9775ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:34.860079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f04f093-2f4e-4bde-98bd-e62dfc9775ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:34.860511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f04f093-2f4e-4bde-98bd-e62dfc9775ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:34.921214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1f04f093-2f4e-4bde-98bd-e62dfc9775ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:34.928837 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1f04f093-2f4e-4bde-98bd-e62dfc9775ce tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082016 Jul 27 22:58:34.929692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 779/1545] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:34 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:35.025897 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b207cceb-f227-485f-8f39-13a236912741 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:35.028049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b207cceb-f227-485f-8f39-13a236912741 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:35.034175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b207cceb-f227-485f-8f39-13a236912741 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:35.034622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b207cceb-f227-485f-8f39-13a236912741 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:35.035881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b207cceb-f227-485f-8f39-13a236912741 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:35.036315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b207cceb-f227-485f-8f39-13a236912741 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:35.064299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b207cceb-f227-485f-8f39-13a236912741 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042416 Jul 27 22:58:35.064869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 767/1546] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:35 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:35.198942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f4367c4d-ef2a-401d-bc1c-aedc6e4e180e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:35.201128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f4367c4d-ef2a-401d-bc1c-aedc6e4e180e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:35.207557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4367c4d-ef2a-401d-bc1c-aedc6e4e180e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:35.207994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4367c4d-ef2a-401d-bc1c-aedc6e4e180e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:35.208765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4367c4d-ef2a-401d-bc1c-aedc6e4e180e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:35.209191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4367c4d-ef2a-401d-bc1c-aedc6e4e180e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:35.237327 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f4367c4d-ef2a-401d-bc1c-aedc6e4e180e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042408 Jul 27 22:58:35.237854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 780/1547] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:35.530314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-75b0f246-51c0-4f97-a44e-0a42def9f037 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:35.532352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-75b0f246-51c0-4f97-a44e-0a42def9f037 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:35.538844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75b0f246-51c0-4f97-a44e-0a42def9f037 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:35.539284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75b0f246-51c0-4f97-a44e-0a42def9f037 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:35.540036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75b0f246-51c0-4f97-a44e-0a42def9f037 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:35.540459 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75b0f246-51c0-4f97-a44e-0a42def9f037 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:35.568927 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-75b0f246-51c0-4f97-a44e-0a42def9f037 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042996 Jul 27 22:58:35.569460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 768/1548] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:35 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:35.950574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-420e56bc-2cea-4afb-85d4-14a205f3c94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:35.951204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-420e56bc-2cea-4afb-85d4-14a205f3c94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:35.958242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-420e56bc-2cea-4afb-85d4-14a205f3c94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:35.958691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-420e56bc-2cea-4afb-85d4-14a205f3c94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:35.959427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-420e56bc-2cea-4afb-85d4-14a205f3c94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:35.959856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-420e56bc-2cea-4afb-85d4-14a205f3c94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:36.020071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-420e56bc-2cea-4afb-85d4-14a205f3c94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:36.027429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-420e56bc-2cea-4afb-85d4-14a205f3c94f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080717 Jul 27 22:58:36.027985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 781/1549] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:35 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:36.076323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-be11f4c8-9c04-4ff2-aa76-d4197d24aeb4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:36.078499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-be11f4c8-9c04-4ff2-aa76-d4197d24aeb4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:36.084396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be11f4c8-9c04-4ff2-aa76-d4197d24aeb4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:36.084875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be11f4c8-9c04-4ff2-aa76-d4197d24aeb4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:36.085629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be11f4c8-9c04-4ff2-aa76-d4197d24aeb4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:36.086057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be11f4c8-9c04-4ff2-aa76-d4197d24aeb4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:36.114729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-be11f4c8-9c04-4ff2-aa76-d4197d24aeb4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042290 Jul 27 22:58:36.115266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 769/1550] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:36 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:36.249360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-726bb93d-c5f0-4e6b-930f-5a4fcb9c435b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:36.251520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-726bb93d-c5f0-4e6b-930f-5a4fcb9c435b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:36.258190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-726bb93d-c5f0-4e6b-930f-5a4fcb9c435b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:36.258636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-726bb93d-c5f0-4e6b-930f-5a4fcb9c435b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:36.259397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-726bb93d-c5f0-4e6b-930f-5a4fcb9c435b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:36.259832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-726bb93d-c5f0-4e6b-930f-5a4fcb9c435b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:36.287502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-726bb93d-c5f0-4e6b-930f-5a4fcb9c435b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042258 Jul 27 22:58:36.288062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 782/1551] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:36.580912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-637d494b-d4a2-4800-a6c4-124aeea0ff86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:36.583672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-637d494b-d4a2-4800-a6c4-124aeea0ff86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:36.589649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-637d494b-d4a2-4800-a6c4-124aeea0ff86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:36.590092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-637d494b-d4a2-4800-a6c4-124aeea0ff86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:36.590845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-637d494b-d4a2-4800-a6c4-124aeea0ff86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:36.591277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-637d494b-d4a2-4800-a6c4-124aeea0ff86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:36.619016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-637d494b-d4a2-4800-a6c4-124aeea0ff86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042053 Jul 27 22:58:36.619546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 770/1552] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:36 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:37.047768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0fb4185d-dcd1-4bd5-a3b2-4ff43da1ac4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:37.048368 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0fb4185d-dcd1-4bd5-a3b2-4ff43da1ac4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:37.055495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0fb4185d-dcd1-4bd5-a3b2-4ff43da1ac4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:37.055959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0fb4185d-dcd1-4bd5-a3b2-4ff43da1ac4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:37.056705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0fb4185d-dcd1-4bd5-a3b2-4ff43da1ac4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:37.057132 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0fb4185d-dcd1-4bd5-a3b2-4ff43da1ac4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:37.121356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0fb4185d-dcd1-4bd5-a3b2-4ff43da1ac4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:37.126807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5f1ca5db-bf63-461d-910b-5e7a16c54ebf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:37.128995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5f1ca5db-bf63-461d-910b-5e7a16c54ebf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:37.129142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0fb4185d-dcd1-4bd5-a3b2-4ff43da1ac4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.085156 Jul 27 22:58:37.129712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 783/1553] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:37 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:37.135119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f1ca5db-bf63-461d-910b-5e7a16c54ebf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:37.135568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f1ca5db-bf63-461d-910b-5e7a16c54ebf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:37.136332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f1ca5db-bf63-461d-910b-5e7a16c54ebf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:37.136794 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f1ca5db-bf63-461d-910b-5e7a16c54ebf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:37.165812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5f1ca5db-bf63-461d-910b-5e7a16c54ebf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042870 Jul 27 22:58:37.166357 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 771/1554] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:37 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:58:37.299781 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3d31c349-c64a-4afe-acf6-8d22c3cbdcdb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:37.302592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3d31c349-c64a-4afe-acf6-8d22c3cbdcdb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:37.308530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d31c349-c64a-4afe-acf6-8d22c3cbdcdb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:37.309009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d31c349-c64a-4afe-acf6-8d22c3cbdcdb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:37.309768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d31c349-c64a-4afe-acf6-8d22c3cbdcdb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:37.310205 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d31c349-c64a-4afe-acf6-8d22c3cbdcdb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:37.338133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3d31c349-c64a-4afe-acf6-8d22c3cbdcdb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042419 Jul 27 22:58:37.338674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 784/1555] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:37.631958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-856c6458-4308-4ef2-84d9-2acf4f380419 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:37.634313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-856c6458-4308-4ef2-84d9-2acf4f380419 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:37.640399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-856c6458-4308-4ef2-84d9-2acf4f380419 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:37.640944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-856c6458-4308-4ef2-84d9-2acf4f380419 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:37.641715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-856c6458-4308-4ef2-84d9-2acf4f380419 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:37.642155 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-856c6458-4308-4ef2-84d9-2acf4f380419 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:37.671148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-856c6458-4308-4ef2-84d9-2acf4f380419 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Jul 27 22:58:37.671696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 772/1556] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:37 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:38.150324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b1594c1f-e1d3-44e4-b7fc-ad695d725cc2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:38.150936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b1594c1f-e1d3-44e4-b7fc-ad695d725cc2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:38.157500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1594c1f-e1d3-44e4-b7fc-ad695d725cc2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:38.157947 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1594c1f-e1d3-44e4-b7fc-ad695d725cc2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:38.158711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1594c1f-e1d3-44e4-b7fc-ad695d725cc2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:38.159147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1594c1f-e1d3-44e4-b7fc-ad695d725cc2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:38.178493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ffa004b0-c823-4a69-a008-860ea17302f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:38.180687 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ffa004b0-c823-4a69-a008-860ea17302f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:38.186953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffa004b0-c823-4a69-a008-860ea17302f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:38.187398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffa004b0-c823-4a69-a008-860ea17302f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:38.188160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffa004b0-c823-4a69-a008-860ea17302f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:38.188621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffa004b0-c823-4a69-a008-860ea17302f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:38.218279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ffa004b0-c823-4a69-a008-860ea17302f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Jul 27 22:58:38.218495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 773/1557] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:38 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:58:38.220188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b1594c1f-e1d3-44e4-b7fc-ad695d725cc2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:38.227706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b1594c1f-e1d3-44e4-b7fc-ad695d725cc2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081235 Jul 27 22:58:38.228515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 785/1558] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:38 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:38.350460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0490548c-8dab-470d-a77d-3e511100617f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:38.352618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0490548c-8dab-470d-a77d-3e511100617f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:38.358915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0490548c-8dab-470d-a77d-3e511100617f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:38.359361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0490548c-8dab-470d-a77d-3e511100617f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:38.360116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0490548c-8dab-470d-a77d-3e511100617f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:38.360581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0490548c-8dab-470d-a77d-3e511100617f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:38.389902 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0490548c-8dab-470d-a77d-3e511100617f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043502 Jul 27 22:58:38.390453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 774/1559] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:38 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:38.683836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-00b0b54f-03e9-4df5-84ef-f1ed7e1b50d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:38.686044 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-00b0b54f-03e9-4df5-84ef-f1ed7e1b50d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:38.691938 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-00b0b54f-03e9-4df5-84ef-f1ed7e1b50d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:38.692385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-00b0b54f-03e9-4df5-84ef-f1ed7e1b50d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:38.693184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-00b0b54f-03e9-4df5-84ef-f1ed7e1b50d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:38.693618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-00b0b54f-03e9-4df5-84ef-f1ed7e1b50d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:38.724502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-00b0b54f-03e9-4df5-84ef-f1ed7e1b50d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044662 Jul 27 22:58:38.725068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 786/1560] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:38 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:39.230789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2a0a0ad8-5b95-45f7-925d-62f813bf9067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:39.232963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2a0a0ad8-5b95-45f7-925d-62f813bf9067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:39.238971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2a0a0ad8-5b95-45f7-925d-62f813bf9067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:39.239426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2a0a0ad8-5b95-45f7-925d-62f813bf9067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:39.240183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2a0a0ad8-5b95-45f7-925d-62f813bf9067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:39.240646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2a0a0ad8-5b95-45f7-925d-62f813bf9067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:39.248541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b0386d5d-dc16-4acd-9269-0601bcd4bef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:39.249181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b0386d5d-dc16-4acd-9269-0601bcd4bef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:39.255563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b0386d5d-dc16-4acd-9269-0601bcd4bef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:39.256005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b0386d5d-dc16-4acd-9269-0601bcd4bef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:39.256814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b0386d5d-dc16-4acd-9269-0601bcd4bef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:39.257225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b0386d5d-dc16-4acd-9269-0601bcd4bef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:39.261093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:39.268848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2a0a0ad8-5b95-45f7-925d-62f813bf9067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042246 Jul 27 22:58:39.269402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 775/1561] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:39 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:39.318375 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b0386d5d-dc16-4acd-9269-0601bcd4bef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:39.325785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b0386d5d-dc16-4acd-9269-0601bcd4bef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081098 Jul 27 22:58:39.326342 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 787/1562] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:39 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:58:39.402176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-55c9ac4d-49e2-49e6-898b-578a74ba5d64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:39.404353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-55c9ac4d-49e2-49e6-898b-578a74ba5d64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:39.410247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55c9ac4d-49e2-49e6-898b-578a74ba5d64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:39.410688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55c9ac4d-49e2-49e6-898b-578a74ba5d64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:39.411449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55c9ac4d-49e2-49e6-898b-578a74ba5d64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:39.411876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55c9ac4d-49e2-49e6-898b-578a74ba5d64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:39.439034 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-55c9ac4d-49e2-49e6-898b-578a74ba5d64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040838 Jul 27 22:58:39.439567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 776/1563] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:39.736973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1adc65fc-ff78-44e1-b6f9-d29b2ef2cb5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:39.739650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1adc65fc-ff78-44e1-b6f9-d29b2ef2cb5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:39.745686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1adc65fc-ff78-44e1-b6f9-d29b2ef2cb5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:39.746129 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1adc65fc-ff78-44e1-b6f9-d29b2ef2cb5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:39.746884 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1adc65fc-ff78-44e1-b6f9-d29b2ef2cb5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:39.747315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1adc65fc-ff78-44e1-b6f9-d29b2ef2cb5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:39.775416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1adc65fc-ff78-44e1-b6f9-d29b2ef2cb5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042536 Jul 27 22:58:39.775951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 788/1564] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:39 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:40.281695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-19ad271d-53b9-4f1b-8ecb-6963d2bf5ea0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:40.283837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-19ad271d-53b9-4f1b-8ecb-6963d2bf5ea0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:40.290385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19ad271d-53b9-4f1b-8ecb-6963d2bf5ea0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:40.290830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19ad271d-53b9-4f1b-8ecb-6963d2bf5ea0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:40.291583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19ad271d-53b9-4f1b-8ecb-6963d2bf5ea0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:40.292041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19ad271d-53b9-4f1b-8ecb-6963d2bf5ea0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:40.295529 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:40.320028 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-19ad271d-53b9-4f1b-8ecb-6963d2bf5ea0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042261 Jul 27 22:58:40.320570 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 777/1565] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:40 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:40.346563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-88d8efd2-f45a-45cc-b7eb-1d3bee3df771 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:40.347166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-88d8efd2-f45a-45cc-b7eb-1d3bee3df771 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:40.354414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88d8efd2-f45a-45cc-b7eb-1d3bee3df771 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:40.354857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88d8efd2-f45a-45cc-b7eb-1d3bee3df771 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:40.355612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88d8efd2-f45a-45cc-b7eb-1d3bee3df771 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:40.356040 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88d8efd2-f45a-45cc-b7eb-1d3bee3df771 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:40.415378 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-88d8efd2-f45a-45cc-b7eb-1d3bee3df771 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:40.422703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-88d8efd2-f45a-45cc-b7eb-1d3bee3df771 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079949 Jul 27 22:58:40.423257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 789/1566] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:40 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:40.451189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-87ab581e-c3e7-438e-bb06-d98a494ce1b4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:40.453336 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-87ab581e-c3e7-438e-bb06-d98a494ce1b4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:40.459731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87ab581e-c3e7-438e-bb06-d98a494ce1b4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:40.460180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87ab581e-c3e7-438e-bb06-d98a494ce1b4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:40.460949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87ab581e-c3e7-438e-bb06-d98a494ce1b4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:40.461381 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87ab581e-c3e7-438e-bb06-d98a494ce1b4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:40.490269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-87ab581e-c3e7-438e-bb06-d98a494ce1b4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042976 Jul 27 22:58:40.490811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 778/1567] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:40.787195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-36875e90-c96e-4ae8-83a4-512ee89a19e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:40.789393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-36875e90-c96e-4ae8-83a4-512ee89a19e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:40.795462 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36875e90-c96e-4ae8-83a4-512ee89a19e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:40.795905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36875e90-c96e-4ae8-83a4-512ee89a19e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:40.796691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36875e90-c96e-4ae8-83a4-512ee89a19e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:40.797125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36875e90-c96e-4ae8-83a4-512ee89a19e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:40.826153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-36875e90-c96e-4ae8-83a4-512ee89a19e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042874 Jul 27 22:58:40.826711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 790/1568] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:40 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:41.332206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-51675252-2881-4c50-8613-ef90f31e5ba4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:41.334858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-51675252-2881-4c50-8613-ef90f31e5ba4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:41.340903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51675252-2881-4c50-8613-ef90f31e5ba4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:41.341354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51675252-2881-4c50-8613-ef90f31e5ba4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:41.342109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51675252-2881-4c50-8613-ef90f31e5ba4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:41.342547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51675252-2881-4c50-8613-ef90f31e5ba4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:41.371596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-51675252-2881-4c50-8613-ef90f31e5ba4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Jul 27 22:58:41.372132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 779/1569] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:41 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:41.443684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3f83584b-d228-4276-aa3b-7c51d99015d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:41.444231 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3f83584b-d228-4276-aa3b-7c51d99015d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:41.450644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3f83584b-d228-4276-aa3b-7c51d99015d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:41.451086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3f83584b-d228-4276-aa3b-7c51d99015d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:41.451842 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3f83584b-d228-4276-aa3b-7c51d99015d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:41.452274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3f83584b-d228-4276-aa3b-7c51d99015d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:41.502666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e85d0937-1990-4ab6-9367-b0bd00813496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:41.507611 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e85d0937-1990-4ab6-9367-b0bd00813496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:41.511105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e85d0937-1990-4ab6-9367-b0bd00813496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:41.511547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e85d0937-1990-4ab6-9367-b0bd00813496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:41.512314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e85d0937-1990-4ab6-9367-b0bd00813496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:41.512772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e85d0937-1990-4ab6-9367-b0bd00813496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:41.522455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3f83584b-d228-4276-aa3b-7c51d99015d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:41.530128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3f83584b-d228-4276-aa3b-7c51d99015d3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.090259 Jul 27 22:58:41.530701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 791/1570] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:41 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:41.542671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e85d0937-1990-4ab6-9367-b0bd00813496 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044030 Jul 27 22:58:41.543216 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 780/1571] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:58:41.839333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ba6dcffe-a4d4-40e6-af24-1c6fc9bcefce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:41.842065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ba6dcffe-a4d4-40e6-af24-1c6fc9bcefce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:41.849617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba6dcffe-a4d4-40e6-af24-1c6fc9bcefce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:41.850057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba6dcffe-a4d4-40e6-af24-1c6fc9bcefce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:41.850813 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba6dcffe-a4d4-40e6-af24-1c6fc9bcefce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:41.851244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba6dcffe-a4d4-40e6-af24-1c6fc9bcefce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:41.879858 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ba6dcffe-a4d4-40e6-af24-1c6fc9bcefce tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045475 Jul 27 22:58:41.880404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 792/1572] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:41 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:42.383873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2420d558-6a33-4613-8243-6216976ded37 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:42.386036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2420d558-6a33-4613-8243-6216976ded37 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:42.392091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2420d558-6a33-4613-8243-6216976ded37 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:42.392525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2420d558-6a33-4613-8243-6216976ded37 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:42.393296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2420d558-6a33-4613-8243-6216976ded37 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:42.393721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2420d558-6a33-4613-8243-6216976ded37 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:42.421407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2420d558-6a33-4613-8243-6216976ded37 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041978 Jul 27 22:58:42.421879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 781/1573] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:42 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:42.553278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1d2dc2af-a3ac-4556-838d-bf3ecf80d42f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:42.553877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1d2dc2af-a3ac-4556-838d-bf3ecf80d42f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:42.554478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-991cc2d0-83f3-4e9f-a291-eff071b63b69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:42.556611 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-991cc2d0-83f3-4e9f-a291-eff071b63b69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:42.560352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1d2dc2af-a3ac-4556-838d-bf3ecf80d42f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:42.560820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1d2dc2af-a3ac-4556-838d-bf3ecf80d42f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:42.561574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1d2dc2af-a3ac-4556-838d-bf3ecf80d42f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:42.561999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1d2dc2af-a3ac-4556-838d-bf3ecf80d42f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:42.562412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-991cc2d0-83f3-4e9f-a291-eff071b63b69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:42.562854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-991cc2d0-83f3-4e9f-a291-eff071b63b69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:42.563606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-991cc2d0-83f3-4e9f-a291-eff071b63b69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:42.564041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-991cc2d0-83f3-4e9f-a291-eff071b63b69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:42.592923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-991cc2d0-83f3-4e9f-a291-eff071b63b69 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042187 Jul 27 22:58:42.593485 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 782/1574] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:58:42.623224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1d2dc2af-a3ac-4556-838d-bf3ecf80d42f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:42.631188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1d2dc2af-a3ac-4556-838d-bf3ecf80d42f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081774 Jul 27 22:58:42.631750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 793/1575] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:42 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:42.891487 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-897fef54-6f19-4c7a-8231-2e0669f7eb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:42.893712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-897fef54-6f19-4c7a-8231-2e0669f7eb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:42.895514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:42.900821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-897fef54-6f19-4c7a-8231-2e0669f7eb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:42.901266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-897fef54-6f19-4c7a-8231-2e0669f7eb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:42.902018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-897fef54-6f19-4c7a-8231-2e0669f7eb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:42.902450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-897fef54-6f19-4c7a-8231-2e0669f7eb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:42.930619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-897fef54-6f19-4c7a-8231-2e0669f7eb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043097 Jul 27 22:58:42.931156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 783/1576] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:42 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:43.433778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8390d570-8191-41b4-90f9-ceaff47a68ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:43.436124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8390d570-8191-41b4-90f9-ceaff47a68ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:43.442564 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8390d570-8191-41b4-90f9-ceaff47a68ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:43.443002 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8390d570-8191-41b4-90f9-ceaff47a68ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:43.444110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8390d570-8191-41b4-90f9-ceaff47a68ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:43.444545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8390d570-8191-41b4-90f9-ceaff47a68ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:43.474472 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8390d570-8191-41b4-90f9-ceaff47a68ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044761 Jul 27 22:58:43.475005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 794/1577] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:43 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:43.606060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3c73c99f-d361-4968-82ee-f74835c554a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:43.608186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3c73c99f-d361-4968-82ee-f74835c554a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:43.614287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c73c99f-d361-4968-82ee-f74835c554a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:43.614734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c73c99f-d361-4968-82ee-f74835c554a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:43.615486 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c73c99f-d361-4968-82ee-f74835c554a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:43.615918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c73c99f-d361-4968-82ee-f74835c554a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:43.643393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3c73c99f-d361-4968-82ee-f74835c554a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041605 Jul 27 22:58:43.643935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 784/1578] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:43.651592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-17d4617a-f0c0-42be-abed-e1d7ed771954 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:43.652192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-17d4617a-f0c0-42be-abed-e1d7ed771954 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:43.658601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-17d4617a-f0c0-42be-abed-e1d7ed771954 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:43.659037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-17d4617a-f0c0-42be-abed-e1d7ed771954 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:43.659785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-17d4617a-f0c0-42be-abed-e1d7ed771954 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:43.660212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-17d4617a-f0c0-42be-abed-e1d7ed771954 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:43.719664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-17d4617a-f0c0-42be-abed-e1d7ed771954 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:43.727693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-17d4617a-f0c0-42be-abed-e1d7ed771954 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079910 Jul 27 22:58:43.728517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 795/1579] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:43 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:43.943372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c64626ff-aa88-4c64-b3b1-136d7033ec4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:43.945548 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c64626ff-aa88-4c64-b3b1-136d7033ec4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:43.951732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c64626ff-aa88-4c64-b3b1-136d7033ec4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:43.952221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c64626ff-aa88-4c64-b3b1-136d7033ec4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:43.953145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c64626ff-aa88-4c64-b3b1-136d7033ec4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:43.953614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c64626ff-aa88-4c64-b3b1-136d7033ec4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:43.982664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c64626ff-aa88-4c64-b3b1-136d7033ec4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043850 Jul 27 22:58:43.983198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 785/1580] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:43 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:44.486934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6de3e3a1-eca3-4627-807d-7af6b3f071bb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:44.489637 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6de3e3a1-eca3-4627-807d-7af6b3f071bb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:44.495663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6de3e3a1-eca3-4627-807d-7af6b3f071bb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:44.496102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6de3e3a1-eca3-4627-807d-7af6b3f071bb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:44.496898 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6de3e3a1-eca3-4627-807d-7af6b3f071bb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:44.497331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6de3e3a1-eca3-4627-807d-7af6b3f071bb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:44.525673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6de3e3a1-eca3-4627-807d-7af6b3f071bb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042664 Jul 27 22:58:44.526209 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 796/1581] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:44 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:44.656240 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ed739fe8-0455-48d3-a6b3-ccad3b9515e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:44.658505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ed739fe8-0455-48d3-a6b3-ccad3b9515e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:44.665007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed739fe8-0455-48d3-a6b3-ccad3b9515e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:44.665446 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed739fe8-0455-48d3-a6b3-ccad3b9515e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:44.666202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed739fe8-0455-48d3-a6b3-ccad3b9515e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:44.666627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed739fe8-0455-48d3-a6b3-ccad3b9515e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:44.694784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ed739fe8-0455-48d3-a6b3-ccad3b9515e8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042905 Jul 27 22:58:44.695320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 786/1582] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:44 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:44.748268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-33e891b9-ab2e-4ca2-9e56-55b72b9c8555 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:44.748840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-33e891b9-ab2e-4ca2-9e56-55b72b9c8555 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:44.755337 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-33e891b9-ab2e-4ca2-9e56-55b72b9c8555 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:44.755781 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-33e891b9-ab2e-4ca2-9e56-55b72b9c8555 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:44.756535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-33e891b9-ab2e-4ca2-9e56-55b72b9c8555 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:44.756990 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-33e891b9-ab2e-4ca2-9e56-55b72b9c8555 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:44.824058 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-33e891b9-ab2e-4ca2-9e56-55b72b9c8555 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:44.831632 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-33e891b9-ab2e-4ca2-9e56-55b72b9c8555 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.087284 Jul 27 22:58:44.832192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 797/1583] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:44 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:44.994673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f12be13f-fabc-4736-ad73-37d95f344265 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:44.996875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f12be13f-fabc-4736-ad73-37d95f344265 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:45.002798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f12be13f-fabc-4736-ad73-37d95f344265 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:45.003177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f12be13f-fabc-4736-ad73-37d95f344265 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:45.003924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f12be13f-fabc-4736-ad73-37d95f344265 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:45.004351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f12be13f-fabc-4736-ad73-37d95f344265 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:45.032174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f12be13f-fabc-4736-ad73-37d95f344265 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041470 Jul 27 22:58:45.032728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 787/1584] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:44 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:45.537995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ee6c5a76-2ffa-46ce-bc9a-60c446998bb0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:45.540317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ee6c5a76-2ffa-46ce-bc9a-60c446998bb0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:45.542358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:45.547663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ee6c5a76-2ffa-46ce-bc9a-60c446998bb0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:45.548099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ee6c5a76-2ffa-46ce-bc9a-60c446998bb0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:45.548891 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ee6c5a76-2ffa-46ce-bc9a-60c446998bb0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:45.549316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ee6c5a76-2ffa-46ce-bc9a-60c446998bb0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:45.577650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ee6c5a76-2ffa-46ce-bc9a-60c446998bb0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043621 Jul 27 22:58:45.578190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 798/1585] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:45 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:45.706933 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-208a8a88-cb59-4710-92b5-0e6cd7bd53bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:45.709601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-208a8a88-cb59-4710-92b5-0e6cd7bd53bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:45.715650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-208a8a88-cb59-4710-92b5-0e6cd7bd53bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:45.716095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-208a8a88-cb59-4710-92b5-0e6cd7bd53bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:45.716895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-208a8a88-cb59-4710-92b5-0e6cd7bd53bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:45.717328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-208a8a88-cb59-4710-92b5-0e6cd7bd53bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:45.745849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-208a8a88-cb59-4710-92b5-0e6cd7bd53bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042872 Jul 27 22:58:45.746387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 788/1586] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:45 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:45.852571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-191d00b4-9143-4ac7-a74d-e6a9787d9bab tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:45.853444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-191d00b4-9143-4ac7-a74d-e6a9787d9bab tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:45.859795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-191d00b4-9143-4ac7-a74d-e6a9787d9bab tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:45.860244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-191d00b4-9143-4ac7-a74d-e6a9787d9bab tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:45.861035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-191d00b4-9143-4ac7-a74d-e6a9787d9bab tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:45.861473 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-191d00b4-9143-4ac7-a74d-e6a9787d9bab tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:45.925256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-191d00b4-9143-4ac7-a74d-e6a9787d9bab tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:45.932801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-191d00b4-9143-4ac7-a74d-e6a9787d9bab tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084800 Jul 27 22:58:45.933360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 799/1587] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:45 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:46.044330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4c09a161-c340-441b-bbde-3957bb08a5a5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:46.046512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4c09a161-c340-441b-bbde-3957bb08a5a5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:46.052435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c09a161-c340-441b-bbde-3957bb08a5a5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:46.052914 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c09a161-c340-441b-bbde-3957bb08a5a5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:46.053669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c09a161-c340-441b-bbde-3957bb08a5a5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:46.054105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c09a161-c340-441b-bbde-3957bb08a5a5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:46.082303 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4c09a161-c340-441b-bbde-3957bb08a5a5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041867 Jul 27 22:58:46.082839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 789/1588] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:46 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:46.589865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e32d83b7-b10b-4bf0-b42d-9413c04de2b7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:46.592016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e32d83b7-b10b-4bf0-b42d-9413c04de2b7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:46.598105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e32d83b7-b10b-4bf0-b42d-9413c04de2b7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:46.598551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e32d83b7-b10b-4bf0-b42d-9413c04de2b7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:46.599312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e32d83b7-b10b-4bf0-b42d-9413c04de2b7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:46.599747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e32d83b7-b10b-4bf0-b42d-9413c04de2b7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:46.628176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e32d83b7-b10b-4bf0-b42d-9413c04de2b7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042276 Jul 27 22:58:46.628749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 800/1589] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:46 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:46.758675 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5bd48569-ae10-4dcd-ba99-98b4bf00b0f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:46.760845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5bd48569-ae10-4dcd-ba99-98b4bf00b0f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:46.766803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bd48569-ae10-4dcd-ba99-98b4bf00b0f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:46.767251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bd48569-ae10-4dcd-ba99-98b4bf00b0f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:46.768012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bd48569-ae10-4dcd-ba99-98b4bf00b0f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:46.768444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bd48569-ae10-4dcd-ba99-98b4bf00b0f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:46.797839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5bd48569-ae10-4dcd-ba99-98b4bf00b0f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043820 Jul 27 22:58:46.798381 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 790/1590] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:46.958336 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3cee4e4d-d57b-4146-a583-fceec3df4594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:46.958857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3cee4e4d-d57b-4146-a583-fceec3df4594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:46.966302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3cee4e4d-d57b-4146-a583-fceec3df4594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:46.966744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3cee4e4d-d57b-4146-a583-fceec3df4594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:46.967495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3cee4e4d-d57b-4146-a583-fceec3df4594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:46.967953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3cee4e4d-d57b-4146-a583-fceec3df4594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:47.028992 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3cee4e4d-d57b-4146-a583-fceec3df4594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:47.036869 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3cee4e4d-d57b-4146-a583-fceec3df4594 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082431 Jul 27 22:58:47.037421 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 801/1591] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:46 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:47.094989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-43a9cc73-1606-4c9d-88e7-45af0241c238 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:47.097221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-43a9cc73-1606-4c9d-88e7-45af0241c238 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:47.103476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43a9cc73-1606-4c9d-88e7-45af0241c238 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:47.103926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43a9cc73-1606-4c9d-88e7-45af0241c238 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:47.104730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43a9cc73-1606-4c9d-88e7-45af0241c238 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:47.105167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43a9cc73-1606-4c9d-88e7-45af0241c238 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:47.134772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-43a9cc73-1606-4c9d-88e7-45af0241c238 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043593 Jul 27 22:58:47.135602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 791/1592] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:47 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:47.641907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2d783e62-e40a-4559-801c-aa2c6273243f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:47.644041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2d783e62-e40a-4559-801c-aa2c6273243f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:47.650142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d783e62-e40a-4559-801c-aa2c6273243f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:47.650690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d783e62-e40a-4559-801c-aa2c6273243f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:47.651478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d783e62-e40a-4559-801c-aa2c6273243f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:47.652083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d783e62-e40a-4559-801c-aa2c6273243f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:47.682750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2d783e62-e40a-4559-801c-aa2c6273243f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045442 Jul 27 22:58:47.683450 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 802/1593] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:47 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:47.810627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9dd02712-8198-437a-9326-14ef659bb197 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:47.812939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9dd02712-8198-437a-9326-14ef659bb197 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:47.818823 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9dd02712-8198-437a-9326-14ef659bb197 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:47.819304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9dd02712-8198-437a-9326-14ef659bb197 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:47.820052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9dd02712-8198-437a-9326-14ef659bb197 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:47.820481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9dd02712-8198-437a-9326-14ef659bb197 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:47.847906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9dd02712-8198-437a-9326-14ef659bb197 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041221 Jul 27 22:58:47.848441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 792/1594] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:48.057816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3e2b7fb0-8b33-41a2-976d-c086ef23a86b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:48.058424 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3e2b7fb0-8b33-41a2-976d-c086ef23a86b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:48.065183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e2b7fb0-8b33-41a2-976d-c086ef23a86b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:48.065623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e2b7fb0-8b33-41a2-976d-c086ef23a86b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:48.066374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e2b7fb0-8b33-41a2-976d-c086ef23a86b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:48.066798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e2b7fb0-8b33-41a2-976d-c086ef23a86b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:48.127527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3e2b7fb0-8b33-41a2-976d-c086ef23a86b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:48.130828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:48.136112 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3e2b7fb0-8b33-41a2-976d-c086ef23a86b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082383 Jul 27 22:58:48.137011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 803/1595] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:48 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:48.147577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-23575744-1432-4dab-aa6f-10600a1815df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:48.149840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-23575744-1432-4dab-aa6f-10600a1815df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:48.156020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23575744-1432-4dab-aa6f-10600a1815df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:48.156458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23575744-1432-4dab-aa6f-10600a1815df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:48.157244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23575744-1432-4dab-aa6f-10600a1815df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:48.157670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23575744-1432-4dab-aa6f-10600a1815df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:48.181979 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:48.186785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-23575744-1432-4dab-aa6f-10600a1815df tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Jul 27 22:58:48.187360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 793/1596] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:48 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:48.694712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8d983143-a32e-4e52-bc75-b208793e90d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:48.696902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8d983143-a32e-4e52-bc75-b208793e90d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:48.703246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d983143-a32e-4e52-bc75-b208793e90d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:48.703681 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d983143-a32e-4e52-bc75-b208793e90d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:48.704427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d983143-a32e-4e52-bc75-b208793e90d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:48.704881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d983143-a32e-4e52-bc75-b208793e90d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:48.733358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8d983143-a32e-4e52-bc75-b208793e90d5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042787 Jul 27 22:58:48.733887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 804/1597] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:48 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:48.861012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7421bb0c-3f87-4bc0-b7fb-7e22ef882a6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:48.863119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7421bb0c-3f87-4bc0-b7fb-7e22ef882a6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:48.869019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7421bb0c-3f87-4bc0-b7fb-7e22ef882a6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:48.869402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7421bb0c-3f87-4bc0-b7fb-7e22ef882a6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:48.870148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7421bb0c-3f87-4bc0-b7fb-7e22ef882a6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:48.870576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7421bb0c-3f87-4bc0-b7fb-7e22ef882a6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:48.898659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7421bb0c-3f87-4bc0-b7fb-7e22ef882a6d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041837 Jul 27 22:58:48.899190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 794/1598] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:48 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:49.157615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-60cc846a-8f17-4051-b7b4-a390cedad6bf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:49.158224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-60cc846a-8f17-4051-b7b4-a390cedad6bf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:49.164419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60cc846a-8f17-4051-b7b4-a390cedad6bf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:49.164942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60cc846a-8f17-4051-b7b4-a390cedad6bf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:49.165697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60cc846a-8f17-4051-b7b4-a390cedad6bf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:49.166125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60cc846a-8f17-4051-b7b4-a390cedad6bf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:49.199667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-90514362-c255-4a29-913a-0879463663a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:49.201852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-90514362-c255-4a29-913a-0879463663a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:49.209339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90514362-c255-4a29-913a-0879463663a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:49.210371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90514362-c255-4a29-913a-0879463663a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:49.211137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90514362-c255-4a29-913a-0879463663a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:49.211564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90514362-c255-4a29-913a-0879463663a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:49.228257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-60cc846a-8f17-4051-b7b4-a390cedad6bf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:49.235745 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-60cc846a-8f17-4051-b7b4-a390cedad6bf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081983 Jul 27 22:58:49.236312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 805/1599] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:49 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:58:49.240594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-90514362-c255-4a29-913a-0879463663a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044734 Jul 27 22:58:49.241140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 795/1600] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:49 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:58:49.745944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9b81cd39-a1c6-4943-a334-42f738cfa772 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:49.748099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9b81cd39-a1c6-4943-a334-42f738cfa772 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:49.754560 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b81cd39-a1c6-4943-a334-42f738cfa772 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:49.755018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b81cd39-a1c6-4943-a334-42f738cfa772 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:49.755780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b81cd39-a1c6-4943-a334-42f738cfa772 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:49.756218 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b81cd39-a1c6-4943-a334-42f738cfa772 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:49.784485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9b81cd39-a1c6-4943-a334-42f738cfa772 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042550 Jul 27 22:58:49.785059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 806/1601] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:49 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:49.911106 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8f089689-c0c9-4b75-8391-9d1b81e01d67 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:49.913818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8f089689-c0c9-4b75-8391-9d1b81e01d67 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:49.919827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f089689-c0c9-4b75-8391-9d1b81e01d67 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:49.920273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f089689-c0c9-4b75-8391-9d1b81e01d67 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:49.921069 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f089689-c0c9-4b75-8391-9d1b81e01d67 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:49.921502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f089689-c0c9-4b75-8391-9d1b81e01d67 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:49.950667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8f089689-c0c9-4b75-8391-9d1b81e01d67 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043407 Jul 27 22:58:49.951141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 796/1602] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:49 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:50.252854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e33e6c2f-86c2-4f5c-822d-653a08e98a75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:50.255017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e33e6c2f-86c2-4f5c-822d-653a08e98a75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:50.256745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-268ff259-ec73-4f70-9229-5415da899b3f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:50.257358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-268ff259-ec73-4f70-9229-5415da899b3f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:50.261266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e33e6c2f-86c2-4f5c-822d-653a08e98a75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:50.261723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e33e6c2f-86c2-4f5c-822d-653a08e98a75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:50.262496 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e33e6c2f-86c2-4f5c-822d-653a08e98a75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:50.262934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e33e6c2f-86c2-4f5c-822d-653a08e98a75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:50.263243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-268ff259-ec73-4f70-9229-5415da899b3f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:50.263684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-268ff259-ec73-4f70-9229-5415da899b3f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:50.264440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-268ff259-ec73-4f70-9229-5415da899b3f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:50.264895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-268ff259-ec73-4f70-9229-5415da899b3f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:50.292322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e33e6c2f-86c2-4f5c-822d-653a08e98a75 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043588 Jul 27 22:58:50.292918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 807/1603] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:50 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:50.326997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-268ff259-ec73-4f70-9229-5415da899b3f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:50.334389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-268ff259-ec73-4f70-9229-5415da899b3f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081789 Jul 27 22:58:50.335249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 797/1604] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:50 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:50.797722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f9f2f5a7-b1e2-4052-a689-2e17c7a57d92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:50.799856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f9f2f5a7-b1e2-4052-a689-2e17c7a57d92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:50.807350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9f2f5a7-b1e2-4052-a689-2e17c7a57d92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:50.807790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9f2f5a7-b1e2-4052-a689-2e17c7a57d92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:50.808540 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9f2f5a7-b1e2-4052-a689-2e17c7a57d92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:50.808993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f9f2f5a7-b1e2-4052-a689-2e17c7a57d92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:50.837341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f9f2f5a7-b1e2-4052-a689-2e17c7a57d92 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043485 Jul 27 22:58:50.837895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 808/1605] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:50.962495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cf71675a-45ca-46a7-9345-01251667bd8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:50.964734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cf71675a-45ca-46a7-9345-01251667bd8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:50.971166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf71675a-45ca-46a7-9345-01251667bd8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:50.971616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf71675a-45ca-46a7-9345-01251667bd8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:50.972386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf71675a-45ca-46a7-9345-01251667bd8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:50.972847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf71675a-45ca-46a7-9345-01251667bd8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:51.002208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cf71675a-45ca-46a7-9345-01251667bd8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043704 Jul 27 22:58:51.002762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 798/1606] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:50 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:51.305327 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-977216d8-d29c-4159-827d-782b9fd4c472 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:51.307471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-977216d8-d29c-4159-827d-782b9fd4c472 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:51.313453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-977216d8-d29c-4159-827d-782b9fd4c472 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:51.313895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-977216d8-d29c-4159-827d-782b9fd4c472 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:51.314648 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-977216d8-d29c-4159-827d-782b9fd4c472 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:51.315078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-977216d8-d29c-4159-827d-782b9fd4c472 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:51.343592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-977216d8-d29c-4159-827d-782b9fd4c472 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042882 Jul 27 22:58:51.344069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 809/1607] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:51 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:51.355764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-61eafee7-cbbb-45a7-ab38-d2a1eaafd7f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:51.356371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-61eafee7-cbbb-45a7-ab38-d2a1eaafd7f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:51.362415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61eafee7-cbbb-45a7-ab38-d2a1eaafd7f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:51.362860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61eafee7-cbbb-45a7-ab38-d2a1eaafd7f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:51.363613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61eafee7-cbbb-45a7-ab38-d2a1eaafd7f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:51.364046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61eafee7-cbbb-45a7-ab38-d2a1eaafd7f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:51.423307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-61eafee7-cbbb-45a7-ab38-d2a1eaafd7f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:51.431268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-61eafee7-cbbb-45a7-ab38-d2a1eaafd7f0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080070 Jul 27 22:58:51.431815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 799/1608] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:51 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:51.849497 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6eda20ee-987b-44bf-bac4-da9dfc0ad85e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:51.852312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6eda20ee-987b-44bf-bac4-da9dfc0ad85e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:51.859115 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6eda20ee-987b-44bf-bac4-da9dfc0ad85e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:51.859566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6eda20ee-987b-44bf-bac4-da9dfc0ad85e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:51.860332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6eda20ee-987b-44bf-bac4-da9dfc0ad85e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:51.860798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6eda20ee-987b-44bf-bac4-da9dfc0ad85e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:51.888313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6eda20ee-987b-44bf-bac4-da9dfc0ad85e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042847 Jul 27 22:58:51.888893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 810/1609] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:51 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:52.014928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0a9ae0ab-c586-4831-996d-33bab59bd9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:52.017053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0a9ae0ab-c586-4831-996d-33bab59bd9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:52.023076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a9ae0ab-c586-4831-996d-33bab59bd9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:52.024164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a9ae0ab-c586-4831-996d-33bab59bd9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:52.024947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a9ae0ab-c586-4831-996d-33bab59bd9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:52.025386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a9ae0ab-c586-4831-996d-33bab59bd9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:52.053207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0a9ae0ab-c586-4831-996d-33bab59bd9e6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042370 Jul 27 22:58:52.053744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 800/1610] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:52 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:52.356008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1c10dd26-444c-4103-9ae0-d324edca4972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:52.358237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1c10dd26-444c-4103-9ae0-d324edca4972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:52.364247 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c10dd26-444c-4103-9ae0-d324edca4972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:52.364736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c10dd26-444c-4103-9ae0-d324edca4972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:52.365505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c10dd26-444c-4103-9ae0-d324edca4972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:52.365938 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c10dd26-444c-4103-9ae0-d324edca4972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:52.395083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1c10dd26-444c-4103-9ae0-d324edca4972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043304 Jul 27 22:58:52.395628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 811/1611] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:52 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:52.452226 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d01be2c1-2648-492e-90fe-bf6d814e2603 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:52.452849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d01be2c1-2648-492e-90fe-bf6d814e2603 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:52.459134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d01be2c1-2648-492e-90fe-bf6d814e2603 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:52.459571 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d01be2c1-2648-492e-90fe-bf6d814e2603 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:52.461998 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d01be2c1-2648-492e-90fe-bf6d814e2603 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:52.461998 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d01be2c1-2648-492e-90fe-bf6d814e2603 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:52.520504 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d01be2c1-2648-492e-90fe-bf6d814e2603 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:52.527858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d01be2c1-2648-492e-90fe-bf6d814e2603 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079433 Jul 27 22:58:52.528406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 801/1612] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:52 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:52.900578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7f6ce067-f6de-4d2d-bdfd-f0ba4e8204be tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:52.902766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7f6ce067-f6de-4d2d-bdfd-f0ba4e8204be tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:52.909302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f6ce067-f6de-4d2d-bdfd-f0ba4e8204be tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:52.909753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f6ce067-f6de-4d2d-bdfd-f0ba4e8204be tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:52.910511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f6ce067-f6de-4d2d-bdfd-f0ba4e8204be tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:52.910948 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f6ce067-f6de-4d2d-bdfd-f0ba4e8204be tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:52.939613 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7f6ce067-f6de-4d2d-bdfd-f0ba4e8204be tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043070 Jul 27 22:58:52.940159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 812/1613] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:52 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:53.065377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fd912803-3927-4a32-b1f7-df1e3cddd847 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:53.067541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fd912803-3927-4a32-b1f7-df1e3cddd847 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:53.073625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd912803-3927-4a32-b1f7-df1e3cddd847 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:53.074072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd912803-3927-4a32-b1f7-df1e3cddd847 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:53.074824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd912803-3927-4a32-b1f7-df1e3cddd847 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:53.075259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd912803-3927-4a32-b1f7-df1e3cddd847 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:53.103762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fd912803-3927-4a32-b1f7-df1e3cddd847 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042376 Jul 27 22:58:53.104294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 802/1614] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:53 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:53.407291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c7ea8ba8-5dee-45cd-9daf-823859634978 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:53.409482 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c7ea8ba8-5dee-45cd-9daf-823859634978 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:53.416088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c7ea8ba8-5dee-45cd-9daf-823859634978 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:53.416545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c7ea8ba8-5dee-45cd-9daf-823859634978 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:53.417332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c7ea8ba8-5dee-45cd-9daf-823859634978 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:53.417768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c7ea8ba8-5dee-45cd-9daf-823859634978 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:53.448398 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c7ea8ba8-5dee-45cd-9daf-823859634978 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045033 Jul 27 22:58:53.448988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 813/1615] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:53 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:53.548232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3a35720e-37d6-484a-8567-95822e9c05dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:53.548869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3a35720e-37d6-484a-8567-95822e9c05dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:53.554810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3a35720e-37d6-484a-8567-95822e9c05dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:53.555254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3a35720e-37d6-484a-8567-95822e9c05dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:53.556002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3a35720e-37d6-484a-8567-95822e9c05dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:53.556430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3a35720e-37d6-484a-8567-95822e9c05dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:53.616262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3a35720e-37d6-484a-8567-95822e9c05dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:53.623600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3a35720e-37d6-484a-8567-95822e9c05dc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079236 Jul 27 22:58:53.624156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 803/1616] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:53 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:53.952035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7dfe258a-2fd6-4ad1-8ff2-8cad9ccbc2e5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:53.954176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7dfe258a-2fd6-4ad1-8ff2-8cad9ccbc2e5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:53.960965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7dfe258a-2fd6-4ad1-8ff2-8cad9ccbc2e5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:53.961404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7dfe258a-2fd6-4ad1-8ff2-8cad9ccbc2e5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:53.962149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7dfe258a-2fd6-4ad1-8ff2-8cad9ccbc2e5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:53.962575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7dfe258a-2fd6-4ad1-8ff2-8cad9ccbc2e5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:53.990191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7dfe258a-2fd6-4ad1-8ff2-8cad9ccbc2e5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042205 Jul 27 22:58:53.990731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 814/1617] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:53 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:54.116019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6fa48a46-8df4-4ed3-839b-ff052e724bef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:54.118663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6fa48a46-8df4-4ed3-839b-ff052e724bef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:54.124592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6fa48a46-8df4-4ed3-839b-ff052e724bef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:54.125033 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6fa48a46-8df4-4ed3-839b-ff052e724bef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:54.125779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6fa48a46-8df4-4ed3-839b-ff052e724bef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:54.126202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6fa48a46-8df4-4ed3-839b-ff052e724bef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:54.155705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6fa48a46-8df4-4ed3-839b-ff052e724bef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043555 Jul 27 22:58:54.156280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 804/1618] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:54 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:54.460619 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-378876ca-6091-406e-9a81-4967ac2fe430 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:54.463097 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-378876ca-6091-406e-9a81-4967ac2fe430 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:54.469128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-378876ca-6091-406e-9a81-4967ac2fe430 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:54.469578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-378876ca-6091-406e-9a81-4967ac2fe430 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:54.470340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-378876ca-6091-406e-9a81-4967ac2fe430 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:54.470779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-378876ca-6091-406e-9a81-4967ac2fe430 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:54.500916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-378876ca-6091-406e-9a81-4967ac2fe430 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Jul 27 22:58:54.501477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 815/1619] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:54 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:54.644606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-814eefa4-43cc-4c98-afb2-720c5d14b62c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:54.645215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-814eefa4-43cc-4c98-afb2-720c5d14b62c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:54.651674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-814eefa4-43cc-4c98-afb2-720c5d14b62c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:54.652119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-814eefa4-43cc-4c98-afb2-720c5d14b62c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:54.652900 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-814eefa4-43cc-4c98-afb2-720c5d14b62c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:54.653328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-814eefa4-43cc-4c98-afb2-720c5d14b62c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:54.714935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-814eefa4-43cc-4c98-afb2-720c5d14b62c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:54.722313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-814eefa4-43cc-4c98-afb2-720c5d14b62c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081647 Jul 27 22:58:54.722870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 805/1620] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:54 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:55.003037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e243762e-82fc-4048-8449-f39f60bb0362 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:55.005186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e243762e-82fc-4048-8449-f39f60bb0362 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:55.012519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e243762e-82fc-4048-8449-f39f60bb0362 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:55.012989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e243762e-82fc-4048-8449-f39f60bb0362 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:55.013748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e243762e-82fc-4048-8449-f39f60bb0362 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:55.014180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e243762e-82fc-4048-8449-f39f60bb0362 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:55.043391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e243762e-82fc-4048-8449-f39f60bb0362 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044363 Jul 27 22:58:55.044167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 816/1621] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:54 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:55.167501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ae653d10-dece-414a-a299-ecc08cacd900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:55.169676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ae653d10-dece-414a-a299-ecc08cacd900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:55.175765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae653d10-dece-414a-a299-ecc08cacd900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:55.176214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae653d10-dece-414a-a299-ecc08cacd900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:55.176998 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae653d10-dece-414a-a299-ecc08cacd900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:55.177437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae653d10-dece-414a-a299-ecc08cacd900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:55.211616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ae653d10-dece-414a-a299-ecc08cacd900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047336 Jul 27 22:58:55.212182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 806/1622] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:55 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:55.513710 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-54e05738-5b44-4ce2-a895-b8a48b13b178 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:55.515920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-54e05738-5b44-4ce2-a895-b8a48b13b178 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:55.522124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54e05738-5b44-4ce2-a895-b8a48b13b178 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:55.522568 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54e05738-5b44-4ce2-a895-b8a48b13b178 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:55.523485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54e05738-5b44-4ce2-a895-b8a48b13b178 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:55.523919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54e05738-5b44-4ce2-a895-b8a48b13b178 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:55.552541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-54e05738-5b44-4ce2-a895-b8a48b13b178 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042772 Jul 27 22:58:55.553108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 817/1623] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:55 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:55.744169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1c0e89dc-cbe1-4e5a-9737-701e36c1810a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:55.744805 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1c0e89dc-cbe1-4e5a-9737-701e36c1810a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:55.750727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c0e89dc-cbe1-4e5a-9737-701e36c1810a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:55.751159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c0e89dc-cbe1-4e5a-9737-701e36c1810a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:55.751906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c0e89dc-cbe1-4e5a-9737-701e36c1810a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:55.752329 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c0e89dc-cbe1-4e5a-9737-701e36c1810a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:55.811361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1c0e89dc-cbe1-4e5a-9737-701e36c1810a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:55.818662 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1c0e89dc-cbe1-4e5a-9737-701e36c1810a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078887 Jul 27 22:58:55.819205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 807/1624] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:55 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:56.056198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ba015429-0d5c-4e6b-8ae4-39b5e7e7ea26 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:56.058559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ba015429-0d5c-4e6b-8ae4-39b5e7e7ea26 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:56.065137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba015429-0d5c-4e6b-8ae4-39b5e7e7ea26 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:56.065533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba015429-0d5c-4e6b-8ae4-39b5e7e7ea26 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:56.066298 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba015429-0d5c-4e6b-8ae4-39b5e7e7ea26 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:56.066730 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba015429-0d5c-4e6b-8ae4-39b5e7e7ea26 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:56.094331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ba015429-0d5c-4e6b-8ae4-39b5e7e7ea26 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042820 Jul 27 22:58:56.094878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 818/1625] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:56 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:56.223928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ee02b80a-8dfa-4d6a-a882-c094bb867b9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:56.226100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ee02b80a-8dfa-4d6a-a882-c094bb867b9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:56.232996 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ee02b80a-8dfa-4d6a-a882-c094bb867b9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:56.233444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ee02b80a-8dfa-4d6a-a882-c094bb867b9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:56.234198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ee02b80a-8dfa-4d6a-a882-c094bb867b9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:56.234738 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ee02b80a-8dfa-4d6a-a882-c094bb867b9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:56.263022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ee02b80a-8dfa-4d6a-a882-c094bb867b9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043063 Jul 27 22:58:56.263564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 808/1626] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:56.565389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d9d77169-372f-455f-9e5c-943c37d2f28e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:56.567612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d9d77169-372f-455f-9e5c-943c37d2f28e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:56.574077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9d77169-372f-455f-9e5c-943c37d2f28e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:56.574608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9d77169-372f-455f-9e5c-943c37d2f28e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:56.575308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9d77169-372f-455f-9e5c-943c37d2f28e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:56.575740 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9d77169-372f-455f-9e5c-943c37d2f28e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:56.604681 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d9d77169-372f-455f-9e5c-943c37d2f28e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043228 Jul 27 22:58:56.605231 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 819/1627] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:56 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:56.839094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2562f245-15b3-446c-ad37-018eb5b59dc6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:56.839611 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2562f245-15b3-446c-ad37-018eb5b59dc6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:56.845775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2562f245-15b3-446c-ad37-018eb5b59dc6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:56.846216 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2562f245-15b3-446c-ad37-018eb5b59dc6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:56.846963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2562f245-15b3-446c-ad37-018eb5b59dc6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:56.847386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2562f245-15b3-446c-ad37-018eb5b59dc6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:56.907527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2562f245-15b3-446c-ad37-018eb5b59dc6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:56.915433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2562f245-15b3-446c-ad37-018eb5b59dc6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080374 Jul 27 22:58:56.915992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 809/1628] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:56 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:57.107506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d24195b3-f9d0-4658-abf8-3e31fe29095a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:57.109624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d24195b3-f9d0-4658-abf8-3e31fe29095a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:57.116042 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d24195b3-f9d0-4658-abf8-3e31fe29095a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:57.116485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d24195b3-f9d0-4658-abf8-3e31fe29095a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:57.117270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d24195b3-f9d0-4658-abf8-3e31fe29095a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:57.117699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d24195b3-f9d0-4658-abf8-3e31fe29095a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:57.134683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:57.149307 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d24195b3-f9d0-4658-abf8-3e31fe29095a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045184 Jul 27 22:58:57.150294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 820/1629] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:57 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:57.275692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ebde2e0f-f98f-4864-af55-83c823ef13b0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:57.277841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ebde2e0f-f98f-4864-af55-83c823ef13b0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:57.283742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebde2e0f-f98f-4864-af55-83c823ef13b0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:57.284214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebde2e0f-f98f-4864-af55-83c823ef13b0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:57.284987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebde2e0f-f98f-4864-af55-83c823ef13b0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:57.285409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebde2e0f-f98f-4864-af55-83c823ef13b0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:57.301250 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:57.313768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ebde2e0f-f98f-4864-af55-83c823ef13b0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042623 Jul 27 22:58:57.314300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 810/1630] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:57 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:57.617478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-38b6eaf7-eafd-424c-9d2e-b3f2dafec5c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:57.619635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-38b6eaf7-eafd-424c-9d2e-b3f2dafec5c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:57.625663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-38b6eaf7-eafd-424c-9d2e-b3f2dafec5c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:57.626116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-38b6eaf7-eafd-424c-9d2e-b3f2dafec5c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:57.626880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-38b6eaf7-eafd-424c-9d2e-b3f2dafec5c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:57.627318 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-38b6eaf7-eafd-424c-9d2e-b3f2dafec5c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:57.656803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-38b6eaf7-eafd-424c-9d2e-b3f2dafec5c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043739 Jul 27 22:58:57.657346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 821/1631] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:57 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:57.936601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ce91c69e-b1a8-43bd-adb9-8bc3a1d9aa10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:57.937209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ce91c69e-b1a8-43bd-adb9-8bc3a1d9aa10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:57.943135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce91c69e-b1a8-43bd-adb9-8bc3a1d9aa10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:57.943577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce91c69e-b1a8-43bd-adb9-8bc3a1d9aa10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:57.944327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce91c69e-b1a8-43bd-adb9-8bc3a1d9aa10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:57.944782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce91c69e-b1a8-43bd-adb9-8bc3a1d9aa10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:58.005055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ce91c69e-b1a8-43bd-adb9-8bc3a1d9aa10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:58.012501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ce91c69e-b1a8-43bd-adb9-8bc3a1d9aa10 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079782 Jul 27 22:58:58.013086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 811/1632] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:57 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:58.161908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-67a141ac-c54c-4bc0-9fa7-0cf8dd7ac06e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:58.164637 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-67a141ac-c54c-4bc0-9fa7-0cf8dd7ac06e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:58.171120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67a141ac-c54c-4bc0-9fa7-0cf8dd7ac06e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:58.171573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67a141ac-c54c-4bc0-9fa7-0cf8dd7ac06e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:58.172335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67a141ac-c54c-4bc0-9fa7-0cf8dd7ac06e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:58.172829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67a141ac-c54c-4bc0-9fa7-0cf8dd7ac06e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:58.201075 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-67a141ac-c54c-4bc0-9fa7-0cf8dd7ac06e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043149 Jul 27 22:58:58.201624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 822/1633] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:58 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:58.326300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-66eec1b2-5d87-4037-96f2-978414884a37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:58.328448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-66eec1b2-5d87-4037-96f2-978414884a37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:58.334547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66eec1b2-5d87-4037-96f2-978414884a37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:58.334992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66eec1b2-5d87-4037-96f2-978414884a37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:58.335746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66eec1b2-5d87-4037-96f2-978414884a37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:58.336769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66eec1b2-5d87-4037-96f2-978414884a37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:58.365787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-66eec1b2-5d87-4037-96f2-978414884a37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043556 Jul 27 22:58:58.366320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 812/1634] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:58.669575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-eed8d1cb-2494-49e4-afbd-914355c265f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:58.671638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-eed8d1cb-2494-49e4-afbd-914355c265f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:58.677646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eed8d1cb-2494-49e4-afbd-914355c265f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:58.678087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eed8d1cb-2494-49e4-afbd-914355c265f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:58.678839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eed8d1cb-2494-49e4-afbd-914355c265f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:58.679267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eed8d1cb-2494-49e4-afbd-914355c265f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:58.706961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-eed8d1cb-2494-49e4-afbd-914355c265f8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041423 Jul 27 22:58:58.707502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 823/1635] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:58 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:59.032090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-aac2918d-4e62-4c1c-afec-1cc898ed76e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:59.032632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-aac2918d-4e62-4c1c-afec-1cc898ed76e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:59.038554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aac2918d-4e62-4c1c-afec-1cc898ed76e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:59.039063 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aac2918d-4e62-4c1c-afec-1cc898ed76e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:59.039809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aac2918d-4e62-4c1c-afec-1cc898ed76e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:59.040235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aac2918d-4e62-4c1c-afec-1cc898ed76e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:59.104011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-aac2918d-4e62-4c1c-afec-1cc898ed76e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:58:59.111666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-aac2918d-4e62-4c1c-afec-1cc898ed76e8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083393 Jul 27 22:58:59.112235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 813/1636] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:58:59 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:58:59.213314 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bc6578d0-e68c-4048-a9e6-ef138e8b9bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:59.215504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bc6578d0-e68c-4048-a9e6-ef138e8b9bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:59.222079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bc6578d0-e68c-4048-a9e6-ef138e8b9bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:59.222543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bc6578d0-e68c-4048-a9e6-ef138e8b9bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:59.223295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bc6578d0-e68c-4048-a9e6-ef138e8b9bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:59.223733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bc6578d0-e68c-4048-a9e6-ef138e8b9bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:59.252198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bc6578d0-e68c-4048-a9e6-ef138e8b9bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042844 Jul 27 22:58:59.252769 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 824/1637] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:59 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:58:59.378171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9ea46aea-a216-41d5-82ac-3836f0b173f4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:59.380402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9ea46aea-a216-41d5-82ac-3836f0b173f4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:59.387074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9ea46aea-a216-41d5-82ac-3836f0b173f4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:59.387520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9ea46aea-a216-41d5-82ac-3836f0b173f4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:59.388277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9ea46aea-a216-41d5-82ac-3836f0b173f4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:59.388747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9ea46aea-a216-41d5-82ac-3836f0b173f4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:59.416629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9ea46aea-a216-41d5-82ac-3836f0b173f4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042522 Jul 27 22:58:59.417168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 814/1638] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:58:59 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:58:59.719278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6ca9a01f-cf57-4efb-af90-dc6eb672d52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:58:59.721449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6ca9a01f-cf57-4efb-af90-dc6eb672d52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:58:59.727910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6ca9a01f-cf57-4efb-af90-dc6eb672d52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:59.728641 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6ca9a01f-cf57-4efb-af90-dc6eb672d52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:59.729573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6ca9a01f-cf57-4efb-af90-dc6eb672d52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:58:59.730070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6ca9a01f-cf57-4efb-af90-dc6eb672d52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:58:59.759529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6ca9a01f-cf57-4efb-af90-dc6eb672d52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044188 Jul 27 22:58:59.760055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 825/1639] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:58:59 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:00.132673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-396d523a-916c-42f7-b93d-98235c205c19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:00.133292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-396d523a-916c-42f7-b93d-98235c205c19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:00.139421 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-396d523a-916c-42f7-b93d-98235c205c19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:00.139865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-396d523a-916c-42f7-b93d-98235c205c19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:00.140658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-396d523a-916c-42f7-b93d-98235c205c19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:00.141094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-396d523a-916c-42f7-b93d-98235c205c19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:00.201053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-396d523a-916c-42f7-b93d-98235c205c19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:00.208382 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-396d523a-916c-42f7-b93d-98235c205c19 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079638 Jul 27 22:59:00.208980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 815/1640] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:00 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:00.264807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8d974f24-e1e0-49d4-b411-897c84c44359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:00.266947 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8d974f24-e1e0-49d4-b411-897c84c44359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:00.273997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d974f24-e1e0-49d4-b411-897c84c44359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:00.274441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d974f24-e1e0-49d4-b411-897c84c44359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:00.275198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d974f24-e1e0-49d4-b411-897c84c44359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:00.275624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8d974f24-e1e0-49d4-b411-897c84c44359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:00.303209 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8d974f24-e1e0-49d4-b411-897c84c44359 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042435 Jul 27 22:59:00.303750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 826/1641] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:00 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:00.428725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f6f18a03-5e9f-4dda-9345-7e298030588b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:00.430785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f6f18a03-5e9f-4dda-9345-7e298030588b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:00.436688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f6f18a03-5e9f-4dda-9345-7e298030588b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:00.437132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f6f18a03-5e9f-4dda-9345-7e298030588b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:00.437878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f6f18a03-5e9f-4dda-9345-7e298030588b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:00.438305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f6f18a03-5e9f-4dda-9345-7e298030588b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:00.466978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f6f18a03-5e9f-4dda-9345-7e298030588b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042238 Jul 27 22:59:00.467510 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 816/1642] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:00 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:00.771402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1ecc6cc7-9d09-412d-96ee-8f8fb4ac8d51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:00.773582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1ecc6cc7-9d09-412d-96ee-8f8fb4ac8d51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:00.779492 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ecc6cc7-9d09-412d-96ee-8f8fb4ac8d51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:00.779931 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ecc6cc7-9d09-412d-96ee-8f8fb4ac8d51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:00.780701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ecc6cc7-9d09-412d-96ee-8f8fb4ac8d51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:00.781129 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ecc6cc7-9d09-412d-96ee-8f8fb4ac8d51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:00.809899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1ecc6cc7-9d09-412d-96ee-8f8fb4ac8d51 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042506 Jul 27 22:59:00.810440 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 827/1643] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:00 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:01.230130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dfcfd3ad-6936-4ac4-b803-ff3836f761a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:01.230730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dfcfd3ad-6936-4ac4-b803-ff3836f761a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:01.236701 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfcfd3ad-6936-4ac4-b803-ff3836f761a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:01.237140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfcfd3ad-6936-4ac4-b803-ff3836f761a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:01.237884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfcfd3ad-6936-4ac4-b803-ff3836f761a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:01.238310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfcfd3ad-6936-4ac4-b803-ff3836f761a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:01.297199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dfcfd3ad-6936-4ac4-b803-ff3836f761a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:01.304521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dfcfd3ad-6936-4ac4-b803-ff3836f761a7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078932 Jul 27 22:59:01.305613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 817/1644] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:01 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:01.315186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-df1b94e2-5ead-4ccc-b18e-96219b8d2e34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:01.317389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-df1b94e2-5ead-4ccc-b18e-96219b8d2e34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:01.323738 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df1b94e2-5ead-4ccc-b18e-96219b8d2e34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:01.324180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df1b94e2-5ead-4ccc-b18e-96219b8d2e34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:01.324963 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df1b94e2-5ead-4ccc-b18e-96219b8d2e34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:01.325393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df1b94e2-5ead-4ccc-b18e-96219b8d2e34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:01.353822 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-df1b94e2-5ead-4ccc-b18e-96219b8d2e34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042529 Jul 27 22:59:01.354363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 828/1645] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:01 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:01.480602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-430ab10c-7ef8-4e16-a381-8965f112d39b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:01.482683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-430ab10c-7ef8-4e16-a381-8965f112d39b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:01.488729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-430ab10c-7ef8-4e16-a381-8965f112d39b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:01.489174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-430ab10c-7ef8-4e16-a381-8965f112d39b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:01.489930 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-430ab10c-7ef8-4e16-a381-8965f112d39b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:01.490360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-430ab10c-7ef8-4e16-a381-8965f112d39b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:01.517973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-430ab10c-7ef8-4e16-a381-8965f112d39b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042855 Jul 27 22:59:01.518511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 818/1646] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:01 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:01.822590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a91e748f-c46d-47a2-a8a2-f93d2188e5d2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:01.824886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a91e748f-c46d-47a2-a8a2-f93d2188e5d2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:01.830881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a91e748f-c46d-47a2-a8a2-f93d2188e5d2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:01.831328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a91e748f-c46d-47a2-a8a2-f93d2188e5d2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:01.832077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a91e748f-c46d-47a2-a8a2-f93d2188e5d2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:01.832507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a91e748f-c46d-47a2-a8a2-f93d2188e5d2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:01.860927 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a91e748f-c46d-47a2-a8a2-f93d2188e5d2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042871 Jul 27 22:59:01.861467 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 829/1647] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:01 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:02.326199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ef490f3a-96db-492a-95b3-b1b949aaf4ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:02.326801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ef490f3a-96db-492a-95b3-b1b949aaf4ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:02.332852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef490f3a-96db-492a-95b3-b1b949aaf4ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:02.333297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef490f3a-96db-492a-95b3-b1b949aaf4ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:02.334046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef490f3a-96db-492a-95b3-b1b949aaf4ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:02.334477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef490f3a-96db-492a-95b3-b1b949aaf4ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:02.366229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8b026c34-0db5-471a-8573-1c4ba91f2c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:02.368954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8b026c34-0db5-471a-8573-1c4ba91f2c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:02.375470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8b026c34-0db5-471a-8573-1c4ba91f2c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:02.375911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8b026c34-0db5-471a-8573-1c4ba91f2c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:02.376693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8b026c34-0db5-471a-8573-1c4ba91f2c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:02.377121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8b026c34-0db5-471a-8573-1c4ba91f2c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:02.394283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ef490f3a-96db-492a-95b3-b1b949aaf4ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:02.401666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ef490f3a-96db-492a-95b3-b1b949aaf4ae tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079342 Jul 27 22:59:02.402358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 819/1648] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:02 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:02.406573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8b026c34-0db5-471a-8573-1c4ba91f2c66 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 Jul 27 22:59:02.407064 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 830/1649] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:02 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:02.529988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5d630743-89c6-4b38-be66-23f588f3a1fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:02.532151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5d630743-89c6-4b38-be66-23f588f3a1fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:02.538186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d630743-89c6-4b38-be66-23f588f3a1fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:02.538631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d630743-89c6-4b38-be66-23f588f3a1fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:02.539887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d630743-89c6-4b38-be66-23f588f3a1fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:02.540316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d630743-89c6-4b38-be66-23f588f3a1fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:02.568585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5d630743-89c6-4b38-be66-23f588f3a1fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042482 Jul 27 22:59:02.569121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 820/1650] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:02 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:02.872909 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0b90ffb1-fc6a-4ac0-891d-6d496b0e4579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:02.875148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0b90ffb1-fc6a-4ac0-891d-6d496b0e4579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:02.881079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b90ffb1-fc6a-4ac0-891d-6d496b0e4579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:02.881529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b90ffb1-fc6a-4ac0-891d-6d496b0e4579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:02.882288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b90ffb1-fc6a-4ac0-891d-6d496b0e4579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:02.882722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b90ffb1-fc6a-4ac0-891d-6d496b0e4579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:02.911585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0b90ffb1-fc6a-4ac0-891d-6d496b0e4579 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042628 Jul 27 22:59:02.912134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 831/1651] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:02 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:03.418794 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1a251f80-2fe0-4c3e-a02a-688c6a2be6a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:03.420892 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1a251f80-2fe0-4c3e-a02a-688c6a2be6a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:03.421362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e69a5266-3f5d-42f2-adbf-ff1082daff0e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:03.421973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e69a5266-3f5d-42f2-adbf-ff1082daff0e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:03.426917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1a251f80-2fe0-4c3e-a02a-688c6a2be6a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:03.427360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1a251f80-2fe0-4c3e-a02a-688c6a2be6a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:03.428114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1a251f80-2fe0-4c3e-a02a-688c6a2be6a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:03.428339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e69a5266-3f5d-42f2-adbf-ff1082daff0e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:03.428545 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1a251f80-2fe0-4c3e-a02a-688c6a2be6a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:03.428828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e69a5266-3f5d-42f2-adbf-ff1082daff0e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:03.429589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e69a5266-3f5d-42f2-adbf-ff1082daff0e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:03.430021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e69a5266-3f5d-42f2-adbf-ff1082daff0e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:03.457229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1a251f80-2fe0-4c3e-a02a-688c6a2be6a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042511 Jul 27 22:59:03.461802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 821/1652] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:03 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:03.493378 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e69a5266-3f5d-42f2-adbf-ff1082daff0e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:03.500952 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e69a5266-3f5d-42f2-adbf-ff1082daff0e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083339 Jul 27 22:59:03.501501 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 832/1653] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:03 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:03.580582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cedbead0-fcb0-4520-bbd3-f86246d768ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:03.582716 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cedbead0-fcb0-4520-bbd3-f86246d768ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:03.589354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cedbead0-fcb0-4520-bbd3-f86246d768ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:03.589800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cedbead0-fcb0-4520-bbd3-f86246d768ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:03.590555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cedbead0-fcb0-4520-bbd3-f86246d768ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:03.590984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cedbead0-fcb0-4520-bbd3-f86246d768ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:03.619351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cedbead0-fcb0-4520-bbd3-f86246d768ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042668 Jul 27 22:59:03.619896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 822/1654] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:03.924895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-568e09f0-1b1f-4271-a9cd-5b1546551908 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:03.927074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-568e09f0-1b1f-4271-a9cd-5b1546551908 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:03.933640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-568e09f0-1b1f-4271-a9cd-5b1546551908 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:03.934089 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-568e09f0-1b1f-4271-a9cd-5b1546551908 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:03.934843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-568e09f0-1b1f-4271-a9cd-5b1546551908 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:03.935276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-568e09f0-1b1f-4271-a9cd-5b1546551908 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:03.963566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-568e09f0-1b1f-4271-a9cd-5b1546551908 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043303 Jul 27 22:59:03.964075 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 833/1655] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:03 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:04.470087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a2719c12-ea70-450e-9528-fff927c3803f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:04.472197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a2719c12-ea70-450e-9528-fff927c3803f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:04.479019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2719c12-ea70-450e-9528-fff927c3803f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:04.479459 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2719c12-ea70-450e-9528-fff927c3803f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:04.480204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2719c12-ea70-450e-9528-fff927c3803f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:04.480654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2719c12-ea70-450e-9528-fff927c3803f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:04.507520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a2719c12-ea70-450e-9528-fff927c3803f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041505 Jul 27 22:59:04.508051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 823/1656] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:04 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:04.521928 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b670113e-70f9-4460-a8b9-671b72c0fa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:04.522536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b670113e-70f9-4460-a8b9-671b72c0fa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:04.529491 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b670113e-70f9-4460-a8b9-671b72c0fa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:04.529938 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b670113e-70f9-4460-a8b9-671b72c0fa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:04.530692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b670113e-70f9-4460-a8b9-671b72c0fa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:04.531125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b670113e-70f9-4460-a8b9-671b72c0fa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:04.591306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b670113e-70f9-4460-a8b9-671b72c0fa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:04.598803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b670113e-70f9-4460-a8b9-671b72c0fa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080806 Jul 27 22:59:04.599362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 834/1657] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:04 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:04.631374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a6cf44eb-6020-42ee-92b5-43f479e89571 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:04.633653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a6cf44eb-6020-42ee-92b5-43f479e89571 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:04.639578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a6cf44eb-6020-42ee-92b5-43f479e89571 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:04.640016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a6cf44eb-6020-42ee-92b5-43f479e89571 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:04.640798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a6cf44eb-6020-42ee-92b5-43f479e89571 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:04.641220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a6cf44eb-6020-42ee-92b5-43f479e89571 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:04.669804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a6cf44eb-6020-42ee-92b5-43f479e89571 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042408 Jul 27 22:59:04.670345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 824/1658] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:04 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:04.975746 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b071daa8-c030-475f-a83a-1ec823ba8ce8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:04.979326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b071daa8-c030-475f-a83a-1ec823ba8ce8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:04.987418 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b071daa8-c030-475f-a83a-1ec823ba8ce8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:04.987861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b071daa8-c030-475f-a83a-1ec823ba8ce8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:04.988654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b071daa8-c030-475f-a83a-1ec823ba8ce8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:04.989087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b071daa8-c030-475f-a83a-1ec823ba8ce8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:05.018376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b071daa8-c030-475f-a83a-1ec823ba8ce8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046562 Jul 27 22:59:05.018918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 835/1659] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:04 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:05.519761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-64d21f73-41db-46a2-be34-7d1471853144 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:05.521931 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-64d21f73-41db-46a2-be34-7d1471853144 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:05.527949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64d21f73-41db-46a2-be34-7d1471853144 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:05.528394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64d21f73-41db-46a2-be34-7d1471853144 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:05.529199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64d21f73-41db-46a2-be34-7d1471853144 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:05.529634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64d21f73-41db-46a2-be34-7d1471853144 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:05.558138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-64d21f73-41db-46a2-be34-7d1471853144 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042443 Jul 27 22:59:05.558675 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 825/1660] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:05 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:05.619987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dc8fe16e-7bf0-4221-b214-4cc73bf2f0f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:05.620609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dc8fe16e-7bf0-4221-b214-4cc73bf2f0f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:05.627138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc8fe16e-7bf0-4221-b214-4cc73bf2f0f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:05.627577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc8fe16e-7bf0-4221-b214-4cc73bf2f0f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:05.628325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc8fe16e-7bf0-4221-b214-4cc73bf2f0f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:05.628780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc8fe16e-7bf0-4221-b214-4cc73bf2f0f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:05.682511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0706cf42-206d-480c-95b8-4ad220e779eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:05.684688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0706cf42-206d-480c-95b8-4ad220e779eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:05.690466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0706cf42-206d-480c-95b8-4ad220e779eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:05.690911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0706cf42-206d-480c-95b8-4ad220e779eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:05.692019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0706cf42-206d-480c-95b8-4ad220e779eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:05.692452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0706cf42-206d-480c-95b8-4ad220e779eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:05.721463 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0706cf42-206d-480c-95b8-4ad220e779eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043574 Jul 27 22:59:05.722016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 826/1661] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:05 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:05.744325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-dc8fe16e-7bf0-4221-b214-4cc73bf2f0f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:05.751809 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dc8fe16e-7bf0-4221-b214-4cc73bf2f0f2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.136249 Jul 27 22:59:05.752361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 836/1662] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:05 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:06.031435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ba7d70c6-f8f0-4632-aaa2-258d03474dca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:06.033702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ba7d70c6-f8f0-4632-aaa2-258d03474dca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:06.040507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba7d70c6-f8f0-4632-aaa2-258d03474dca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:06.040987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba7d70c6-f8f0-4632-aaa2-258d03474dca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:06.041754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba7d70c6-f8f0-4632-aaa2-258d03474dca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:06.042193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba7d70c6-f8f0-4632-aaa2-258d03474dca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:06.045819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:06.070548 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ba7d70c6-f8f0-4632-aaa2-258d03474dca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043056 Jul 27 22:59:06.071094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 827/1663] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:06 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:06.571054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-708f51ab-f74e-4e49-bdf5-45106fc2404d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:06.573401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-708f51ab-f74e-4e49-bdf5-45106fc2404d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:06.579358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-708f51ab-f74e-4e49-bdf5-45106fc2404d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:06.579797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-708f51ab-f74e-4e49-bdf5-45106fc2404d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:06.580545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-708f51ab-f74e-4e49-bdf5-45106fc2404d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:06.581020 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-708f51ab-f74e-4e49-bdf5-45106fc2404d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:06.584507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:06.610184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-708f51ab-f74e-4e49-bdf5-45106fc2404d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043718 Jul 27 22:59:06.610729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 837/1664] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:06 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:06.732914 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5daae88a-c46a-4558-9354-5aa950dc650b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:06.735032 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5daae88a-c46a-4558-9354-5aa950dc650b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:06.741066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5daae88a-c46a-4558-9354-5aa950dc650b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:06.741504 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5daae88a-c46a-4558-9354-5aa950dc650b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:06.742780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5daae88a-c46a-4558-9354-5aa950dc650b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:06.743212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5daae88a-c46a-4558-9354-5aa950dc650b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:06.771441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-641bb23a-5666-4a00-894e-2bc840244e7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:06.771949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5daae88a-c46a-4558-9354-5aa950dc650b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042709 Jul 27 22:59:06.772058 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-641bb23a-5666-4a00-894e-2bc840244e7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:06.772199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 828/1665] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:59:06.779097 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-641bb23a-5666-4a00-894e-2bc840244e7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:06.779540 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-641bb23a-5666-4a00-894e-2bc840244e7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:06.780298 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-641bb23a-5666-4a00-894e-2bc840244e7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:06.780761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-641bb23a-5666-4a00-894e-2bc840244e7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:06.841157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-641bb23a-5666-4a00-894e-2bc840244e7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:06.848465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-641bb23a-5666-4a00-894e-2bc840244e7a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080879 Jul 27 22:59:06.849046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 838/1666] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:06 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:07.082776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b76e97a6-10c2-4066-a8e3-b1d718d450ef tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:07.084965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b76e97a6-10c2-4066-a8e3-b1d718d450ef tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:07.090974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b76e97a6-10c2-4066-a8e3-b1d718d450ef tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:07.091366 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b76e97a6-10c2-4066-a8e3-b1d718d450ef tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:07.092127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b76e97a6-10c2-4066-a8e3-b1d718d450ef tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:07.092573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b76e97a6-10c2-4066-a8e3-b1d718d450ef tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:07.121501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b76e97a6-10c2-4066-a8e3-b1d718d450ef tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042774 Jul 27 22:59:07.122039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 829/1667] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:07 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:07.622332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9e309474-64ec-429a-9600-6e5d9bd6456c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:07.624489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9e309474-64ec-429a-9600-6e5d9bd6456c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:07.630493 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e309474-64ec-429a-9600-6e5d9bd6456c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:07.630929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e309474-64ec-429a-9600-6e5d9bd6456c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:07.631677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e309474-64ec-429a-9600-6e5d9bd6456c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:07.632101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e309474-64ec-429a-9600-6e5d9bd6456c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:07.661283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9e309474-64ec-429a-9600-6e5d9bd6456c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042872 Jul 27 22:59:07.661823 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 839/1668] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:07 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:07.783263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1d88f00c-1843-4708-8fd0-196baa64c45c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:07.785434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1d88f00c-1843-4708-8fd0-196baa64c45c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:07.791339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d88f00c-1843-4708-8fd0-196baa64c45c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:07.791775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d88f00c-1843-4708-8fd0-196baa64c45c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:07.792526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d88f00c-1843-4708-8fd0-196baa64c45c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:07.792975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d88f00c-1843-4708-8fd0-196baa64c45c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:07.823827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1d88f00c-1843-4708-8fd0-196baa64c45c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044467 Jul 27 22:59:07.824372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 830/1669] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:07 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:07.869144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-68cac3af-eced-4491-a241-d68cc80a4eaa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:07.869770 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-68cac3af-eced-4491-a241-d68cc80a4eaa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:07.876117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-68cac3af-eced-4491-a241-d68cc80a4eaa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:07.876499 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-68cac3af-eced-4491-a241-d68cc80a4eaa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:07.877271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-68cac3af-eced-4491-a241-d68cc80a4eaa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:07.877703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-68cac3af-eced-4491-a241-d68cc80a4eaa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:07.939900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-68cac3af-eced-4491-a241-d68cc80a4eaa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:07.947812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-68cac3af-eced-4491-a241-d68cc80a4eaa tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082534 Jul 27 22:59:07.948366 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 840/1670] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:07 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:08.134254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-be649907-f6fc-4454-9fdb-76425c152446 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:08.136337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-be649907-f6fc-4454-9fdb-76425c152446 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:08.142466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be649907-f6fc-4454-9fdb-76425c152446 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:08.142917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be649907-f6fc-4454-9fdb-76425c152446 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:08.144023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be649907-f6fc-4454-9fdb-76425c152446 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:08.144501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-be649907-f6fc-4454-9fdb-76425c152446 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:08.173112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-be649907-f6fc-4454-9fdb-76425c152446 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043539 Jul 27 22:59:08.173664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 831/1671] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:08 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:08.673810 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dfdd70ab-3f80-4e00-ac99-1c9d422e1bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:08.675987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dfdd70ab-3f80-4e00-ac99-1c9d422e1bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:08.682699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfdd70ab-3f80-4e00-ac99-1c9d422e1bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:08.683146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfdd70ab-3f80-4e00-ac99-1c9d422e1bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:08.683903 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfdd70ab-3f80-4e00-ac99-1c9d422e1bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:08.684333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dfdd70ab-3f80-4e00-ac99-1c9d422e1bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:08.711295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dfdd70ab-3f80-4e00-ac99-1c9d422e1bf7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041529 Jul 27 22:59:08.711841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 841/1672] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:08 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:08.836975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dde64a02-11db-4f0f-af51-aa2aa5f13fe2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:08.839093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dde64a02-11db-4f0f-af51-aa2aa5f13fe2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:08.844938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dde64a02-11db-4f0f-af51-aa2aa5f13fe2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:08.845413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dde64a02-11db-4f0f-af51-aa2aa5f13fe2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:08.846158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dde64a02-11db-4f0f-af51-aa2aa5f13fe2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:08.846583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dde64a02-11db-4f0f-af51-aa2aa5f13fe2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:08.874796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dde64a02-11db-4f0f-af51-aa2aa5f13fe2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042312 Jul 27 22:59:08.875327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 832/1673] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:08 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:08.968977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c125e8a5-45f2-46a5-a6e3-3c00bc11380d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:08.969512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c125e8a5-45f2-46a5-a6e3-3c00bc11380d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:08.975867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c125e8a5-45f2-46a5-a6e3-3c00bc11380d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:08.976974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c125e8a5-45f2-46a5-a6e3-3c00bc11380d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:08.977744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c125e8a5-45f2-46a5-a6e3-3c00bc11380d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:08.978434 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c125e8a5-45f2-46a5-a6e3-3c00bc11380d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:09.037346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c125e8a5-45f2-46a5-a6e3-3c00bc11380d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:09.045537 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c125e8a5-45f2-46a5-a6e3-3c00bc11380d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080388 Jul 27 22:59:09.046083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 842/1674] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:08 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:09.184516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9a2400be-0144-40bd-bb05-d0648a73a8f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:09.186700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9a2400be-0144-40bd-bb05-d0648a73a8f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:09.188534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:09.193820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a2400be-0144-40bd-bb05-d0648a73a8f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:09.194268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a2400be-0144-40bd-bb05-d0648a73a8f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:09.195025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a2400be-0144-40bd-bb05-d0648a73a8f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:09.195465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a2400be-0144-40bd-bb05-d0648a73a8f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:09.224997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9a2400be-0144-40bd-bb05-d0648a73a8f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Jul 27 22:59:09.225469 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 833/1675] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:09 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:09.723323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3f24e286-9d2c-4a30-97e3-d34a4794dd5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:09.725535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3f24e286-9d2c-4a30-97e3-d34a4794dd5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:09.731763 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3f24e286-9d2c-4a30-97e3-d34a4794dd5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:09.732208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3f24e286-9d2c-4a30-97e3-d34a4794dd5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:09.732995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3f24e286-9d2c-4a30-97e3-d34a4794dd5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:09.733428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3f24e286-9d2c-4a30-97e3-d34a4794dd5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:09.763390 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3f24e286-9d2c-4a30-97e3-d34a4794dd5f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044069 Jul 27 22:59:09.763930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 843/1676] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:09 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:09.887408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-48b30281-9f90-4462-bfec-5a6eacc6de2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:09.889931 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-48b30281-9f90-4462-bfec-5a6eacc6de2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:09.895880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-48b30281-9f90-4462-bfec-5a6eacc6de2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:09.896331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-48b30281-9f90-4462-bfec-5a6eacc6de2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:09.897130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-48b30281-9f90-4462-bfec-5a6eacc6de2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:09.897565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-48b30281-9f90-4462-bfec-5a6eacc6de2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:09.925629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-48b30281-9f90-4462-bfec-5a6eacc6de2e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042849 Jul 27 22:59:09.926164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 834/1677] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:09 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:10.066244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-60eec3f9-5bc3-43bd-bb0a-dd462ab36faf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:10.066856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-60eec3f9-5bc3-43bd-bb0a-dd462ab36faf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:10.073306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60eec3f9-5bc3-43bd-bb0a-dd462ab36faf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:10.073750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60eec3f9-5bc3-43bd-bb0a-dd462ab36faf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:10.074503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60eec3f9-5bc3-43bd-bb0a-dd462ab36faf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:10.074936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60eec3f9-5bc3-43bd-bb0a-dd462ab36faf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:10.134809 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-60eec3f9-5bc3-43bd-bb0a-dd462ab36faf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:10.142257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-60eec3f9-5bc3-43bd-bb0a-dd462ab36faf tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079875 Jul 27 22:59:10.142812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 844/1678] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:10 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:10.237974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-37801a28-9499-4bcb-a666-9e680798a5c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:10.240091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-37801a28-9499-4bcb-a666-9e680798a5c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:10.246710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-37801a28-9499-4bcb-a666-9e680798a5c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:10.247145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-37801a28-9499-4bcb-a666-9e680798a5c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:10.247893 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-37801a28-9499-4bcb-a666-9e680798a5c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:10.248314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-37801a28-9499-4bcb-a666-9e680798a5c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:10.276164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-37801a28-9499-4bcb-a666-9e680798a5c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042016 Jul 27 22:59:10.276764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 835/1679] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:10 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:10.776170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4a04dd08-ee49-4449-9e8f-25661459957d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:10.778479 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4a04dd08-ee49-4449-9e8f-25661459957d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:10.784465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4a04dd08-ee49-4449-9e8f-25661459957d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:10.784945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4a04dd08-ee49-4449-9e8f-25661459957d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:10.785715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4a04dd08-ee49-4449-9e8f-25661459957d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:10.786148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4a04dd08-ee49-4449-9e8f-25661459957d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:10.814347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4a04dd08-ee49-4449-9e8f-25661459957d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042783 Jul 27 22:59:10.815109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 845/1680] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:10 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:10.938353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-db544036-5447-4306-8e54-fb277fc76c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:10.940659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-db544036-5447-4306-8e54-fb277fc76c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:10.947147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db544036-5447-4306-8e54-fb277fc76c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:10.947586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db544036-5447-4306-8e54-fb277fc76c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:10.948340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db544036-5447-4306-8e54-fb277fc76c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:10.948809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db544036-5447-4306-8e54-fb277fc76c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:10.978415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-db544036-5447-4306-8e54-fb277fc76c46 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043706 Jul 27 22:59:10.978973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 836/1681] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:10 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:11.162697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b2414bb1-6d18-4b1e-b97c-55a64aec44e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:11.163310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b2414bb1-6d18-4b1e-b97c-55a64aec44e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:11.169704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2414bb1-6d18-4b1e-b97c-55a64aec44e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:11.170152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2414bb1-6d18-4b1e-b97c-55a64aec44e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:11.170926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2414bb1-6d18-4b1e-b97c-55a64aec44e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:11.171343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2414bb1-6d18-4b1e-b97c-55a64aec44e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:11.233017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b2414bb1-6d18-4b1e-b97c-55a64aec44e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:11.240451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b2414bb1-6d18-4b1e-b97c-55a64aec44e3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081580 Jul 27 22:59:11.241049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 846/1682] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:11 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:11.288459 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6b96b366-5627-44ca-bca9-ed9a7c7c0daf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:11.291282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6b96b366-5627-44ca-bca9-ed9a7c7c0daf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:11.297452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b96b366-5627-44ca-bca9-ed9a7c7c0daf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:11.297900 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b96b366-5627-44ca-bca9-ed9a7c7c0daf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:11.298669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b96b366-5627-44ca-bca9-ed9a7c7c0daf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:11.299106 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b96b366-5627-44ca-bca9-ed9a7c7c0daf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:11.326847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6b96b366-5627-44ca-bca9-ed9a7c7c0daf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042390 Jul 27 22:59:11.327396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 837/1683] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:11 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:11.827194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8a54da05-7c42-4323-82b9-9321640fc12a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:11.829457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8a54da05-7c42-4323-82b9-9321640fc12a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:11.836140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8a54da05-7c42-4323-82b9-9321640fc12a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:11.836609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8a54da05-7c42-4323-82b9-9321640fc12a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:11.837374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8a54da05-7c42-4323-82b9-9321640fc12a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:11.837810 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8a54da05-7c42-4323-82b9-9321640fc12a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:11.865383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8a54da05-7c42-4323-82b9-9321640fc12a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042253 Jul 27 22:59:11.865926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 847/1684] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:11 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:11.990602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0a9d21a3-e228-47dd-80cb-c8c92ce81370 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:11.993293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0a9d21a3-e228-47dd-80cb-c8c92ce81370 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:11.999282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a9d21a3-e228-47dd-80cb-c8c92ce81370 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:11.999735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a9d21a3-e228-47dd-80cb-c8c92ce81370 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:12.000494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a9d21a3-e228-47dd-80cb-c8c92ce81370 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:12.000956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a9d21a3-e228-47dd-80cb-c8c92ce81370 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:12.029143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0a9d21a3-e228-47dd-80cb-c8c92ce81370 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042520 Jul 27 22:59:12.029689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 838/1685] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:11 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:12.261791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7cf55577-ff81-410d-92f1-33c6d6c82a3c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:12.262390 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7cf55577-ff81-410d-92f1-33c6d6c82a3c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:12.264716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:12.270259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7cf55577-ff81-410d-92f1-33c6d6c82a3c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:12.270695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7cf55577-ff81-410d-92f1-33c6d6c82a3c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:12.271445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7cf55577-ff81-410d-92f1-33c6d6c82a3c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:12.271871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7cf55577-ff81-410d-92f1-33c6d6c82a3c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:12.334323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7cf55577-ff81-410d-92f1-33c6d6c82a3c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:12.338846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9dc03252-a17c-4c4d-9729-1e263ca2fad5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:12.341044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9dc03252-a17c-4c4d-9729-1e263ca2fad5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:12.341953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7cf55577-ff81-410d-92f1-33c6d6c82a3c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084310 Jul 27 22:59:12.342688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 848/1686] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:12 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:12.346914 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9dc03252-a17c-4c4d-9729-1e263ca2fad5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:12.347353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9dc03252-a17c-4c4d-9729-1e263ca2fad5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:12.348101 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9dc03252-a17c-4c4d-9729-1e263ca2fad5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:12.348529 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9dc03252-a17c-4c4d-9729-1e263ca2fad5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:12.377841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9dc03252-a17c-4c4d-9729-1e263ca2fad5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042839 Jul 27 22:59:12.378383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 839/1687] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:12 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:12.878451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b3b30174-b6a5-465f-b457-9e12282a2d43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:12.880672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b3b30174-b6a5-465f-b457-9e12282a2d43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:12.886649 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3b30174-b6a5-465f-b457-9e12282a2d43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:12.887093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3b30174-b6a5-465f-b457-9e12282a2d43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:12.887844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3b30174-b6a5-465f-b457-9e12282a2d43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:12.888265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3b30174-b6a5-465f-b457-9e12282a2d43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:12.919715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b3b30174-b6a5-465f-b457-9e12282a2d43 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Jul 27 22:59:12.920756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 849/1688] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:12 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:13.041520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-17358e2e-b6d8-4ca3-9dea-feafee6f35bf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:13.043651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-17358e2e-b6d8-4ca3-9dea-feafee6f35bf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:13.050657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17358e2e-b6d8-4ca3-9dea-feafee6f35bf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:13.051361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17358e2e-b6d8-4ca3-9dea-feafee6f35bf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:13.052248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17358e2e-b6d8-4ca3-9dea-feafee6f35bf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:13.052724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17358e2e-b6d8-4ca3-9dea-feafee6f35bf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:13.088740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-17358e2e-b6d8-4ca3-9dea-feafee6f35bf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051112 Jul 27 22:59:13.089308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 840/1689] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:13.363542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f293b524-882e-42be-af9c-4019aaa7d3a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:13.364140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f293b524-882e-42be-af9c-4019aaa7d3a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:13.371323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f293b524-882e-42be-af9c-4019aaa7d3a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:13.371837 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f293b524-882e-42be-af9c-4019aaa7d3a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:13.372649 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f293b524-882e-42be-af9c-4019aaa7d3a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:13.373077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f293b524-882e-42be-af9c-4019aaa7d3a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:13.390304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a0d43f5e-8d66-41b8-985f-3989d6807945 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:13.392515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a0d43f5e-8d66-41b8-985f-3989d6807945 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:13.398612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0d43f5e-8d66-41b8-985f-3989d6807945 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:13.399092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0d43f5e-8d66-41b8-985f-3989d6807945 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:13.399855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0d43f5e-8d66-41b8-985f-3989d6807945 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:13.400288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0d43f5e-8d66-41b8-985f-3989d6807945 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:13.433343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a0d43f5e-8d66-41b8-985f-3989d6807945 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046465 Jul 27 22:59:13.434123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 841/1690] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:13 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:13.435946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f293b524-882e-42be-af9c-4019aaa7d3a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:13.444041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f293b524-882e-42be-af9c-4019aaa7d3a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084561 Jul 27 22:59:13.445616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 850/1691] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:13 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:13.933023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8f41fc69-a1a2-4de2-abbd-e4d1c5b4b901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:13.935175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8f41fc69-a1a2-4de2-abbd-e4d1c5b4b901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:13.941139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f41fc69-a1a2-4de2-abbd-e4d1c5b4b901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:13.941576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f41fc69-a1a2-4de2-abbd-e4d1c5b4b901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:13.942350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f41fc69-a1a2-4de2-abbd-e4d1c5b4b901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:13.942778 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f41fc69-a1a2-4de2-abbd-e4d1c5b4b901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:13.971668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8f41fc69-a1a2-4de2-abbd-e4d1c5b4b901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042602 Jul 27 22:59:13.972297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 842/1692] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:13 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:14.101021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-479a49d9-df9c-47cf-9201-3d4cf2618ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:14.104073 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-479a49d9-df9c-47cf-9201-3d4cf2618ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:14.110049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-479a49d9-df9c-47cf-9201-3d4cf2618ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:14.110491 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-479a49d9-df9c-47cf-9201-3d4cf2618ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:14.111237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-479a49d9-df9c-47cf-9201-3d4cf2618ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:14.111665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-479a49d9-df9c-47cf-9201-3d4cf2618ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:14.141257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-479a49d9-df9c-47cf-9201-3d4cf2618ebf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044139 Jul 27 22:59:14.141804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 851/1693] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:14 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:14.445535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2e36e5be-1e29-41a3-92bc-c5c0b7124e96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:14.447654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2e36e5be-1e29-41a3-92bc-c5c0b7124e96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:14.453757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e36e5be-1e29-41a3-92bc-c5c0b7124e96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:14.454199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e36e5be-1e29-41a3-92bc-c5c0b7124e96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:14.454971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e36e5be-1e29-41a3-92bc-c5c0b7124e96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:14.455398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e36e5be-1e29-41a3-92bc-c5c0b7124e96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:14.466033 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4bb0f51b-a2ab-4027-9c19-21b6e56bfa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:14.466643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4bb0f51b-a2ab-4027-9c19-21b6e56bfa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:14.473522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4bb0f51b-a2ab-4027-9c19-21b6e56bfa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:14.473968 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4bb0f51b-a2ab-4027-9c19-21b6e56bfa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:14.474734 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4bb0f51b-a2ab-4027-9c19-21b6e56bfa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:14.475168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4bb0f51b-a2ab-4027-9c19-21b6e56bfa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:14.485037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:14.489864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2e36e5be-1e29-41a3-92bc-c5c0b7124e96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048330 Jul 27 22:59:14.490415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 843/1694] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:14 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:14.537673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4bb0f51b-a2ab-4027-9c19-21b6e56bfa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:14.545113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4bb0f51b-a2ab-4027-9c19-21b6e56bfa1d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082902 Jul 27 22:59:14.545679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 852/1695] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:14 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:14.984247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dc9288c1-3046-4f59-ac56-37c0e4891c93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:14.986388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dc9288c1-3046-4f59-ac56-37c0e4891c93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:14.992928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc9288c1-3046-4f59-ac56-37c0e4891c93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:14.993371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc9288c1-3046-4f59-ac56-37c0e4891c93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:14.994423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc9288c1-3046-4f59-ac56-37c0e4891c93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:14.994538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc9288c1-3046-4f59-ac56-37c0e4891c93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:15.023002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dc9288c1-3046-4f59-ac56-37c0e4891c93 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042886 Jul 27 22:59:15.023546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 844/1696] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:14 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:15.153607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d343e398-edca-4d46-bdfa-143681c0a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:15.155782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d343e398-edca-4d46-bdfa-143681c0a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:15.161928 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d343e398-edca-4d46-bdfa-143681c0a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:15.162374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d343e398-edca-4d46-bdfa-143681c0a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:15.163140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d343e398-edca-4d46-bdfa-143681c0a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:15.163578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d343e398-edca-4d46-bdfa-143681c0a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:15.187747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:15.192656 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d343e398-edca-4d46-bdfa-143681c0a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043020 Jul 27 22:59:15.193205 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 853/1697] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:15 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:15.502301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c3f92056-796f-4d1c-9ce8-ace2c18166a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:15.504465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c3f92056-796f-4d1c-9ce8-ace2c18166a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:15.510411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3f92056-796f-4d1c-9ce8-ace2c18166a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:15.510849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3f92056-796f-4d1c-9ce8-ace2c18166a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:15.511593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3f92056-796f-4d1c-9ce8-ace2c18166a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:15.512019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3f92056-796f-4d1c-9ce8-ace2c18166a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:15.540065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c3f92056-796f-4d1c-9ce8-ace2c18166a7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041735 Jul 27 22:59:15.540617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 845/1698] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:15.566448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8531be9d-7893-458c-ad56-2670030eb147 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:15.567059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8531be9d-7893-458c-ad56-2670030eb147 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:15.573674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8531be9d-7893-458c-ad56-2670030eb147 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:15.574247 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8531be9d-7893-458c-ad56-2670030eb147 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:15.575016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8531be9d-7893-458c-ad56-2670030eb147 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:15.575448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8531be9d-7893-458c-ad56-2670030eb147 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:15.641485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8531be9d-7893-458c-ad56-2670030eb147 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:15.649367 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8531be9d-7893-458c-ad56-2670030eb147 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.087692 Jul 27 22:59:15.649930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 854/1699] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:15 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:16.035301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c1f8c240-61f6-4154-9fb0-cccfaf80e300 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:16.037461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c1f8c240-61f6-4154-9fb0-cccfaf80e300 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:16.043413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1f8c240-61f6-4154-9fb0-cccfaf80e300 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:16.043858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1f8c240-61f6-4154-9fb0-cccfaf80e300 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:16.044629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1f8c240-61f6-4154-9fb0-cccfaf80e300 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:16.045064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1f8c240-61f6-4154-9fb0-cccfaf80e300 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:16.072567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c1f8c240-61f6-4154-9fb0-cccfaf80e300 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041236 Jul 27 22:59:16.073121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 846/1700] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:16 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:16.205621 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-af290cd7-7378-4655-886e-70edd63dbb22 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:16.207752 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-af290cd7-7378-4655-886e-70edd63dbb22 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:16.214326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af290cd7-7378-4655-886e-70edd63dbb22 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:16.214762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af290cd7-7378-4655-886e-70edd63dbb22 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:16.215508 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af290cd7-7378-4655-886e-70edd63dbb22 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:16.215934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af290cd7-7378-4655-886e-70edd63dbb22 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:16.243512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-af290cd7-7378-4655-886e-70edd63dbb22 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041898 Jul 27 22:59:16.244043 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 855/1701] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:16 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:16.552112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1c5469f5-7e93-43e6-ad54-0225615ffbe1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:16.554296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1c5469f5-7e93-43e6-ad54-0225615ffbe1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:16.560249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c5469f5-7e93-43e6-ad54-0225615ffbe1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:16.560730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c5469f5-7e93-43e6-ad54-0225615ffbe1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:16.561487 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c5469f5-7e93-43e6-ad54-0225615ffbe1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:16.561922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c5469f5-7e93-43e6-ad54-0225615ffbe1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:16.590638 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1c5469f5-7e93-43e6-ad54-0225615ffbe1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042400 Jul 27 22:59:16.591187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 847/1702] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:16 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:16.669474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ce555283-eb0f-433d-853a-e818a2c377f9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:16.670078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ce555283-eb0f-433d-853a-e818a2c377f9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:16.676744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce555283-eb0f-433d-853a-e818a2c377f9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:16.677185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce555283-eb0f-433d-853a-e818a2c377f9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:16.677932 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce555283-eb0f-433d-853a-e818a2c377f9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:16.678359 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce555283-eb0f-433d-853a-e818a2c377f9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:16.740544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ce555283-eb0f-433d-853a-e818a2c377f9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:16.747872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ce555283-eb0f-433d-853a-e818a2c377f9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082201 Jul 27 22:59:16.748431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 856/1703] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:16 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:17.084997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7fff08bd-095d-4c4f-8724-774fe2ae2f1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:17.087752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7fff08bd-095d-4c4f-8724-774fe2ae2f1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:17.093737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7fff08bd-095d-4c4f-8724-774fe2ae2f1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:17.094216 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7fff08bd-095d-4c4f-8724-774fe2ae2f1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:17.094975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7fff08bd-095d-4c4f-8724-774fe2ae2f1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:17.095405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7fff08bd-095d-4c4f-8724-774fe2ae2f1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:17.123493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7fff08bd-095d-4c4f-8724-774fe2ae2f1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043037 Jul 27 22:59:17.124035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 848/1704] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:17 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:17.256484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bceec33e-16d7-47fe-8981-09314c96bea1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:17.259286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bceec33e-16d7-47fe-8981-09314c96bea1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:17.265423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bceec33e-16d7-47fe-8981-09314c96bea1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:17.265884 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bceec33e-16d7-47fe-8981-09314c96bea1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:17.266632 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bceec33e-16d7-47fe-8981-09314c96bea1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:17.267178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bceec33e-16d7-47fe-8981-09314c96bea1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:17.295724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bceec33e-16d7-47fe-8981-09314c96bea1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043813 Jul 27 22:59:17.296277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 857/1705] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:17 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:17.602450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b873cff9-61ce-4891-9920-3f76dada13fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:17.604857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b873cff9-61ce-4891-9920-3f76dada13fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:17.610838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b873cff9-61ce-4891-9920-3f76dada13fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:17.611274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b873cff9-61ce-4891-9920-3f76dada13fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:17.612016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b873cff9-61ce-4891-9920-3f76dada13fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:17.612442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b873cff9-61ce-4891-9920-3f76dada13fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:17.640574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b873cff9-61ce-4891-9920-3f76dada13fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042574 Jul 27 22:59:17.641144 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 849/1706] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:17 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:17.768665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-822ff2ec-b8c6-42c1-bfa7-aa492f2ca3d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:17.769281 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-822ff2ec-b8c6-42c1-bfa7-aa492f2ca3d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:17.776014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-822ff2ec-b8c6-42c1-bfa7-aa492f2ca3d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:17.776452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-822ff2ec-b8c6-42c1-bfa7-aa492f2ca3d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:17.777308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-822ff2ec-b8c6-42c1-bfa7-aa492f2ca3d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:17.777739 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-822ff2ec-b8c6-42c1-bfa7-aa492f2ca3d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:17.838100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-822ff2ec-b8c6-42c1-bfa7-aa492f2ca3d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:17.845404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-822ff2ec-b8c6-42c1-bfa7-aa492f2ca3d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080675 Jul 27 22:59:17.845981 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 858/1707] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:17 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:18.135803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dd03eaaa-c357-4636-817b-da647e97e274 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:18.138002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dd03eaaa-c357-4636-817b-da647e97e274 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:18.143958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd03eaaa-c357-4636-817b-da647e97e274 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:18.144403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd03eaaa-c357-4636-817b-da647e97e274 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:18.145198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd03eaaa-c357-4636-817b-da647e97e274 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:18.145632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd03eaaa-c357-4636-817b-da647e97e274 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:18.174373 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dd03eaaa-c357-4636-817b-da647e97e274 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042538 Jul 27 22:59:18.174913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 850/1708] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:18 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:18.307705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a09d3c4a-263f-4713-8b0d-793547672526 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:18.309915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a09d3c4a-263f-4713-8b0d-793547672526 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:18.315892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a09d3c4a-263f-4713-8b0d-793547672526 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:18.316330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a09d3c4a-263f-4713-8b0d-793547672526 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:18.317104 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a09d3c4a-263f-4713-8b0d-793547672526 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:18.317530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a09d3c4a-263f-4713-8b0d-793547672526 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:18.347804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a09d3c4a-263f-4713-8b0d-793547672526 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044212 Jul 27 22:59:18.348336 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 859/1709] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:18.715140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-15ce7b59-4c25-42b8-b171-ce00f74b45c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:18.717291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-15ce7b59-4c25-42b8-b171-ce00f74b45c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:18.723126 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15ce7b59-4c25-42b8-b171-ce00f74b45c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:18.723567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15ce7b59-4c25-42b8-b171-ce00f74b45c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:18.724323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15ce7b59-4c25-42b8-b171-ce00f74b45c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:18.725090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15ce7b59-4c25-42b8-b171-ce00f74b45c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:18.754659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-15ce7b59-4c25-42b8-b171-ce00f74b45c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105569 Jul 27 22:59:18.755201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 851/1710] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:18 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:18.812202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 22:59:18.812704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 22:59:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 22:59:18.866460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-36c09620-47b5-4d5a-8bc8-5c99956844cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:18.867602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-36c09620-47b5-4d5a-8bc8-5c99956844cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:18.873783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36c09620-47b5-4d5a-8bc8-5c99956844cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:18.874175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36c09620-47b5-4d5a-8bc8-5c99956844cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:18.874939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36c09620-47b5-4d5a-8bc8-5c99956844cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:18.875380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36c09620-47b5-4d5a-8bc8-5c99956844cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:18.935256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-36c09620-47b5-4d5a-8bc8-5c99956844cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:18.942634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-36c09620-47b5-4d5a-8bc8-5c99956844cb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079951 Jul 27 22:59:18.943189 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 860/1711] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:18 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:19.186660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2536dc76-7c6a-48da-9c02-442977fb9742 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:19.188801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2536dc76-7c6a-48da-9c02-442977fb9742 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:19.194748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2536dc76-7c6a-48da-9c02-442977fb9742 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:19.195184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2536dc76-7c6a-48da-9c02-442977fb9742 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:19.195924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2536dc76-7c6a-48da-9c02-442977fb9742 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:19.196348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2536dc76-7c6a-48da-9c02-442977fb9742 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:19.223540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2536dc76-7c6a-48da-9c02-442977fb9742 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040917 Jul 27 22:59:19.224065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 852/1712] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:19 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:19.360525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d1037e22-0ec8-4d11-8c22-5bdf0d56d821 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:19.362677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d1037e22-0ec8-4d11-8c22-5bdf0d56d821 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:19.369091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1037e22-0ec8-4d11-8c22-5bdf0d56d821 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:19.369530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1037e22-0ec8-4d11-8c22-5bdf0d56d821 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:19.370278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1037e22-0ec8-4d11-8c22-5bdf0d56d821 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:19.370734 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1037e22-0ec8-4d11-8c22-5bdf0d56d821 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:19.398691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d1037e22-0ec8-4d11-8c22-5bdf0d56d821 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041767 Jul 27 22:59:19.399229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 861/1713] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:19 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:59:19.767503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c44f6252-1108-4a7c-9772-8d7408c3dd44 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:19.769771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c44f6252-1108-4a7c-9772-8d7408c3dd44 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:19.776484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c44f6252-1108-4a7c-9772-8d7408c3dd44 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:19.776992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c44f6252-1108-4a7c-9772-8d7408c3dd44 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:19.777754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c44f6252-1108-4a7c-9772-8d7408c3dd44 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:19.778189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c44f6252-1108-4a7c-9772-8d7408c3dd44 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:19.806918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c44f6252-1108-4a7c-9772-8d7408c3dd44 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043404 Jul 27 22:59:19.807458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 853/1714] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:19 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:19.963891 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-983b416a-f28b-4df7-b0d1-0d0d1f6eedb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:19.964433 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-983b416a-f28b-4df7-b0d1-0d0d1f6eedb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:19.970358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-983b416a-f28b-4df7-b0d1-0d0d1f6eedb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:19.970804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-983b416a-f28b-4df7-b0d1-0d0d1f6eedb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:19.971562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-983b416a-f28b-4df7-b0d1-0d0d1f6eedb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:19.971997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-983b416a-f28b-4df7-b0d1-0d0d1f6eedb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:20.032715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-983b416a-f28b-4df7-b0d1-0d0d1f6eedb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:20.040171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-983b416a-f28b-4df7-b0d1-0d0d1f6eedb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080883 Jul 27 22:59:20.040755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 862/1715] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:19 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:20.236485 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4a00fc76-c318-46c4-93d9-845bdf50c574 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:20.238626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4a00fc76-c318-46c4-93d9-845bdf50c574 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:20.245100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4a00fc76-c318-46c4-93d9-845bdf50c574 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:20.245548 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4a00fc76-c318-46c4-93d9-845bdf50c574 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:20.246327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4a00fc76-c318-46c4-93d9-845bdf50c574 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:20.246760 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4a00fc76-c318-46c4-93d9-845bdf50c574 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:20.274672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4a00fc76-c318-46c4-93d9-845bdf50c574 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042247 Jul 27 22:59:20.275210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 854/1716] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:20 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:20.410917 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-735ef8da-736c-4601-a1e6-7238359cd9cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:20.413100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-735ef8da-736c-4601-a1e6-7238359cd9cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:20.419559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-735ef8da-736c-4601-a1e6-7238359cd9cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:20.420006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-735ef8da-736c-4601-a1e6-7238359cd9cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:20.420802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-735ef8da-736c-4601-a1e6-7238359cd9cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:20.421239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-735ef8da-736c-4601-a1e6-7238359cd9cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:20.450839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-735ef8da-736c-4601-a1e6-7238359cd9cf tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043900 Jul 27 22:59:20.451387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 863/1717] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:59:20.819121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3065e895-a966-47a0-b7e0-35ef431f6c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:20.821832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3065e895-a966-47a0-b7e0-35ef431f6c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:20.829945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3065e895-a966-47a0-b7e0-35ef431f6c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:20.830392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3065e895-a966-47a0-b7e0-35ef431f6c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:20.831149 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3065e895-a966-47a0-b7e0-35ef431f6c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:20.831584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3065e895-a966-47a0-b7e0-35ef431f6c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:20.861190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3065e895-a966-47a0-b7e0-35ef431f6c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046038 Jul 27 22:59:20.861733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 855/1718] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:20 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:21.060415 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-831e1f1f-a08f-4b63-91f1-4b0fbb17a29e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:21.061051 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-831e1f1f-a08f-4b63-91f1-4b0fbb17a29e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:21.067030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-831e1f1f-a08f-4b63-91f1-4b0fbb17a29e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:21.067474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-831e1f1f-a08f-4b63-91f1-4b0fbb17a29e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:21.068233 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-831e1f1f-a08f-4b63-91f1-4b0fbb17a29e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:21.068698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-831e1f1f-a08f-4b63-91f1-4b0fbb17a29e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:21.135281 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-831e1f1f-a08f-4b63-91f1-4b0fbb17a29e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:21.142848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-831e1f1f-a08f-4b63-91f1-4b0fbb17a29e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.086252 Jul 27 22:59:21.143405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 864/1719] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:21 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:21.286922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6c3f18ee-39b3-4e46-9dd4-8be3875c9162 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:21.289176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6c3f18ee-39b3-4e46-9dd4-8be3875c9162 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:21.295222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c3f18ee-39b3-4e46-9dd4-8be3875c9162 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:21.295667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c3f18ee-39b3-4e46-9dd4-8be3875c9162 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:21.296420 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c3f18ee-39b3-4e46-9dd4-8be3875c9162 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:21.296877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c3f18ee-39b3-4e46-9dd4-8be3875c9162 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:21.324724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6c3f18ee-39b3-4e46-9dd4-8be3875c9162 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041749 Jul 27 22:59:21.325258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 856/1720] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:21 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:21.463787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1b72ee24-130e-4a58-9021-f5de7736867a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:21.465914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1b72ee24-130e-4a58-9021-f5de7736867a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:21.472297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b72ee24-130e-4a58-9021-f5de7736867a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:21.472771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b72ee24-130e-4a58-9021-f5de7736867a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:21.473514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b72ee24-130e-4a58-9021-f5de7736867a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:21.473937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b72ee24-130e-4a58-9021-f5de7736867a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:21.503725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1b72ee24-130e-4a58-9021-f5de7736867a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044575 Jul 27 22:59:21.504268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 865/1721] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:21 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:21.847096 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 22:59:21.847267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 22:59:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 22:59:21.873997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d2a5a1fe-e458-4214-a50a-58628fb7f8ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:21.876113 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d2a5a1fe-e458-4214-a50a-58628fb7f8ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:21.882056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2a5a1fe-e458-4214-a50a-58628fb7f8ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:21.883130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2a5a1fe-e458-4214-a50a-58628fb7f8ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:21.883876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2a5a1fe-e458-4214-a50a-58628fb7f8ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:21.884302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2a5a1fe-e458-4214-a50a-58628fb7f8ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:21.911762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d2a5a1fe-e458-4214-a50a-58628fb7f8ca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041717 Jul 27 22:59:21.912296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 857/1722] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:21 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:22.125010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 22:59:22.125182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 22:59:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 22:59:22.163179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0eaf858e-d74a-4f3c-9beb-e051c13d6fb9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:22.164417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0eaf858e-d74a-4f3c-9beb-e051c13d6fb9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:22.170563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0eaf858e-d74a-4f3c-9beb-e051c13d6fb9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:22.171009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0eaf858e-d74a-4f3c-9beb-e051c13d6fb9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:22.171775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0eaf858e-d74a-4f3c-9beb-e051c13d6fb9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:22.172211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0eaf858e-d74a-4f3c-9beb-e051c13d6fb9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:22.232149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0eaf858e-d74a-4f3c-9beb-e051c13d6fb9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:22.239573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0eaf858e-d74a-4f3c-9beb-e051c13d6fb9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080338 Jul 27 22:59:22.240133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 866/1723] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:22 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:22.336763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4bb0ab7b-3585-4435-a54e-83034768e2fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:22.338911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4bb0ab7b-3585-4435-a54e-83034768e2fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:22.344981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4bb0ab7b-3585-4435-a54e-83034768e2fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:22.345424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4bb0ab7b-3585-4435-a54e-83034768e2fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:22.346174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4bb0ab7b-3585-4435-a54e-83034768e2fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:22.346602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4bb0ab7b-3585-4435-a54e-83034768e2fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:22.375274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4bb0ab7b-3585-4435-a54e-83034768e2fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042895 Jul 27 22:59:22.375749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 858/1724] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:22 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:22.578388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-76bf2dff-9805-40a4-af13-3772e31329b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:22.580511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-76bf2dff-9805-40a4-af13-3772e31329b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:22.587050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-76bf2dff-9805-40a4-af13-3772e31329b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:22.587498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-76bf2dff-9805-40a4-af13-3772e31329b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:22.588251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-76bf2dff-9805-40a4-af13-3772e31329b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:22.588716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-76bf2dff-9805-40a4-af13-3772e31329b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:22.617784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-76bf2dff-9805-40a4-af13-3772e31329b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105333 Jul 27 22:59:22.618328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 867/1725] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:22 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:22.924397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3a123065-cec9-4a95-ad24-15be958db8e4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:22.926669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3a123065-cec9-4a95-ad24-15be958db8e4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:22.932627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3a123065-cec9-4a95-ad24-15be958db8e4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:22.933074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3a123065-cec9-4a95-ad24-15be958db8e4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:22.933828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3a123065-cec9-4a95-ad24-15be958db8e4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:22.934263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3a123065-cec9-4a95-ad24-15be958db8e4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:22.963056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3a123065-cec9-4a95-ad24-15be958db8e4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042753 Jul 27 22:59:22.963588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 859/1726] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:22 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:23.261564 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f5018d45-04d8-4777-a606-55d208e3ac6b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:23.262080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f5018d45-04d8-4777-a606-55d208e3ac6b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:23.268080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5018d45-04d8-4777-a606-55d208e3ac6b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:23.268520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5018d45-04d8-4777-a606-55d208e3ac6b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:23.269325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5018d45-04d8-4777-a606-55d208e3ac6b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:23.269756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5018d45-04d8-4777-a606-55d208e3ac6b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:23.336163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f5018d45-04d8-4777-a606-55d208e3ac6b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:23.343672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f5018d45-04d8-4777-a606-55d208e3ac6b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.086854 Jul 27 22:59:23.344225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 868/1727] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:23 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:23.387885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f86b61a3-0e99-4c8e-8f53-574a6d429845 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:23.390096 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f86b61a3-0e99-4c8e-8f53-574a6d429845 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:23.396285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f86b61a3-0e99-4c8e-8f53-574a6d429845 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:23.396769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f86b61a3-0e99-4c8e-8f53-574a6d429845 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:23.397530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f86b61a3-0e99-4c8e-8f53-574a6d429845 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:23.397968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f86b61a3-0e99-4c8e-8f53-574a6d429845 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:23.414020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:23.427265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f86b61a3-0e99-4c8e-8f53-574a6d429845 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043352 Jul 27 22:59:23.428064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 860/1728] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:23 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:23.630182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c3021021-956a-4be9-97ee-0e7603edbcef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:23.632376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c3021021-956a-4be9-97ee-0e7603edbcef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:23.638822 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3021021-956a-4be9-97ee-0e7603edbcef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:23.639269 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3021021-956a-4be9-97ee-0e7603edbcef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:23.640024 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3021021-956a-4be9-97ee-0e7603edbcef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:23.640484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c3021021-956a-4be9-97ee-0e7603edbcef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:23.668937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c3021021-956a-4be9-97ee-0e7603edbcef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042739 Jul 27 22:59:23.669475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 869/1729] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:23 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:23.975312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-741c20e9-978d-4b4c-9782-56ad57e45b2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:23.978008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-741c20e9-978d-4b4c-9782-56ad57e45b2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:23.984278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-741c20e9-978d-4b4c-9782-56ad57e45b2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:23.984750 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-741c20e9-978d-4b4c-9782-56ad57e45b2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:23.985496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-741c20e9-978d-4b4c-9782-56ad57e45b2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:23.985923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-741c20e9-978d-4b4c-9782-56ad57e45b2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:24.013748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-741c20e9-978d-4b4c-9782-56ad57e45b2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042496 Jul 27 22:59:24.014274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 861/1730] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:23 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:24.238528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-89948f4c-90c3-4599-bd19-026f44fb0e7a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:24.239013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-89948f4c-90c3-4599-bd19-026f44fb0e7a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:24.245680 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89948f4c-90c3-4599-bd19-026f44fb0e7a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:24.246121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89948f4c-90c3-4599-bd19-026f44fb0e7a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:24.246905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89948f4c-90c3-4599-bd19-026f44fb0e7a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:24.247329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89948f4c-90c3-4599-bd19-026f44fb0e7a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:24.265080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:24.364001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-99f5cff8-9755-4ae9-b14b-decf8d131d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:24.364687 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-99f5cff8-9755-4ae9-b14b-decf8d131d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:24.370681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99f5cff8-9755-4ae9-b14b-decf8d131d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:24.371103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99f5cff8-9755-4ae9-b14b-decf8d131d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:24.371854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99f5cff8-9755-4ae9-b14b-decf8d131d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:24.372284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99f5cff8-9755-4ae9-b14b-decf8d131d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:24.476850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-99f5cff8-9755-4ae9-b14b-decf8d131d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:24.484681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-99f5cff8-9755-4ae9-b14b-decf8d131d5d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.124446 Jul 27 22:59:24.485173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 862/1731] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:24 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:24.489574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a5b9bd7c-9ad0-48b2-8ad7-31e134dd92b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:24.493565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a5b9bd7c-9ad0-48b2-8ad7-31e134dd92b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:24.499370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a5b9bd7c-9ad0-48b2-8ad7-31e134dd92b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:24.499811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a5b9bd7c-9ad0-48b2-8ad7-31e134dd92b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:24.500587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a5b9bd7c-9ad0-48b2-8ad7-31e134dd92b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:24.501017 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a5b9bd7c-9ad0-48b2-8ad7-31e134dd92b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:24.529585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a5b9bd7c-9ad0-48b2-8ad7-31e134dd92b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043444 Jul 27 22:59:24.530121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 863/1732] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:24 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:24.681746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-517d10f3-85bd-4193-84ee-9435d3a6e5fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:24.683864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-517d10f3-85bd-4193-84ee-9435d3a6e5fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:24.689854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-517d10f3-85bd-4193-84ee-9435d3a6e5fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:24.690297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-517d10f3-85bd-4193-84ee-9435d3a6e5fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:24.691042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-517d10f3-85bd-4193-84ee-9435d3a6e5fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:24.691472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-517d10f3-85bd-4193-84ee-9435d3a6e5fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:24.719605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-517d10f3-85bd-4193-84ee-9435d3a6e5fb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042328 Jul 27 22:59:24.720140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 864/1733] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:24 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:59:25.025653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b2ff3974-fda0-4342-bb20-d3ea6b8582e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:25.027779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b2ff3974-fda0-4342-bb20-d3ea6b8582e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:25.033764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2ff3974-fda0-4342-bb20-d3ea6b8582e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:25.034202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2ff3974-fda0-4342-bb20-d3ea6b8582e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:25.034980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2ff3974-fda0-4342-bb20-d3ea6b8582e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:25.035406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2ff3974-fda0-4342-bb20-d3ea6b8582e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:25.063895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b2ff3974-fda0-4342-bb20-d3ea6b8582e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042104 Jul 27 22:59:25.064355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 865/1734] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:25 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:25.504624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4485694d-0478-4279-ab9a-f67c03494710 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:25.505158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4485694d-0478-4279-ab9a-f67c03494710 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:25.511398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4485694d-0478-4279-ab9a-f67c03494710 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:25.511841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4485694d-0478-4279-ab9a-f67c03494710 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:25.512636 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4485694d-0478-4279-ab9a-f67c03494710 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:25.513074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4485694d-0478-4279-ab9a-f67c03494710 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:25.575242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4485694d-0478-4279-ab9a-f67c03494710 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:25.582719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4485694d-0478-4279-ab9a-f67c03494710 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082076 Jul 27 22:59:25.583263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 866/1735] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:25 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:25.593022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dff2c50e-3f8d-4067-9606-55225bcdb970 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:25.595747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dff2c50e-3f8d-4067-9606-55225bcdb970 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:25.603711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dff2c50e-3f8d-4067-9606-55225bcdb970 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:25.604342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dff2c50e-3f8d-4067-9606-55225bcdb970 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:25.605699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dff2c50e-3f8d-4067-9606-55225bcdb970 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:25.606487 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dff2c50e-3f8d-4067-9606-55225bcdb970 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:25.640371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dff2c50e-3f8d-4067-9606-55225bcdb970 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056097 Jul 27 22:59:25.640948 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 867/1736] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:25.731846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a1f45688-f95e-4f38-bf2a-ae0d53d57642 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:25.733980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a1f45688-f95e-4f38-bf2a-ae0d53d57642 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:25.739725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1f45688-f95e-4f38-bf2a-ae0d53d57642 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:25.740164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1f45688-f95e-4f38-bf2a-ae0d53d57642 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:25.740948 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1f45688-f95e-4f38-bf2a-ae0d53d57642 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:25.741381 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1f45688-f95e-4f38-bf2a-ae0d53d57642 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:25.769121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a1f45688-f95e-4f38-bf2a-ae0d53d57642 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041264 Jul 27 22:59:25.769592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 868/1737] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:25 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:59:26.076485 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f9820459-913c-4c1c-ad45-3cfca63eb10c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:26.078662 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f9820459-913c-4c1c-ad45-3cfca63eb10c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:26.084604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f9820459-913c-4c1c-ad45-3cfca63eb10c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:26.085046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f9820459-913c-4c1c-ad45-3cfca63eb10c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:26.086337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f9820459-913c-4c1c-ad45-3cfca63eb10c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:26.086767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f9820459-913c-4c1c-ad45-3cfca63eb10c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:26.114680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f9820459-913c-4c1c-ad45-3cfca63eb10c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042169 Jul 27 22:59:26.115215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 869/1738] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:26 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:26.603988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-158bc580-47d1-4e9c-ac07-3d4c3ab756c1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:26.604515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-158bc580-47d1-4e9c-ac07-3d4c3ab756c1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:26.610555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-158bc580-47d1-4e9c-ac07-3d4c3ab756c1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:26.610998 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-158bc580-47d1-4e9c-ac07-3d4c3ab756c1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:26.611750 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-158bc580-47d1-4e9c-ac07-3d4c3ab756c1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:26.612182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-158bc580-47d1-4e9c-ac07-3d4c3ab756c1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:26.671441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-158bc580-47d1-4e9c-ac07-3d4c3ab756c1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:26.679562 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-158bc580-47d1-4e9c-ac07-3d4c3ab756c1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079615 Jul 27 22:59:26.680125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 870/1739] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:26 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:26.684619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e355a8f8-7035-45a1-8a25-c425cb1caa3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:26.686712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e355a8f8-7035-45a1-8a25-c425cb1caa3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:26.692294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e355a8f8-7035-45a1-8a25-c425cb1caa3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:26.692774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e355a8f8-7035-45a1-8a25-c425cb1caa3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:26.693530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e355a8f8-7035-45a1-8a25-c425cb1caa3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:26.693961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e355a8f8-7035-45a1-8a25-c425cb1caa3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:26.721311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e355a8f8-7035-45a1-8a25-c425cb1caa3c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040198 Jul 27 22:59:26.721840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 871/1740] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:26 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:26.781461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-98dd55cc-057b-448f-8dcc-cfee282ade0d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:26.783570 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-98dd55cc-057b-448f-8dcc-cfee282ade0d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:26.789832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98dd55cc-057b-448f-8dcc-cfee282ade0d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:26.790272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98dd55cc-057b-448f-8dcc-cfee282ade0d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:26.791021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98dd55cc-057b-448f-8dcc-cfee282ade0d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:26.791451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98dd55cc-057b-448f-8dcc-cfee282ade0d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:26.819415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-98dd55cc-057b-448f-8dcc-cfee282ade0d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041630 Jul 27 22:59:26.819945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 872/1741] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:26 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:59:27.127323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-61682a3e-1994-48ab-8127-6952632f06c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:27.129457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-61682a3e-1994-48ab-8127-6952632f06c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:27.135503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61682a3e-1994-48ab-8127-6952632f06c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:27.135939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61682a3e-1994-48ab-8127-6952632f06c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:27.136715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61682a3e-1994-48ab-8127-6952632f06c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:27.137140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61682a3e-1994-48ab-8127-6952632f06c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:27.173691 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-61682a3e-1994-48ab-8127-6952632f06c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050205 Jul 27 22:59:27.174243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 873/1742] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:27 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:27.699717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f7619ed3-a15c-444f-a4c4-75759b9fe1de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:27.700317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f7619ed3-a15c-444f-a4c4-75759b9fe1de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:27.706513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f7619ed3-a15c-444f-a4c4-75759b9fe1de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:27.706987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f7619ed3-a15c-444f-a4c4-75759b9fe1de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:27.707748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f7619ed3-a15c-444f-a4c4-75759b9fe1de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:27.708180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f7619ed3-a15c-444f-a4c4-75759b9fe1de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:27.767905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f7619ed3-a15c-444f-a4c4-75759b9fe1de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:27.775261 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f7619ed3-a15c-444f-a4c4-75759b9fe1de tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079400 Jul 27 22:59:27.775815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 874/1743] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:27 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:27.780197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-93762286-0dae-4a3e-a755-c9a86bfb9b4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:27.782363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-93762286-0dae-4a3e-a755-c9a86bfb9b4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:27.787879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-93762286-0dae-4a3e-a755-c9a86bfb9b4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:27.788350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-93762286-0dae-4a3e-a755-c9a86bfb9b4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:27.789138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-93762286-0dae-4a3e-a755-c9a86bfb9b4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:27.789568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-93762286-0dae-4a3e-a755-c9a86bfb9b4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:27.817746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-93762286-0dae-4a3e-a755-c9a86bfb9b4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040956 Jul 27 22:59:27.818290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 875/1744] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:27 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:27.830931 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6dd089af-e6b3-4f86-89b6-24b680e80894 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:27.833048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6dd089af-e6b3-4f86-89b6-24b680e80894 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:27.838864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6dd089af-e6b3-4f86-89b6-24b680e80894 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:27.839300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6dd089af-e6b3-4f86-89b6-24b680e80894 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:27.840044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6dd089af-e6b3-4f86-89b6-24b680e80894 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:27.840470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6dd089af-e6b3-4f86-89b6-24b680e80894 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:27.868632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6dd089af-e6b3-4f86-89b6-24b680e80894 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041377 Jul 27 22:59:27.869168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 876/1745] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:27 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 22:59:28.186523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-af8c4376-84b4-44b8-a51e-f4171a525ce7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:28.189017 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-af8c4376-84b4-44b8-a51e-f4171a525ce7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:28.195015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-af8c4376-84b4-44b8-a51e-f4171a525ce7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:28.195460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-af8c4376-84b4-44b8-a51e-f4171a525ce7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:28.196240 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-af8c4376-84b4-44b8-a51e-f4171a525ce7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:28.196705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-af8c4376-84b4-44b8-a51e-f4171a525ce7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:28.200238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:28.224290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-af8c4376-84b4-44b8-a51e-f4171a525ce7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042051 Jul 27 22:59:28.224861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 877/1746] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:28 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:28.795724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-88fc81db-911d-4ade-9c28-baeef8e8cf8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:28.796334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-88fc81db-911d-4ade-9c28-baeef8e8cf8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:28.802337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-88fc81db-911d-4ade-9c28-baeef8e8cf8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:28.802777 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-88fc81db-911d-4ade-9c28-baeef8e8cf8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:28.803527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-88fc81db-911d-4ade-9c28-baeef8e8cf8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:28.803958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-88fc81db-911d-4ade-9c28-baeef8e8cf8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:28.863347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-88fc81db-911d-4ade-9c28-baeef8e8cf8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:28.870704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-88fc81db-911d-4ade-9c28-baeef8e8cf8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078819 Jul 27 22:59:28.871248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 878/1747] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:28 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:28.875933 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ff775d69-b374-4b05-a70b-ca98d3d862b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:28.878058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ff775d69-b374-4b05-a70b-ca98d3d862b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:28.884098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff775d69-b374-4b05-a70b-ca98d3d862b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:28.884538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff775d69-b374-4b05-a70b-ca98d3d862b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:28.885304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff775d69-b374-4b05-a70b-ca98d3d862b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:28.885731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff775d69-b374-4b05-a70b-ca98d3d862b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:28.913566 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ff775d69-b374-4b05-a70b-ca98d3d862b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041339 Jul 27 22:59:28.914104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 879/1748] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:28 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:28.918580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5bf222ba-3e5c-4fa5-8e6e-cbbb809a4f07 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:28.920640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5bf222ba-3e5c-4fa5-8e6e-cbbb809a4f07 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:28.926021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bf222ba-3e5c-4fa5-8e6e-cbbb809a4f07 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:28.926466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bf222ba-3e5c-4fa5-8e6e-cbbb809a4f07 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:28.927205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bf222ba-3e5c-4fa5-8e6e-cbbb809a4f07 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:28.927635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bf222ba-3e5c-4fa5-8e6e-cbbb809a4f07 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:28.955200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5bf222ba-3e5c-4fa5-8e6e-cbbb809a4f07 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040163 Jul 27 22:59:28.955723 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 880/1749] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:28 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:29.237449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-08773aa9-cba4-408e-83ec-8c5c26141122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:29.239573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-08773aa9-cba4-408e-83ec-8c5c26141122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:29.246097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08773aa9-cba4-408e-83ec-8c5c26141122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:29.246543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08773aa9-cba4-408e-83ec-8c5c26141122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:29.247333 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08773aa9-cba4-408e-83ec-8c5c26141122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:29.247765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08773aa9-cba4-408e-83ec-8c5c26141122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:29.276040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-08773aa9-cba4-408e-83ec-8c5c26141122 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042589 Jul 27 22:59:29.276600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 881/1750] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:29 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:29.890898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0895b2ae-75ec-4e65-acae-afaff53e71a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:29.891500 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0895b2ae-75ec-4e65-acae-afaff53e71a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:29.897489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0895b2ae-75ec-4e65-acae-afaff53e71a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:29.898440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0895b2ae-75ec-4e65-acae-afaff53e71a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:29.899190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0895b2ae-75ec-4e65-acae-afaff53e71a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:29.899621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0895b2ae-75ec-4e65-acae-afaff53e71a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:29.963573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0895b2ae-75ec-4e65-acae-afaff53e71a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:29.971127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0895b2ae-75ec-4e65-acae-afaff53e71a0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083979 Jul 27 22:59:29.971617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 882/1751] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:29 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:29.976699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-30d8d9b9-f561-4915-b5cd-60e7e6fd3791 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:29.979064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-30d8d9b9-f561-4915-b5cd-60e7e6fd3791 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:29.980695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:29.985446 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-30d8d9b9-f561-4915-b5cd-60e7e6fd3791 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:29.985886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-30d8d9b9-f561-4915-b5cd-60e7e6fd3791 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:29.986644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-30d8d9b9-f561-4915-b5cd-60e7e6fd3791 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:29.987082 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-30d8d9b9-f561-4915-b5cd-60e7e6fd3791 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:30.014891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-30d8d9b9-f561-4915-b5cd-60e7e6fd3791 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042303 Jul 27 22:59:30.015415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 883/1752] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:29 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:30.019763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bf09720c-af83-44db-889f-5cdf1f9b66b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:30.021881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bf09720c-af83-44db-889f-5cdf1f9b66b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:30.027846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf09720c-af83-44db-889f-5cdf1f9b66b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:30.028290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf09720c-af83-44db-889f-5cdf1f9b66b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:30.029072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf09720c-af83-44db-889f-5cdf1f9b66b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:30.029506 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf09720c-af83-44db-889f-5cdf1f9b66b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:30.056933 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bf09720c-af83-44db-889f-5cdf1f9b66b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040565 Jul 27 22:59:30.057466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 884/1753] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:30.287588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-08a1fef6-002f-462b-a84b-2ae42945e347 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:30.289726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-08a1fef6-002f-462b-a84b-2ae42945e347 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:30.295699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08a1fef6-002f-462b-a84b-2ae42945e347 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:30.296143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08a1fef6-002f-462b-a84b-2ae42945e347 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:30.296915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08a1fef6-002f-462b-a84b-2ae42945e347 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:30.297342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08a1fef6-002f-462b-a84b-2ae42945e347 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:30.326035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-08a1fef6-002f-462b-a84b-2ae42945e347 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042359 Jul 27 22:59:30.326576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 885/1754] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:30 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:30.993732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9af9ba02-1bfb-4ae9-be3e-4ecbd9b25e01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:30.994346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9af9ba02-1bfb-4ae9-be3e-4ecbd9b25e01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:31.000427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9af9ba02-1bfb-4ae9-be3e-4ecbd9b25e01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:31.000903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9af9ba02-1bfb-4ae9-be3e-4ecbd9b25e01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:31.001654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9af9ba02-1bfb-4ae9-be3e-4ecbd9b25e01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:31.002089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9af9ba02-1bfb-4ae9-be3e-4ecbd9b25e01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:31.061441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9af9ba02-1bfb-4ae9-be3e-4ecbd9b25e01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:31.068831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9af9ba02-1bfb-4ae9-be3e-4ecbd9b25e01 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079569 Jul 27 22:59:31.069429 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 886/1755] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:30 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:31.073816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2d4592f4-03d2-497a-9daf-6c17288bfdbe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:31.075913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2d4592f4-03d2-497a-9daf-6c17288bfdbe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:31.081426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2d4592f4-03d2-497a-9daf-6c17288bfdbe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:31.081872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2d4592f4-03d2-497a-9daf-6c17288bfdbe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:31.082623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2d4592f4-03d2-497a-9daf-6c17288bfdbe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:31.083058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2d4592f4-03d2-497a-9daf-6c17288bfdbe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:31.110907 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2d4592f4-03d2-497a-9daf-6c17288bfdbe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040534 Jul 27 22:59:31.111440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 887/1756] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:31 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:31.115755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0b3f3879-80f8-42d8-8f07-605cc9a6b460 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:31.118462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0b3f3879-80f8-42d8-8f07-605cc9a6b460 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:31.123863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0b3f3879-80f8-42d8-8f07-605cc9a6b460 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:31.124305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0b3f3879-80f8-42d8-8f07-605cc9a6b460 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:31.125139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0b3f3879-80f8-42d8-8f07-605cc9a6b460 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:31.126568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0b3f3879-80f8-42d8-8f07-605cc9a6b460 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:31.157061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0b3f3879-80f8-42d8-8f07-605cc9a6b460 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044572 Jul 27 22:59:31.157632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 888/1757] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:31 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:31.338686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4f8bef30-0e63-4312-bc90-fc32b2a9fe45 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:31.340846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4f8bef30-0e63-4312-bc90-fc32b2a9fe45 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:31.346821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4f8bef30-0e63-4312-bc90-fc32b2a9fe45 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:31.347262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4f8bef30-0e63-4312-bc90-fc32b2a9fe45 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:31.348018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4f8bef30-0e63-4312-bc90-fc32b2a9fe45 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:31.348447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4f8bef30-0e63-4312-bc90-fc32b2a9fe45 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:31.376959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4f8bef30-0e63-4312-bc90-fc32b2a9fe45 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042653 Jul 27 22:59:31.377499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 889/1758] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:31 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:32.089964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5aa7b2db-a8fa-4a1a-8835-6cfa0b1ec95a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:32.090611 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5aa7b2db-a8fa-4a1a-8835-6cfa0b1ec95a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:32.096664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5aa7b2db-a8fa-4a1a-8835-6cfa0b1ec95a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:32.097113 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5aa7b2db-a8fa-4a1a-8835-6cfa0b1ec95a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:32.097870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5aa7b2db-a8fa-4a1a-8835-6cfa0b1ec95a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:32.098305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5aa7b2db-a8fa-4a1a-8835-6cfa0b1ec95a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:32.158609 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5aa7b2db-a8fa-4a1a-8835-6cfa0b1ec95a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:32.166024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5aa7b2db-a8fa-4a1a-8835-6cfa0b1ec95a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079871 Jul 27 22:59:32.166582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 890/1759] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:32 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:32.171003 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-362f03b5-0e2e-40b0-bda1-b7cede216517 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:32.173125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-362f03b5-0e2e-40b0-bda1-b7cede216517 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:32.179460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-362f03b5-0e2e-40b0-bda1-b7cede216517 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:32.179902 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-362f03b5-0e2e-40b0-bda1-b7cede216517 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:32.180728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-362f03b5-0e2e-40b0-bda1-b7cede216517 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:32.181157 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-362f03b5-0e2e-40b0-bda1-b7cede216517 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:32.208964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-362f03b5-0e2e-40b0-bda1-b7cede216517 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041403 Jul 27 22:59:32.209501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 891/1760] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:32 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:32.213863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9d1438d7-4122-4855-b43c-c22d6f63a99b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:32.215873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9d1438d7-4122-4855-b43c-c22d6f63a99b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:32.221332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d1438d7-4122-4855-b43c-c22d6f63a99b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:32.221775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d1438d7-4122-4855-b43c-c22d6f63a99b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:32.222512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d1438d7-4122-4855-b43c-c22d6f63a99b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:32.222938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d1438d7-4122-4855-b43c-c22d6f63a99b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:32.250717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9d1438d7-4122-4855-b43c-c22d6f63a99b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040291 Jul 27 22:59:32.251249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 892/1761] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:32 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:32.389153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5449d28d-b993-4b1f-955c-6c82d4c4e11d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:32.391186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5449d28d-b993-4b1f-955c-6c82d4c4e11d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:32.397227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5449d28d-b993-4b1f-955c-6c82d4c4e11d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:32.397670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5449d28d-b993-4b1f-955c-6c82d4c4e11d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:32.398421 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5449d28d-b993-4b1f-955c-6c82d4c4e11d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:32.398851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5449d28d-b993-4b1f-955c-6c82d4c4e11d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:32.422466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:32.427277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5449d28d-b993-4b1f-955c-6c82d4c4e11d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042011 Jul 27 22:59:32.427814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 893/1762] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:32 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:33.187278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5ce82546-a98a-477b-93c1-10cc0dafa778 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:33.187888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5ce82546-a98a-477b-93c1-10cc0dafa778 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:33.193889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ce82546-a98a-477b-93c1-10cc0dafa778 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:33.194343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ce82546-a98a-477b-93c1-10cc0dafa778 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:33.195113 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ce82546-a98a-477b-93c1-10cc0dafa778 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:33.195551 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ce82546-a98a-477b-93c1-10cc0dafa778 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:33.255087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5ce82546-a98a-477b-93c1-10cc0dafa778 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:33.263141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5ce82546-a98a-477b-93c1-10cc0dafa778 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079935 Jul 27 22:59:33.263694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 894/1763] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:33 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:33.268151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-24f40542-7348-4527-ac5d-532dd04ca496 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:33.270283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-24f40542-7348-4527-ac5d-532dd04ca496 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:33.276630 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24f40542-7348-4527-ac5d-532dd04ca496 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:33.277086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24f40542-7348-4527-ac5d-532dd04ca496 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:33.277843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24f40542-7348-4527-ac5d-532dd04ca496 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:33.278278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24f40542-7348-4527-ac5d-532dd04ca496 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:33.306934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-24f40542-7348-4527-ac5d-532dd04ca496 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042210 Jul 27 22:59:33.309282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 895/1764] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:33 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:33.314278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6d0d9f2d-6584-4638-965d-698fe28a4fbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:33.316416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6d0d9f2d-6584-4638-965d-698fe28a4fbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:33.323239 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d0d9f2d-6584-4638-965d-698fe28a4fbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:33.323690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d0d9f2d-6584-4638-965d-698fe28a4fbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:33.324459 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d0d9f2d-6584-4638-965d-698fe28a4fbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:33.324919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d0d9f2d-6584-4638-965d-698fe28a4fbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:33.354125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6d0d9f2d-6584-4638-965d-698fe28a4fbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045530 Jul 27 22:59:33.354676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 896/1765] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:33.439430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9be2f0af-42c7-4fb2-a531-2974552746ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:33.441558 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9be2f0af-42c7-4fb2-a531-2974552746ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:33.447814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9be2f0af-42c7-4fb2-a531-2974552746ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:33.448254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9be2f0af-42c7-4fb2-a531-2974552746ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:33.449025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9be2f0af-42c7-4fb2-a531-2974552746ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:33.449452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9be2f0af-42c7-4fb2-a531-2974552746ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:33.477341 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9be2f0af-42c7-4fb2-a531-2974552746ba tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041602 Jul 27 22:59:33.477874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 897/1766] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:33 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:34.242887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=45 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:34.284002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-24de0695-1d4b-40a4-ab3f-829c13110b25 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:34.284640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-24de0695-1d4b-40a4-ab3f-829c13110b25 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:34.291173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24de0695-1d4b-40a4-ab3f-829c13110b25 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:34.291617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24de0695-1d4b-40a4-ab3f-829c13110b25 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:34.292439 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24de0695-1d4b-40a4-ab3f-829c13110b25 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:34.292897 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-24de0695-1d4b-40a4-ab3f-829c13110b25 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:34.355857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-24de0695-1d4b-40a4-ab3f-829c13110b25 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:34.363312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-24de0695-1d4b-40a4-ab3f-829c13110b25 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083105 Jul 27 22:59:34.363943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 898/1767] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:34 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:34.368368 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-876255a2-f328-43e1-998d-b864fbb07234 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:34.370493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-876255a2-f328-43e1-998d-b864fbb07234 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:34.376758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-876255a2-f328-43e1-998d-b864fbb07234 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:34.377436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-876255a2-f328-43e1-998d-b864fbb07234 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:34.378192 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-876255a2-f328-43e1-998d-b864fbb07234 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:34.378654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-876255a2-f328-43e1-998d-b864fbb07234 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:34.406735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-876255a2-f328-43e1-998d-b864fbb07234 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041923 Jul 27 22:59:34.407273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 899/1768] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:34 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:34.411643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-23ca73cb-8f78-4341-b122-86eeca7da509 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:34.414355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-23ca73cb-8f78-4341-b122-86eeca7da509 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:34.419765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23ca73cb-8f78-4341-b122-86eeca7da509 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:34.420201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23ca73cb-8f78-4341-b122-86eeca7da509 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:34.420984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23ca73cb-8f78-4341-b122-86eeca7da509 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:34.421411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23ca73cb-8f78-4341-b122-86eeca7da509 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:34.449073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-23ca73cb-8f78-4341-b122-86eeca7da509 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040808 Jul 27 22:59:34.449680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 900/1769] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:34 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:34.488342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f71d277a-0c04-4522-a4d5-f1f76236a861 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:34.490441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f71d277a-0c04-4522-a4d5-f1f76236a861 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:34.496190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f71d277a-0c04-4522-a4d5-f1f76236a861 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:34.496663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f71d277a-0c04-4522-a4d5-f1f76236a861 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:34.497415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f71d277a-0c04-4522-a4d5-f1f76236a861 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:34.497847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f71d277a-0c04-4522-a4d5-f1f76236a861 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:34.525764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f71d277a-0c04-4522-a4d5-f1f76236a861 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041022 Jul 27 22:59:34.526298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 901/1770] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:34 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:35.383190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-313ba701-edd6-40a3-8a0e-e718f8d9c7b8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:35.383792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-313ba701-edd6-40a3-8a0e-e718f8d9c7b8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:35.389848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-313ba701-edd6-40a3-8a0e-e718f8d9c7b8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:35.390283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-313ba701-edd6-40a3-8a0e-e718f8d9c7b8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:35.391026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-313ba701-edd6-40a3-8a0e-e718f8d9c7b8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:35.391455 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-313ba701-edd6-40a3-8a0e-e718f8d9c7b8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:35.451430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-313ba701-edd6-40a3-8a0e-e718f8d9c7b8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:35.458864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-313ba701-edd6-40a3-8a0e-e718f8d9c7b8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079526 Jul 27 22:59:35.459406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 902/1771] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:35 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:35.464432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c7b0d7c7-f7d5-4c96-89f1-20c835e7b085 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:35.466606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c7b0d7c7-f7d5-4c96-89f1-20c835e7b085 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:35.472160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7b0d7c7-f7d5-4c96-89f1-20c835e7b085 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:35.472691 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7b0d7c7-f7d5-4c96-89f1-20c835e7b085 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:35.473442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7b0d7c7-f7d5-4c96-89f1-20c835e7b085 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:35.473869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7b0d7c7-f7d5-4c96-89f1-20c835e7b085 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:35.501759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c7b0d7c7-f7d5-4c96-89f1-20c835e7b085 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041407 Jul 27 22:59:35.502291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 903/1772] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:35 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:35.507337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-14ceb4d3-1881-4053-834a-cef42fdd8150 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:35.509365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-14ceb4d3-1881-4053-834a-cef42fdd8150 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:35.514753 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14ceb4d3-1881-4053-834a-cef42fdd8150 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:35.515189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14ceb4d3-1881-4053-834a-cef42fdd8150 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:35.515923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14ceb4d3-1881-4053-834a-cef42fdd8150 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:35.516345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14ceb4d3-1881-4053-834a-cef42fdd8150 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:35.544149 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-14ceb4d3-1881-4053-834a-cef42fdd8150 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040913 Jul 27 22:59:35.544706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 904/1773] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:35.549115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6c904b41-3d99-4ee4-976f-911e7e243b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:35.551130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6c904b41-3d99-4ee4-976f-911e7e243b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:35.556612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c904b41-3d99-4ee4-976f-911e7e243b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:35.557062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c904b41-3d99-4ee4-976f-911e7e243b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:35.557795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c904b41-3d99-4ee4-976f-911e7e243b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:35.558222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c904b41-3d99-4ee4-976f-911e7e243b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:35.586276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6c904b41-3d99-4ee4-976f-911e7e243b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040646 Jul 27 22:59:35.586804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 905/1774] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:35 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:36.480608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ead2eedd-e92e-4062-be7c-538f3e17d2a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:36.481256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ead2eedd-e92e-4062-be7c-538f3e17d2a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:36.487422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ead2eedd-e92e-4062-be7c-538f3e17d2a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:36.487872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ead2eedd-e92e-4062-be7c-538f3e17d2a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:36.488660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ead2eedd-e92e-4062-be7c-538f3e17d2a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:36.489104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ead2eedd-e92e-4062-be7c-538f3e17d2a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:36.548885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ead2eedd-e92e-4062-be7c-538f3e17d2a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:36.556957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ead2eedd-e92e-4062-be7c-538f3e17d2a3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081015 Jul 27 22:59:36.557514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 906/1775] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:36 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:36.562027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d8ccbb75-c35a-4a7b-acb0-9f74a433ce6c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:36.564133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d8ccbb75-c35a-4a7b-acb0-9f74a433ce6c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:36.569974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d8ccbb75-c35a-4a7b-acb0-9f74a433ce6c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:36.570413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d8ccbb75-c35a-4a7b-acb0-9f74a433ce6c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:36.571163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d8ccbb75-c35a-4a7b-acb0-9f74a433ce6c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:36.571620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d8ccbb75-c35a-4a7b-acb0-9f74a433ce6c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:36.599563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d8ccbb75-c35a-4a7b-acb0-9f74a433ce6c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041079 Jul 27 22:59:36.600100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 907/1776] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:36 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:36.605310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-76a33e69-3514-47f9-af92-0e6f8df8ab5b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:36.607330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-76a33e69-3514-47f9-af92-0e6f8df8ab5b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:36.612817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76a33e69-3514-47f9-af92-0e6f8df8ab5b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:36.613255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76a33e69-3514-47f9-af92-0e6f8df8ab5b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:36.613999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76a33e69-3514-47f9-af92-0e6f8df8ab5b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:36.614422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76a33e69-3514-47f9-af92-0e6f8df8ab5b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:36.641483 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-76a33e69-3514-47f9-af92-0e6f8df8ab5b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040432 Jul 27 22:59:36.642018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 908/1777] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:36.646249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9133e40a-0bd8-4fbf-9952-0a195e02f75a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:36.648827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9133e40a-0bd8-4fbf-9952-0a195e02f75a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:36.654277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9133e40a-0bd8-4fbf-9952-0a195e02f75a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:36.654711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9133e40a-0bd8-4fbf-9952-0a195e02f75a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:36.655449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9133e40a-0bd8-4fbf-9952-0a195e02f75a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:36.655878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9133e40a-0bd8-4fbf-9952-0a195e02f75a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:36.684748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9133e40a-0bd8-4fbf-9952-0a195e02f75a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041757 Jul 27 22:59:36.685291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 909/1778] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:36 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:37.577303 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-966c7fdf-f3b2-4a9b-8c97-33c8f3e99458 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:37.577921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-966c7fdf-f3b2-4a9b-8c97-33c8f3e99458 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:37.583856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-966c7fdf-f3b2-4a9b-8c97-33c8f3e99458 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:37.584292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-966c7fdf-f3b2-4a9b-8c97-33c8f3e99458 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:37.585080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-966c7fdf-f3b2-4a9b-8c97-33c8f3e99458 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:37.585512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-966c7fdf-f3b2-4a9b-8c97-33c8f3e99458 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:37.602670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:37.645905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-966c7fdf-f3b2-4a9b-8c97-33c8f3e99458 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:37.654103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-966c7fdf-f3b2-4a9b-8c97-33c8f3e99458 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080528 Jul 27 22:59:37.654686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 910/1779] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:37 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:37.659378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-06633ac5-a42e-40de-86fb-724643f122f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:37.661481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-06633ac5-a42e-40de-86fb-724643f122f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:37.667177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06633ac5-a42e-40de-86fb-724643f122f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:37.667619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06633ac5-a42e-40de-86fb-724643f122f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:37.668362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06633ac5-a42e-40de-86fb-724643f122f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:37.668809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06633ac5-a42e-40de-86fb-724643f122f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:37.697343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-06633ac5-a42e-40de-86fb-724643f122f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041547 Jul 27 22:59:37.697885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 911/1780] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:37 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:37.702650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f7309833-41a1-45c0-9b56-8f97bb69914c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:37.704684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f7309833-41a1-45c0-9b56-8f97bb69914c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:37.710405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f7309833-41a1-45c0-9b56-8f97bb69914c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:37.710872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f7309833-41a1-45c0-9b56-8f97bb69914c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:37.711615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f7309833-41a1-45c0-9b56-8f97bb69914c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:37.712043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f7309833-41a1-45c0-9b56-8f97bb69914c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:37.740207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f7309833-41a1-45c0-9b56-8f97bb69914c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041370 Jul 27 22:59:37.740772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 912/1781] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:37.745618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f90f82b5-c43c-468d-8e6f-75643b76b284 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:37.747655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f90f82b5-c43c-468d-8e6f-75643b76b284 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:37.753059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f90f82b5-c43c-468d-8e6f-75643b76b284 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:37.753495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f90f82b5-c43c-468d-8e6f-75643b76b284 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:37.754230 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f90f82b5-c43c-468d-8e6f-75643b76b284 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:37.754654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f90f82b5-c43c-468d-8e6f-75643b76b284 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:37.781428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f90f82b5-c43c-468d-8e6f-75643b76b284 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039734 Jul 27 22:59:37.781950 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 913/1782] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:37 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:38.674630 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-622eae5f-fea2-40f3-be05-d0c77ab2060b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:38.675347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-622eae5f-fea2-40f3-be05-d0c77ab2060b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:38.681258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-622eae5f-fea2-40f3-be05-d0c77ab2060b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:38.681697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-622eae5f-fea2-40f3-be05-d0c77ab2060b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:38.682438 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-622eae5f-fea2-40f3-be05-d0c77ab2060b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:38.682864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-622eae5f-fea2-40f3-be05-d0c77ab2060b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:38.746411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-622eae5f-fea2-40f3-be05-d0c77ab2060b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:38.753857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-622eae5f-fea2-40f3-be05-d0c77ab2060b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083090 Jul 27 22:59:38.754400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 914/1783] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:38 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:38.759318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a9b0774f-b6a3-4c92-9305-a469f8743881 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:38.761420 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a9b0774f-b6a3-4c92-9305-a469f8743881 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:38.766877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9b0774f-b6a3-4c92-9305-a469f8743881 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:38.767310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9b0774f-b6a3-4c92-9305-a469f8743881 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:38.768049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9b0774f-b6a3-4c92-9305-a469f8743881 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:38.768475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9b0774f-b6a3-4c92-9305-a469f8743881 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:38.796090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a9b0774f-b6a3-4c92-9305-a469f8743881 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040735 Jul 27 22:59:38.796644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 915/1784] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:38 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:38.801027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1aba4ec4-634a-4439-8a0c-f56bd49c3828 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:38.803148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1aba4ec4-634a-4439-8a0c-f56bd49c3828 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:38.808581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1aba4ec4-634a-4439-8a0c-f56bd49c3828 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:38.809022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1aba4ec4-634a-4439-8a0c-f56bd49c3828 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:38.809763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1aba4ec4-634a-4439-8a0c-f56bd49c3828 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:38.810186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1aba4ec4-634a-4439-8a0c-f56bd49c3828 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:38.838519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1aba4ec4-634a-4439-8a0c-f56bd49c3828 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040945 Jul 27 22:59:38.839052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 916/1785] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:38 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:38.843359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8b647fe7-7276-4bf7-b35b-2db21520e5ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:38.845398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8b647fe7-7276-4bf7-b35b-2db21520e5ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:38.850808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b647fe7-7276-4bf7-b35b-2db21520e5ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:38.851308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b647fe7-7276-4bf7-b35b-2db21520e5ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:38.852048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b647fe7-7276-4bf7-b35b-2db21520e5ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:38.852475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8b647fe7-7276-4bf7-b35b-2db21520e5ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:38.879948 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8b647fe7-7276-4bf7-b35b-2db21520e5ec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039995 Jul 27 22:59:38.880469 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 917/1786] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:38 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:39.775234 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-07f62544-38b3-41b9-b4bc-ddc5e971001b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:39.775846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-07f62544-38b3-41b9-b4bc-ddc5e971001b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:39.781991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07f62544-38b3-41b9-b4bc-ddc5e971001b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:39.782446 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07f62544-38b3-41b9-b4bc-ddc5e971001b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:39.783200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07f62544-38b3-41b9-b4bc-ddc5e971001b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:39.783635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07f62544-38b3-41b9-b4bc-ddc5e971001b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:39.842969 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-07f62544-38b3-41b9-b4bc-ddc5e971001b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:39.850371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-07f62544-38b3-41b9-b4bc-ddc5e971001b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079479 Jul 27 22:59:39.850931 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 918/1787] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:39 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:39.856193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-99a30d91-ca21-44b6-b619-13e0236b16d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:39.858340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-99a30d91-ca21-44b6-b619-13e0236b16d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:39.863934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99a30d91-ca21-44b6-b619-13e0236b16d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:39.864380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99a30d91-ca21-44b6-b619-13e0236b16d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:39.865171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99a30d91-ca21-44b6-b619-13e0236b16d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:39.865610 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99a30d91-ca21-44b6-b619-13e0236b16d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:39.893001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-99a30d91-ca21-44b6-b619-13e0236b16d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040493 Jul 27 22:59:39.893540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 919/1788] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:39 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:39.897905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f40b6613-908b-493b-bad9-d7370271e66d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:39.900488 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f40b6613-908b-493b-bad9-d7370271e66d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:39.905999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f40b6613-908b-493b-bad9-d7370271e66d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:39.906443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f40b6613-908b-493b-bad9-d7370271e66d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:39.907194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f40b6613-908b-493b-bad9-d7370271e66d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:39.907630 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f40b6613-908b-493b-bad9-d7370271e66d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:39.936001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f40b6613-908b-493b-bad9-d7370271e66d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041456 Jul 27 22:59:39.937050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 920/1789] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:39.941752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-56490c79-82b9-4af9-94b3-398465f4dc05 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:39.943864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-56490c79-82b9-4af9-94b3-398465f4dc05 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:39.950396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56490c79-82b9-4af9-94b3-398465f4dc05 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:39.950832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56490c79-82b9-4af9-94b3-398465f4dc05 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:39.951583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56490c79-82b9-4af9-94b3-398465f4dc05 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:39.952006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56490c79-82b9-4af9-94b3-398465f4dc05 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:39.980517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-56490c79-82b9-4af9-94b3-398465f4dc05 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042485 Jul 27 22:59:39.981018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 921/1790] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:39 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:40.872087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7e76a75a-a2d1-425c-afe4-a82df53a8f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:40.872799 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7e76a75a-a2d1-425c-afe4-a82df53a8f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:40.878710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e76a75a-a2d1-425c-afe4-a82df53a8f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:40.879154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e76a75a-a2d1-425c-afe4-a82df53a8f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:40.879905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e76a75a-a2d1-425c-afe4-a82df53a8f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:40.880335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e76a75a-a2d1-425c-afe4-a82df53a8f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:40.939608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7e76a75a-a2d1-425c-afe4-a82df53a8f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:40.947146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7e76a75a-a2d1-425c-afe4-a82df53a8f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078881 Jul 27 22:59:40.947701 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 922/1791] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:40 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:40.953012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2767e3cb-6e25-43dd-a3b4-073db5e03c78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:40.955526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2767e3cb-6e25-43dd-a3b4-073db5e03c78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:40.962407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2767e3cb-6e25-43dd-a3b4-073db5e03c78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:40.963047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2767e3cb-6e25-43dd-a3b4-073db5e03c78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:40.963805 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2767e3cb-6e25-43dd-a3b4-073db5e03c78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:40.964230 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2767e3cb-6e25-43dd-a3b4-073db5e03c78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:40.993963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2767e3cb-6e25-43dd-a3b4-073db5e03c78 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Jul 27 22:59:40.994502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 923/1792] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:40 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:40.998923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d602adde-0ee1-46f8-a94c-a2dee24403ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:41.000999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d602adde-0ee1-46f8-a94c-a2dee24403ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:41.006522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d602adde-0ee1-46f8-a94c-a2dee24403ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:41.006968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d602adde-0ee1-46f8-a94c-a2dee24403ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:41.007746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d602adde-0ee1-46f8-a94c-a2dee24403ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:41.008172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d602adde-0ee1-46f8-a94c-a2dee24403ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:41.035367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d602adde-0ee1-46f8-a94c-a2dee24403ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039938 Jul 27 22:59:41.035887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 924/1793] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Jul 27 22:59:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 22:59:41.040747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4d82c330-7d74-4c8d-a687-12842f113e10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:41.042714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4d82c330-7d74-4c8d-a687-12842f113e10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:41.048010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d82c330-7d74-4c8d-a687-12842f113e10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:41.048442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d82c330-7d74-4c8d-a687-12842f113e10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:41.049214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d82c330-7d74-4c8d-a687-12842f113e10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:41.049637 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d82c330-7d74-4c8d-a687-12842f113e10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:41.077056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4d82c330-7d74-4c8d-a687-12842f113e10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040261 Jul 27 22:59:41.077604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 925/1794] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:41 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:41.968055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-23b503d2-a0ee-48af-aedf-2908bef24ef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:41.968711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-23b503d2-a0ee-48af-aedf-2908bef24ef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:41.974783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23b503d2-a0ee-48af-aedf-2908bef24ef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:41.975172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23b503d2-a0ee-48af-aedf-2908bef24ef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:41.975916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23b503d2-a0ee-48af-aedf-2908bef24ef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:41.976346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23b503d2-a0ee-48af-aedf-2908bef24ef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:42.035220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-23b503d2-a0ee-48af-aedf-2908bef24ef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:42.042535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-23b503d2-a0ee-48af-aedf-2908bef24ef9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078330 Jul 27 22:59:42.043083 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 926/1795] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:41 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:42.047461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bb0f778c-81ca-46be-8a9d-e361c2b35ac2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:42.049575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bb0f778c-81ca-46be-8a9d-e361c2b35ac2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:42.055591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb0f778c-81ca-46be-8a9d-e361c2b35ac2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:42.056030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb0f778c-81ca-46be-8a9d-e361c2b35ac2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:42.056814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb0f778c-81ca-46be-8a9d-e361c2b35ac2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:42.057245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb0f778c-81ca-46be-8a9d-e361c2b35ac2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:42.060714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:42.085403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bb0f778c-81ca-46be-8a9d-e361c2b35ac2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041347 Jul 27 22:59:42.085953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 927/1796] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:42 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:42.090287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-73105a21-c5cb-4285-b934-008cef464d6e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 22:59:42.092345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-73105a21-c5cb-4285-b934-008cef464d6e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:42.097872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73105a21-c5cb-4285-b934-008cef464d6e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:42.098316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73105a21-c5cb-4285-b934-008cef464d6e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:42.099060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73105a21-c5cb-4285-b934-008cef464d6e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:42.099507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73105a21-c5cb-4285-b934-008cef464d6e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:42.214078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-73105a21-c5cb-4285-b934-008cef464d6e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "POST /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/action" status: 200 len: 37564 microversion: 2.20 time: 0.126942 Jul 27 22:59:42.214750 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 928/1797] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Jul 27 22:59:42 2022] POST /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e/action => generated 37564 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 27 22:59:42.219783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e5d09a19-9690-406f-87e5-45affc233980 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:42.222079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e5d09a19-9690-406f-87e5-45affc233980 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:42.229953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5d09a19-9690-406f-87e5-45affc233980 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:42.230343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5d09a19-9690-406f-87e5-45affc233980 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:42.231097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5d09a19-9690-406f-87e5-45affc233980 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:42.231529 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5d09a19-9690-406f-87e5-45affc233980 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:42.260639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e5d09a19-9690-406f-87e5-45affc233980 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044753 Jul 27 22:59:42.261180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 929/1798] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:42 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:43.063490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6d00d685-6926-4f1b-bcdd-547e49a34fdd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:43.064161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6d00d685-6926-4f1b-bcdd-547e49a34fdd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:43.070543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d00d685-6926-4f1b-bcdd-547e49a34fdd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:43.070984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d00d685-6926-4f1b-bcdd-547e49a34fdd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:43.071728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d00d685-6926-4f1b-bcdd-547e49a34fdd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:43.072153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d00d685-6926-4f1b-bcdd-547e49a34fdd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:43.135503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6d00d685-6926-4f1b-bcdd-547e49a34fdd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:43.143188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6d00d685-6926-4f1b-bcdd-547e49a34fdd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083714 Jul 27 22:59:43.143745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 930/1799] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:43 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:43.148292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7814c074-1d88-4bd4-bcbf-18cb48d43bae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:43.151145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7814c074-1d88-4bd4-bcbf-18cb48d43bae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:43.157158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7814c074-1d88-4bd4-bcbf-18cb48d43bae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:43.157600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7814c074-1d88-4bd4-bcbf-18cb48d43bae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:43.158364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7814c074-1d88-4bd4-bcbf-18cb48d43bae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:43.158800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7814c074-1d88-4bd4-bcbf-18cb48d43bae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:43.187388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7814c074-1d88-4bd4-bcbf-18cb48d43bae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042674 Jul 27 22:59:43.187929 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 931/1800] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:43 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:43.271814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8d831067-2576-478d-8106-784958dac752 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:43.274010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8d831067-2576-478d-8106-784958dac752 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:43.280001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8d831067-2576-478d-8106-784958dac752 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:43.280445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8d831067-2576-478d-8106-784958dac752 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:43.281312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8d831067-2576-478d-8106-784958dac752 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:43.281747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8d831067-2576-478d-8106-784958dac752 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:43.312449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8d831067-2576-478d-8106-784958dac752 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044533 Jul 27 22:59:43.313046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 932/1801] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:43 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:44.163435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3195eea7-cc7e-432d-a533-42462946b368 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:44.164161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3195eea7-cc7e-432d-a533-42462946b368 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:44.167572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:44.172761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3195eea7-cc7e-432d-a533-42462946b368 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:44.173202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3195eea7-cc7e-432d-a533-42462946b368 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:44.173958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3195eea7-cc7e-432d-a533-42462946b368 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:44.174384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3195eea7-cc7e-432d-a533-42462946b368 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:44.234502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3195eea7-cc7e-432d-a533-42462946b368 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:44.241754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3195eea7-cc7e-432d-a533-42462946b368 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082231 Jul 27 22:59:44.242300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 933/1802] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:44 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:44.246762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-61f03eed-6683-459b-bbda-9ef68da3377e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:44.248876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-61f03eed-6683-459b-bbda-9ef68da3377e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:44.254372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61f03eed-6683-459b-bbda-9ef68da3377e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:44.254812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61f03eed-6683-459b-bbda-9ef68da3377e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:44.255557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61f03eed-6683-459b-bbda-9ef68da3377e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:44.255982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61f03eed-6683-459b-bbda-9ef68da3377e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:44.283537 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-61f03eed-6683-459b-bbda-9ef68da3377e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040226 Jul 27 22:59:44.284073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 934/1803] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:44 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:44.324165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cd60806f-f207-4655-be2e-67b95b9e5e6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:44.326284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cd60806f-f207-4655-be2e-67b95b9e5e6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:44.332041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd60806f-f207-4655-be2e-67b95b9e5e6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:44.332484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd60806f-f207-4655-be2e-67b95b9e5e6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:44.333259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd60806f-f207-4655-be2e-67b95b9e5e6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:44.333696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd60806f-f207-4655-be2e-67b95b9e5e6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:44.362539 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cd60806f-f207-4655-be2e-67b95b9e5e6b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042038 Jul 27 22:59:44.363068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 935/1804] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:44 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 22:59:45.262488 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-31257cb0-f27a-4728-8a01-3cd8ba4752d5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:45.263142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-31257cb0-f27a-4728-8a01-3cd8ba4752d5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:45.269626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31257cb0-f27a-4728-8a01-3cd8ba4752d5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:45.270065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31257cb0-f27a-4728-8a01-3cd8ba4752d5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:45.270809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31257cb0-f27a-4728-8a01-3cd8ba4752d5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:45.271235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31257cb0-f27a-4728-8a01-3cd8ba4752d5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:45.330584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-31257cb0-f27a-4728-8a01-3cd8ba4752d5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:45.338118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-31257cb0-f27a-4728-8a01-3cd8ba4752d5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079524 Jul 27 22:59:45.338670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 936/1805] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:45 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:45.343237 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e8c5876c-7d13-4344-86e1-548a107da135 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:45.345378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e8c5876c-7d13-4344-86e1-548a107da135 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:45.350995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8c5876c-7d13-4344-86e1-548a107da135 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:45.351443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8c5876c-7d13-4344-86e1-548a107da135 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:45.352199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8c5876c-7d13-4344-86e1-548a107da135 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:45.352663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8c5876c-7d13-4344-86e1-548a107da135 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:45.382290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e8c5876c-7d13-4344-86e1-548a107da135 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042590 Jul 27 22:59:45.382854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 937/1806] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:45 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:45.387330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b3e73256-5c59-4585-b0fc-93c37123e250 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:45.389491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b3e73256-5c59-4585-b0fc-93c37123e250 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:45.395166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3e73256-5c59-4585-b0fc-93c37123e250 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:45.395612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3e73256-5c59-4585-b0fc-93c37123e250 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:45.396364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3e73256-5c59-4585-b0fc-93c37123e250 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:45.396825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3e73256-5c59-4585-b0fc-93c37123e250 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:45.424942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b3e73256-5c59-4585-b0fc-93c37123e250 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040948 Jul 27 22:59:45.425412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 938/1807] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:45 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:46.359635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-da3bd080-70bc-4194-bb27-b4ad38ae6c69 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:46.360292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-da3bd080-70bc-4194-bb27-b4ad38ae6c69 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:46.366811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da3bd080-70bc-4194-bb27-b4ad38ae6c69 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:46.367264 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da3bd080-70bc-4194-bb27-b4ad38ae6c69 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:46.368021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da3bd080-70bc-4194-bb27-b4ad38ae6c69 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:46.368455 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da3bd080-70bc-4194-bb27-b4ad38ae6c69 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:46.427605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-da3bd080-70bc-4194-bb27-b4ad38ae6c69 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:46.435030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-da3bd080-70bc-4194-bb27-b4ad38ae6c69 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079230 Jul 27 22:59:46.435582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 939/1808] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:46 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:46.439988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b291b6d4-2c0a-40fb-9ca2-568e760310e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:46.442107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b291b6d4-2c0a-40fb-9ca2-568e760310e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:46.447584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b291b6d4-2c0a-40fb-9ca2-568e760310e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:46.448034 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b291b6d4-2c0a-40fb-9ca2-568e760310e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:46.448882 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b291b6d4-2c0a-40fb-9ca2-568e760310e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:46.449313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b291b6d4-2c0a-40fb-9ca2-568e760310e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:46.476806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b291b6d4-2c0a-40fb-9ca2-568e760310e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040245 Jul 27 22:59:46.477328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 940/1809] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:46 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:46.482470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c9b87739-6ac5-4523-a9d5-1641acc0f16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:46.484460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c9b87739-6ac5-4523-a9d5-1641acc0f16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:46.489865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9b87739-6ac5-4523-a9d5-1641acc0f16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:46.490310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9b87739-6ac5-4523-a9d5-1641acc0f16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:46.491045 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9b87739-6ac5-4523-a9d5-1641acc0f16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:46.491513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9b87739-6ac5-4523-a9d5-1641acc0f16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:46.518661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c9b87739-6ac5-4523-a9d5-1641acc0f16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040340 Jul 27 22:59:46.519197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 941/1810] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:46 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:47.454953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f352f216-6e35-4c31-a89b-d8f5144dd5ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:47.455585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f352f216-6e35-4c31-a89b-d8f5144dd5ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:47.462038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f352f216-6e35-4c31-a89b-d8f5144dd5ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:47.462542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f352f216-6e35-4c31-a89b-d8f5144dd5ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:47.463288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f352f216-6e35-4c31-a89b-d8f5144dd5ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:47.463716 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f352f216-6e35-4c31-a89b-d8f5144dd5ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:47.526874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f352f216-6e35-4c31-a89b-d8f5144dd5ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:47.534308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f352f216-6e35-4c31-a89b-d8f5144dd5ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083305 Jul 27 22:59:47.534852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 942/1811] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:47 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:47.539461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d35c65fb-8b0a-4d9d-beb4-5ddd928d6838 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:47.542165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d35c65fb-8b0a-4d9d-beb4-5ddd928d6838 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:47.547616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d35c65fb-8b0a-4d9d-beb4-5ddd928d6838 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:47.548060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d35c65fb-8b0a-4d9d-beb4-5ddd928d6838 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:47.548828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d35c65fb-8b0a-4d9d-beb4-5ddd928d6838 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:47.549253 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d35c65fb-8b0a-4d9d-beb4-5ddd928d6838 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:47.577663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d35c65fb-8b0a-4d9d-beb4-5ddd928d6838 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041810 Jul 27 22:59:47.578192 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 943/1812] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:47 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:47.582598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-33814c11-7a98-4b43-8243-c6ef8f82dac2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:47.584640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-33814c11-7a98-4b43-8243-c6ef8f82dac2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:47.590186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33814c11-7a98-4b43-8243-c6ef8f82dac2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:47.590635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33814c11-7a98-4b43-8243-c6ef8f82dac2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:47.591387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33814c11-7a98-4b43-8243-c6ef8f82dac2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:47.591821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33814c11-7a98-4b43-8243-c6ef8f82dac2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:47.595385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:47.621316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-33814c11-7a98-4b43-8243-c6ef8f82dac2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042190 Jul 27 22:59:47.621852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 944/1813] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:47 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:48.555191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-47d6bd96-4896-40d9-be69-c3fdf5d35486 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:48.555834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-47d6bd96-4896-40d9-be69-c3fdf5d35486 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:48.562251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-47d6bd96-4896-40d9-be69-c3fdf5d35486 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:48.562689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-47d6bd96-4896-40d9-be69-c3fdf5d35486 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:48.563437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-47d6bd96-4896-40d9-be69-c3fdf5d35486 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:48.563865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-47d6bd96-4896-40d9-be69-c3fdf5d35486 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:48.623510 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-47d6bd96-4896-40d9-be69-c3fdf5d35486 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:48.631259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-47d6bd96-4896-40d9-be69-c3fdf5d35486 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079880 Jul 27 22:59:48.631817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 945/1814] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:48 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:48.636386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-77ab6454-38a0-4de8-b332-baffce2a8898 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:48.638525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-77ab6454-38a0-4de8-b332-baffce2a8898 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:48.644198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-77ab6454-38a0-4de8-b332-baffce2a8898 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:48.644681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-77ab6454-38a0-4de8-b332-baffce2a8898 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:48.645443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-77ab6454-38a0-4de8-b332-baffce2a8898 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:48.645877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-77ab6454-38a0-4de8-b332-baffce2a8898 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:48.674846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-77ab6454-38a0-4de8-b332-baffce2a8898 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042045 Jul 27 22:59:48.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 946/1815] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:48 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:48.679760 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-447e94a4-c126-495a-8835-a9cb13cacb0d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:48.681828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-447e94a4-c126-495a-8835-a9cb13cacb0d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:48.687247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-447e94a4-c126-495a-8835-a9cb13cacb0d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:48.687693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-447e94a4-c126-495a-8835-a9cb13cacb0d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:48.688439 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-447e94a4-c126-495a-8835-a9cb13cacb0d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:48.688976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-447e94a4-c126-495a-8835-a9cb13cacb0d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:48.717241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-447e94a4-c126-495a-8835-a9cb13cacb0d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040912 Jul 27 22:59:48.717779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 947/1816] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:48 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:49.652071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ed48c62f-eb81-4f9c-9149-3f84b60b56e0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:49.652703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ed48c62f-eb81-4f9c-9149-3f84b60b56e0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:49.659191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed48c62f-eb81-4f9c-9149-3f84b60b56e0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:49.659632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed48c62f-eb81-4f9c-9149-3f84b60b56e0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:49.660416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed48c62f-eb81-4f9c-9149-3f84b60b56e0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:49.660884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed48c62f-eb81-4f9c-9149-3f84b60b56e0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:49.720874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ed48c62f-eb81-4f9c-9149-3f84b60b56e0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:49.728944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ed48c62f-eb81-4f9c-9149-3f84b60b56e0 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080869 Jul 27 22:59:49.729518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 948/1817] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:49 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:49.734107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-41abcae7-d413-42f7-9166-02dabed4077c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:49.736221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-41abcae7-d413-42f7-9166-02dabed4077c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:49.742203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-41abcae7-d413-42f7-9166-02dabed4077c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:49.742641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-41abcae7-d413-42f7-9166-02dabed4077c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:49.743421 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-41abcae7-d413-42f7-9166-02dabed4077c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:49.743847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-41abcae7-d413-42f7-9166-02dabed4077c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:49.771653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-41abcae7-d413-42f7-9166-02dabed4077c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041195 Jul 27 22:59:49.772186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 949/1818] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:49 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:49.777133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1adbc6ec-7b2f-4286-a3b7-d9f814eaa121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:49.779153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1adbc6ec-7b2f-4286-a3b7-d9f814eaa121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:49.784578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1adbc6ec-7b2f-4286-a3b7-d9f814eaa121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:49.785018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1adbc6ec-7b2f-4286-a3b7-d9f814eaa121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:49.785760 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1adbc6ec-7b2f-4286-a3b7-d9f814eaa121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:49.786187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1adbc6ec-7b2f-4286-a3b7-d9f814eaa121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:49.813099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1adbc6ec-7b2f-4286-a3b7-d9f814eaa121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039975 Jul 27 22:59:49.813622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 950/1819] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:49 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:50.749546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2ad2b47c-3005-4a16-ac5c-973e7a7a8874 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:50.750895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2ad2b47c-3005-4a16-ac5c-973e7a7a8874 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:50.757466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2ad2b47c-3005-4a16-ac5c-973e7a7a8874 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:50.757912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2ad2b47c-3005-4a16-ac5c-973e7a7a8874 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:50.758663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2ad2b47c-3005-4a16-ac5c-973e7a7a8874 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:50.759087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2ad2b47c-3005-4a16-ac5c-973e7a7a8874 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:50.820072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2ad2b47c-3005-4a16-ac5c-973e7a7a8874 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:50.827258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2ad2b47c-3005-4a16-ac5c-973e7a7a8874 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081609 Jul 27 22:59:50.827797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 951/1820] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:50 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:50.832170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-947407b7-7d16-46c3-bb4d-58557a69cad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:50.834302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-947407b7-7d16-46c3-bb4d-58557a69cad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:50.840320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-947407b7-7d16-46c3-bb4d-58557a69cad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:50.840797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-947407b7-7d16-46c3-bb4d-58557a69cad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:50.841533 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-947407b7-7d16-46c3-bb4d-58557a69cad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:50.841958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-947407b7-7d16-46c3-bb4d-58557a69cad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:50.869627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-947407b7-7d16-46c3-bb4d-58557a69cad0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040886 Jul 27 22:59:50.870155 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 952/1821] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:50.874409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-38256734-3545-468d-82e0-27bd4f819094 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:50.876414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-38256734-3545-468d-82e0-27bd4f819094 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:50.881828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-38256734-3545-468d-82e0-27bd4f819094 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:50.882267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-38256734-3545-468d-82e0-27bd4f819094 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:50.883000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-38256734-3545-468d-82e0-27bd4f819094 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:50.883428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-38256734-3545-468d-82e0-27bd4f819094 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:50.913107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-38256734-3545-468d-82e0-27bd4f819094 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041997 Jul 27 22:59:50.913648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 953/1822] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:50 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:51.848057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ebc8d950-f110-46b3-ae76-5bd3ddac34d1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:51.848712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ebc8d950-f110-46b3-ae76-5bd3ddac34d1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:51.855477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebc8d950-f110-46b3-ae76-5bd3ddac34d1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:51.855915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebc8d950-f110-46b3-ae76-5bd3ddac34d1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:51.856750 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebc8d950-f110-46b3-ae76-5bd3ddac34d1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:51.857183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebc8d950-f110-46b3-ae76-5bd3ddac34d1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:51.920452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ebc8d950-f110-46b3-ae76-5bd3ddac34d1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:51.928117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ebc8d950-f110-46b3-ae76-5bd3ddac34d1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083864 Jul 27 22:59:51.928692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 954/1823] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:51 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:51.933830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-64816cbc-bd14-4d0e-9cd8-d35905f9e89c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:51.935917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-64816cbc-bd14-4d0e-9cd8-d35905f9e89c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:51.941597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64816cbc-bd14-4d0e-9cd8-d35905f9e89c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:51.942073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64816cbc-bd14-4d0e-9cd8-d35905f9e89c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:51.942863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64816cbc-bd14-4d0e-9cd8-d35905f9e89c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:51.943293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-64816cbc-bd14-4d0e-9cd8-d35905f9e89c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:51.970829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-64816cbc-bd14-4d0e-9cd8-d35905f9e89c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041188 Jul 27 22:59:51.971362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 955/1824] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:51 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:51.975853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9f4a9a8a-f6a5-448b-8340-f4195228f2dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:51.978365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9f4a9a8a-f6a5-448b-8340-f4195228f2dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:51.984043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f4a9a8a-f6a5-448b-8340-f4195228f2dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:51.984486 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f4a9a8a-f6a5-448b-8340-f4195228f2dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:51.985260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f4a9a8a-f6a5-448b-8340-f4195228f2dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:51.985689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f4a9a8a-f6a5-448b-8340-f4195228f2dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:52.013370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9f4a9a8a-f6a5-448b-8340-f4195228f2dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041078 Jul 27 22:59:52.013916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 956/1825] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:51 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:52.949825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6465abc1-021d-4960-8995-8938a654dd89 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:52.950471 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6465abc1-021d-4960-8995-8938a654dd89 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:52.957136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6465abc1-021d-4960-8995-8938a654dd89 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:52.957712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6465abc1-021d-4960-8995-8938a654dd89 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:52.958470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6465abc1-021d-4960-8995-8938a654dd89 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:52.958902 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6465abc1-021d-4960-8995-8938a654dd89 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:53.018748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6465abc1-021d-4960-8995-8938a654dd89 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:53.026782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6465abc1-021d-4960-8995-8938a654dd89 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081311 Jul 27 22:59:53.027335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 957/1826] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:52 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:53.031733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a7b424a4-252e-42ca-a84b-d47ea87cc914 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:53.033854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a7b424a4-252e-42ca-a84b-d47ea87cc914 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:53.039322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a7b424a4-252e-42ca-a84b-d47ea87cc914 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:53.039761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a7b424a4-252e-42ca-a84b-d47ea87cc914 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:53.040542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a7b424a4-252e-42ca-a84b-d47ea87cc914 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:53.040995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a7b424a4-252e-42ca-a84b-d47ea87cc914 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:53.068803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a7b424a4-252e-42ca-a84b-d47ea87cc914 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040455 Jul 27 22:59:53.069379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 958/1827] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:53 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:53.074548 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d2bcb50a-c667-4084-a709-2140c699c2e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:53.076653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d2bcb50a-c667-4084-a709-2140c699c2e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:53.082501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2bcb50a-c667-4084-a709-2140c699c2e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:53.082943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2bcb50a-c667-4084-a709-2140c699c2e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:53.083695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2bcb50a-c667-4084-a709-2140c699c2e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:53.084130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2bcb50a-c667-4084-a709-2140c699c2e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:53.111541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d2bcb50a-c667-4084-a709-2140c699c2e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041201 Jul 27 22:59:53.112108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 959/1828] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:53 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:54.047220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-83972b24-1c26-4a2f-a5c4-68438a83ca2e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:54.047849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-83972b24-1c26-4a2f-a5c4-68438a83ca2e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:54.054290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-83972b24-1c26-4a2f-a5c4-68438a83ca2e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:54.054740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-83972b24-1c26-4a2f-a5c4-68438a83ca2e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:54.055476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-83972b24-1c26-4a2f-a5c4-68438a83ca2e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:54.056428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-83972b24-1c26-4a2f-a5c4-68438a83ca2e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:54.115622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-83972b24-1c26-4a2f-a5c4-68438a83ca2e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:54.119433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:54.124181 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-83972b24-1c26-4a2f-a5c4-68438a83ca2e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080829 Jul 27 22:59:54.124765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 960/1829] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:54 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:54.129154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-33ea0a5f-b402-480a-ae3f-5e5d71b71457 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:54.131244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-33ea0a5f-b402-480a-ae3f-5e5d71b71457 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:54.137993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33ea0a5f-b402-480a-ae3f-5e5d71b71457 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:54.138432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33ea0a5f-b402-480a-ae3f-5e5d71b71457 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:54.139186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33ea0a5f-b402-480a-ae3f-5e5d71b71457 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:54.139617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33ea0a5f-b402-480a-ae3f-5e5d71b71457 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:54.168811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-33ea0a5f-b402-480a-ae3f-5e5d71b71457 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042902 Jul 27 22:59:54.169660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 961/1830] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:54 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:54.174167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-faa751d9-bd7c-441e-80ff-faec65cd3a20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:54.176629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-faa751d9-bd7c-441e-80ff-faec65cd3a20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:54.183017 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-faa751d9-bd7c-441e-80ff-faec65cd3a20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:54.183460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-faa751d9-bd7c-441e-80ff-faec65cd3a20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:54.184211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-faa751d9-bd7c-441e-80ff-faec65cd3a20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:54.184671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-faa751d9-bd7c-441e-80ff-faec65cd3a20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:54.212418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-faa751d9-bd7c-441e-80ff-faec65cd3a20 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042016 Jul 27 22:59:54.212990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 962/1831] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:54 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:55.145627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1b936a23-02f4-423d-9741-51376b2f03d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:55.146364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1b936a23-02f4-423d-9741-51376b2f03d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:55.152985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1b936a23-02f4-423d-9741-51376b2f03d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:55.153436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1b936a23-02f4-423d-9741-51376b2f03d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:55.154343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1b936a23-02f4-423d-9741-51376b2f03d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:55.154960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1b936a23-02f4-423d-9741-51376b2f03d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:55.219630 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1b936a23-02f4-423d-9741-51376b2f03d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:55.226206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1b936a23-02f4-423d-9741-51376b2f03d6 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084705 Jul 27 22:59:55.227036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 963/1832] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:55 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:55.232513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5d89ae71-3e37-459d-9294-0a06a2b63a90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:55.234650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5d89ae71-3e37-459d-9294-0a06a2b63a90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:55.240482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d89ae71-3e37-459d-9294-0a06a2b63a90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:55.240963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d89ae71-3e37-459d-9294-0a06a2b63a90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:55.241710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d89ae71-3e37-459d-9294-0a06a2b63a90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:55.242137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d89ae71-3e37-459d-9294-0a06a2b63a90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:55.274296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5d89ae71-3e37-459d-9294-0a06a2b63a90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045618 Jul 27 22:59:55.275397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 964/1833] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:55 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:55.283313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0c8232cc-830c-4e87-8631-0dcbb3305e81 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:55.285435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0c8232cc-830c-4e87-8631-0dcbb3305e81 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:55.292599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c8232cc-830c-4e87-8631-0dcbb3305e81 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:55.293048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c8232cc-830c-4e87-8631-0dcbb3305e81 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:55.293817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c8232cc-830c-4e87-8631-0dcbb3305e81 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:55.294275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c8232cc-830c-4e87-8631-0dcbb3305e81 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:55.325602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0c8232cc-830c-4e87-8631-0dcbb3305e81 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049195 Jul 27 22:59:55.326158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 965/1834] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:55 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:56.247617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dda1d919-5f25-4425-b2d4-df51dc8044c3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:56.248213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dda1d919-5f25-4425-b2d4-df51dc8044c3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:56.254762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dda1d919-5f25-4425-b2d4-df51dc8044c3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:56.255206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dda1d919-5f25-4425-b2d4-df51dc8044c3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:56.255961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dda1d919-5f25-4425-b2d4-df51dc8044c3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:56.256396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dda1d919-5f25-4425-b2d4-df51dc8044c3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:56.324595 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dda1d919-5f25-4425-b2d4-df51dc8044c3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:56.332184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dda1d919-5f25-4425-b2d4-df51dc8044c3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.088899 Jul 27 22:59:56.333037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 966/1835] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:56 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:56.337526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-af4c01e1-5b5d-4008-8ea3-2ef2f3089648 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:56.339624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-af4c01e1-5b5d-4008-8ea3-2ef2f3089648 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:56.345530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-af4c01e1-5b5d-4008-8ea3-2ef2f3089648 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:56.345972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-af4c01e1-5b5d-4008-8ea3-2ef2f3089648 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:56.346732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-af4c01e1-5b5d-4008-8ea3-2ef2f3089648 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:56.347143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-af4c01e1-5b5d-4008-8ea3-2ef2f3089648 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:56.375414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-af4c01e1-5b5d-4008-8ea3-2ef2f3089648 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041524 Jul 27 22:59:56.375981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 967/1836] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:56 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:56.380464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-82da7973-eabd-43d9-a8d4-0d3480336905 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:56.382547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-82da7973-eabd-43d9-a8d4-0d3480336905 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:56.388684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82da7973-eabd-43d9-a8d4-0d3480336905 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:56.389130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82da7973-eabd-43d9-a8d4-0d3480336905 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:56.389867 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82da7973-eabd-43d9-a8d4-0d3480336905 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:56.390291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82da7973-eabd-43d9-a8d4-0d3480336905 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:56.418055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-82da7973-eabd-43d9-a8d4-0d3480336905 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041134 Jul 27 22:59:56.418584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 968/1837] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:56 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:57.352480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-931b0a6a-b244-4067-8037-efab09722f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:57.353934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-931b0a6a-b244-4067-8037-efab09722f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:57.360238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-931b0a6a-b244-4067-8037-efab09722f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:57.360715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-931b0a6a-b244-4067-8037-efab09722f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:57.361468 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-931b0a6a-b244-4067-8037-efab09722f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:57.361893 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-931b0a6a-b244-4067-8037-efab09722f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:57.422110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-931b0a6a-b244-4067-8037-efab09722f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:57.429847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-931b0a6a-b244-4067-8037-efab09722f4c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081176 Jul 27 22:59:57.430408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 969/1838] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:57 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:57.435477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c2ff3c4c-878b-4b97-815c-4dc446b9ec67 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:57.437594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c2ff3c4c-878b-4b97-815c-4dc446b9ec67 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:57.443584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c2ff3c4c-878b-4b97-815c-4dc446b9ec67 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:57.444031 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c2ff3c4c-878b-4b97-815c-4dc446b9ec67 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:57.444821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c2ff3c4c-878b-4b97-815c-4dc446b9ec67 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:57.445262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c2ff3c4c-878b-4b97-815c-4dc446b9ec67 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:57.472300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c2ff3c4c-878b-4b97-815c-4dc446b9ec67 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040382 Jul 27 22:59:57.472874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 970/1839] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:57 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:57.477205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2b99e9a4-8d06-4c11-94e7-e983e6295899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:57.480055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2b99e9a4-8d06-4c11-94e7-e983e6295899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:57.485609 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b99e9a4-8d06-4c11-94e7-e983e6295899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:57.486054 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b99e9a4-8d06-4c11-94e7-e983e6295899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:57.486804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b99e9a4-8d06-4c11-94e7-e983e6295899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:57.487236 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b99e9a4-8d06-4c11-94e7-e983e6295899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:57.515029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2b99e9a4-8d06-4c11-94e7-e983e6295899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041214 Jul 27 22:59:57.515566 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 971/1840] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:57 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:58.451078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a6f6fb67-b8ef-48e9-933d-25376090028d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:58.451703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a6f6fb67-b8ef-48e9-933d-25376090028d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:58.458010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a6f6fb67-b8ef-48e9-933d-25376090028d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:58.458451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a6f6fb67-b8ef-48e9-933d-25376090028d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:58.459194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a6f6fb67-b8ef-48e9-933d-25376090028d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:58.459622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a6f6fb67-b8ef-48e9-933d-25376090028d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:58.518995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a6f6fb67-b8ef-48e9-933d-25376090028d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:58.527245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a6f6fb67-b8ef-48e9-933d-25376090028d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080134 Jul 27 22:59:58.527791 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 972/1841] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:58 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 22:59:58.532167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8fa18928-6a36-4fcb-b23c-035046908105 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:58.534294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8fa18928-6a36-4fcb-b23c-035046908105 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:58.539764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8fa18928-6a36-4fcb-b23c-035046908105 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:58.540202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8fa18928-6a36-4fcb-b23c-035046908105 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:58.540984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8fa18928-6a36-4fcb-b23c-035046908105 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:58.542076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8fa18928-6a36-4fcb-b23c-035046908105 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:58.570411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8fa18928-6a36-4fcb-b23c-035046908105 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041657 Jul 27 22:59:58.570986 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 973/1842] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:58 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:58.575293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6f948d1d-c4a1-41a5-9e1f-132d652748a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:58.577690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6f948d1d-c4a1-41a5-9e1f-132d652748a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:58.584540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f948d1d-c4a1-41a5-9e1f-132d652748a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:58.585007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f948d1d-c4a1-41a5-9e1f-132d652748a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:58.585830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f948d1d-c4a1-41a5-9e1f-132d652748a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:58.586253 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f948d1d-c4a1-41a5-9e1f-132d652748a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:58.615414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6f948d1d-c4a1-41a5-9e1f-132d652748a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043537 Jul 27 22:59:58.616186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 974/1843] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:58 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:59.548375 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e4105221-c514-4f09-9e19-3fbe439f0cc8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:59.549041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e4105221-c514-4f09-9e19-3fbe439f0cc8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:59.555444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4105221-c514-4f09-9e19-3fbe439f0cc8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:59.555885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4105221-c514-4f09-9e19-3fbe439f0cc8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:59.556662 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4105221-c514-4f09-9e19-3fbe439f0cc8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:59.557660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4105221-c514-4f09-9e19-3fbe439f0cc8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:59.616752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e4105221-c514-4f09-9e19-3fbe439f0cc8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 22:59:59.624840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e4105221-c514-4f09-9e19-3fbe439f0cc8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080415 Jul 27 22:59:59.625390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 975/1844] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 22:59:59 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 22:59:59.629840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-94fafc4a-aefc-4875-8e93-2a8d14d3d9e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:59.631944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-94fafc4a-aefc-4875-8e93-2a8d14d3d9e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:59.637544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-94fafc4a-aefc-4875-8e93-2a8d14d3d9e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:59.637989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-94fafc4a-aefc-4875-8e93-2a8d14d3d9e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:59.638740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-94fafc4a-aefc-4875-8e93-2a8d14d3d9e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:59.639169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-94fafc4a-aefc-4875-8e93-2a8d14d3d9e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:59.666063 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-94fafc4a-aefc-4875-8e93-2a8d14d3d9e4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039718 Jul 27 22:59:59.667115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 976/1845] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:59 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 22:59:59.671395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b29e1f47-27ec-40cc-8963-0b38b7fd124b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 22:59:59.673448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b29e1f47-27ec-40cc-8963-0b38b7fd124b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 22:59:59.678888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b29e1f47-27ec-40cc-8963-0b38b7fd124b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:59.679332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b29e1f47-27ec-40cc-8963-0b38b7fd124b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:59.680074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b29e1f47-27ec-40cc-8963-0b38b7fd124b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 22:59:59.680505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b29e1f47-27ec-40cc-8963-0b38b7fd124b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 22:59:59.696999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:59.709876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b29e1f47-27ec-40cc-8963-0b38b7fd124b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041851 Jul 27 22:59:59.710420 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 977/1846] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 22:59:59 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:00.645325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-523b296d-c544-4798-b091-c561c2bac531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:00.646043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-523b296d-c544-4798-b091-c561c2bac531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:00.652632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-523b296d-c544-4798-b091-c561c2bac531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:00.653075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-523b296d-c544-4798-b091-c561c2bac531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:00.653822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-523b296d-c544-4798-b091-c561c2bac531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:00.654248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-523b296d-c544-4798-b091-c561c2bac531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:00.715953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-523b296d-c544-4798-b091-c561c2bac531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:00.723399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-523b296d-c544-4798-b091-c561c2bac531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081931 Jul 27 23:00:00.723949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 978/1847] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:00 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:00.728339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fb4f4709-925b-4b5f-b739-ea3a2426aff3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:00.730774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fb4f4709-925b-4b5f-b739-ea3a2426aff3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:00.736380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb4f4709-925b-4b5f-b739-ea3a2426aff3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:00.736851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb4f4709-925b-4b5f-b739-ea3a2426aff3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:00.737598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb4f4709-925b-4b5f-b739-ea3a2426aff3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:00.738023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb4f4709-925b-4b5f-b739-ea3a2426aff3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:00.766069 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fb4f4709-925b-4b5f-b739-ea3a2426aff3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041182 Jul 27 23:00:00.766594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 979/1848] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:00 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:00.770844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-176753f9-aa99-446e-96c5-e135e563bc6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:00.772879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-176753f9-aa99-446e-96c5-e135e563bc6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:00.778296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-176753f9-aa99-446e-96c5-e135e563bc6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:00.778731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-176753f9-aa99-446e-96c5-e135e563bc6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:00.779465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-176753f9-aa99-446e-96c5-e135e563bc6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:00.779890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-176753f9-aa99-446e-96c5-e135e563bc6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:00.807451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-176753f9-aa99-446e-96c5-e135e563bc6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039408 Jul 27 23:00:00.807966 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 980/1849] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:00 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:01.743625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c8347e45-2891-49ef-bc6e-a2e86dacd75d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:01.744232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c8347e45-2891-49ef-bc6e-a2e86dacd75d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:01.750679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8347e45-2891-49ef-bc6e-a2e86dacd75d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:01.751117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8347e45-2891-49ef-bc6e-a2e86dacd75d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:01.751860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8347e45-2891-49ef-bc6e-a2e86dacd75d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:01.752285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8347e45-2891-49ef-bc6e-a2e86dacd75d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:01.812485 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c8347e45-2891-49ef-bc6e-a2e86dacd75d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:01.820301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c8347e45-2891-49ef-bc6e-a2e86dacd75d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080525 Jul 27 23:00:01.820907 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 981/1850] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:01 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:01.826072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6e6187c6-d016-40ce-a22e-ea5db43a8176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:01.828213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6e6187c6-d016-40ce-a22e-ea5db43a8176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:01.834403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e6187c6-d016-40ce-a22e-ea5db43a8176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:01.834850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e6187c6-d016-40ce-a22e-ea5db43a8176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:01.835621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e6187c6-d016-40ce-a22e-ea5db43a8176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:01.836058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e6187c6-d016-40ce-a22e-ea5db43a8176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:01.868647 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6e6187c6-d016-40ce-a22e-ea5db43a8176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046669 Jul 27 23:00:01.869222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 982/1851] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:01 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:01.873904 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dfe28deb-0904-46f8-9a28-51f2d89719f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:01.876022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dfe28deb-0904-46f8-9a28-51f2d89719f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:01.877808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:00:01.883939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfe28deb-0904-46f8-9a28-51f2d89719f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:01.884386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfe28deb-0904-46f8-9a28-51f2d89719f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:01.885694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfe28deb-0904-46f8-9a28-51f2d89719f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:01.886138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dfe28deb-0904-46f8-9a28-51f2d89719f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:01.919496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dfe28deb-0904-46f8-9a28-51f2d89719f3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049228 Jul 27 23:00:01.920067 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 983/1852] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:01 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:02.846635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-07fe4037-08c8-4822-894d-ab89a2f8426b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:02.847309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-07fe4037-08c8-4822-894d-ab89a2f8426b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:02.854495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07fe4037-08c8-4822-894d-ab89a2f8426b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:02.854936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07fe4037-08c8-4822-894d-ab89a2f8426b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:02.855684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07fe4037-08c8-4822-894d-ab89a2f8426b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:02.856131 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-07fe4037-08c8-4822-894d-ab89a2f8426b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:02.915154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-07fe4037-08c8-4822-894d-ab89a2f8426b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:02.923111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-07fe4037-08c8-4822-894d-ab89a2f8426b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080373 Jul 27 23:00:02.923657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 984/1853] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:02 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:02.928064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2b8a8d78-ed61-4dd0-bfa6-f507b5a8f2fe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:02.930179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2b8a8d78-ed61-4dd0-bfa6-f507b5a8f2fe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:02.935874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b8a8d78-ed61-4dd0-bfa6-f507b5a8f2fe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:02.936313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b8a8d78-ed61-4dd0-bfa6-f507b5a8f2fe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:02.937088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b8a8d78-ed61-4dd0-bfa6-f507b5a8f2fe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:02.937514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b8a8d78-ed61-4dd0-bfa6-f507b5a8f2fe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:02.964911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2b8a8d78-ed61-4dd0-bfa6-f507b5a8f2fe tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040266 Jul 27 23:00:02.965443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 985/1854] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:02 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:02.969745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b2ce1f25-ed3c-4c0d-9dc6-6745802fba82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:02.971763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b2ce1f25-ed3c-4c0d-9dc6-6745802fba82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:02.977246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2ce1f25-ed3c-4c0d-9dc6-6745802fba82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:02.977683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2ce1f25-ed3c-4c0d-9dc6-6745802fba82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:02.978423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2ce1f25-ed3c-4c0d-9dc6-6745802fba82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:02.979757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2ce1f25-ed3c-4c0d-9dc6-6745802fba82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:03.007147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b2ce1f25-ed3c-4c0d-9dc6-6745802fba82 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040740 Jul 27 23:00:03.007702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 986/1855] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:02 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:03.944803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ced37f61-9bab-41c2-b6e6-3db69e0ac22e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:03.945538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ced37f61-9bab-41c2-b6e6-3db69e0ac22e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:03.952663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ced37f61-9bab-41c2-b6e6-3db69e0ac22e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:03.953101 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ced37f61-9bab-41c2-b6e6-3db69e0ac22e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:03.953854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ced37f61-9bab-41c2-b6e6-3db69e0ac22e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:03.954279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ced37f61-9bab-41c2-b6e6-3db69e0ac22e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:04.014255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ced37f61-9bab-41c2-b6e6-3db69e0ac22e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:04.021717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ced37f61-9bab-41c2-b6e6-3db69e0ac22e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080913 Jul 27 23:00:04.022428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 987/1856] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:03 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:04.027368 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-451bd182-dd39-488c-9387-0852ff44426c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:04.029493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-451bd182-dd39-488c-9387-0852ff44426c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:04.035029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-451bd182-dd39-488c-9387-0852ff44426c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:04.035467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-451bd182-dd39-488c-9387-0852ff44426c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:04.036215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-451bd182-dd39-488c-9387-0852ff44426c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:04.036665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-451bd182-dd39-488c-9387-0852ff44426c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:04.063285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-451bd182-dd39-488c-9387-0852ff44426c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039977 Jul 27 23:00:04.063809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 988/1857] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:04 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:04.068168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-15c947d5-d415-40bf-860e-891b37706750 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:04.070194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-15c947d5-d415-40bf-860e-891b37706750 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:04.076096 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15c947d5-d415-40bf-860e-891b37706750 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:04.076535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15c947d5-d415-40bf-860e-891b37706750 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:04.077298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15c947d5-d415-40bf-860e-891b37706750 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:04.077720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15c947d5-d415-40bf-860e-891b37706750 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:04.107025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-15c947d5-d415-40bf-860e-891b37706750 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042262 Jul 27 23:00:04.107566 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 989/1858] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:04 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:05.043430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7de126e3-0ea0-4107-a1c3-3cb9f375c7bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:05.044094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7de126e3-0ea0-4107-a1c3-3cb9f375c7bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:05.050555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7de126e3-0ea0-4107-a1c3-3cb9f375c7bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:05.050996 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7de126e3-0ea0-4107-a1c3-3cb9f375c7bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:05.051744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7de126e3-0ea0-4107-a1c3-3cb9f375c7bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:05.052173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7de126e3-0ea0-4107-a1c3-3cb9f375c7bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:05.114826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7de126e3-0ea0-4107-a1c3-3cb9f375c7bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:05.122349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7de126e3-0ea0-4107-a1c3-3cb9f375c7bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083330 Jul 27 23:00:05.122904 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 990/1859] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:05 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:05.127305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a2b12c0b-d645-4109-bf32-e105178c8a9b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:05.129447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a2b12c0b-d645-4109-bf32-e105178c8a9b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:05.134993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2b12c0b-d645-4109-bf32-e105178c8a9b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:05.135452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2b12c0b-d645-4109-bf32-e105178c8a9b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:05.136218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2b12c0b-d645-4109-bf32-e105178c8a9b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:05.136679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2b12c0b-d645-4109-bf32-e105178c8a9b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:05.167347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a2b12c0b-d645-4109-bf32-e105178c8a9b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042797 Jul 27 23:00:05.167908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 991/1860] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:05 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:05.172324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d83b4f85-dc9f-4723-aa4d-e2d22d34a315 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:05.174426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d83b4f85-dc9f-4723-aa4d-e2d22d34a315 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:05.180071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d83b4f85-dc9f-4723-aa4d-e2d22d34a315 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:05.180523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d83b4f85-dc9f-4723-aa4d-e2d22d34a315 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:05.181306 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d83b4f85-dc9f-4723-aa4d-e2d22d34a315 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:05.181743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d83b4f85-dc9f-4723-aa4d-e2d22d34a315 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:05.212531 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d83b4f85-dc9f-4723-aa4d-e2d22d34a315 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043645 Jul 27 23:00:05.213094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 992/1861] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:05 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:06.143074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-de9aef5a-429b-4bda-b63a-1c8815ecd204 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:06.143692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-de9aef5a-429b-4bda-b63a-1c8815ecd204 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:06.150143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de9aef5a-429b-4bda-b63a-1c8815ecd204 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:06.150580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de9aef5a-429b-4bda-b63a-1c8815ecd204 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:06.151332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de9aef5a-429b-4bda-b63a-1c8815ecd204 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:06.151761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de9aef5a-429b-4bda-b63a-1c8815ecd204 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:06.211135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-de9aef5a-429b-4bda-b63a-1c8815ecd204 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:06.218434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-de9aef5a-429b-4bda-b63a-1c8815ecd204 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079259 Jul 27 23:00:06.220385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 993/1862] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:06 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:06.225210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-03a87cb0-e165-4cc3-9406-3a9c13f7c0bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:06.227332 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-03a87cb0-e165-4cc3-9406-3a9c13f7c0bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:06.233757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-03a87cb0-e165-4cc3-9406-3a9c13f7c0bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:06.234193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-03a87cb0-e165-4cc3-9406-3a9c13f7c0bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:06.234934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-03a87cb0-e165-4cc3-9406-3a9c13f7c0bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:06.235360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-03a87cb0-e165-4cc3-9406-3a9c13f7c0bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:06.238847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:00:06.264592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-03a87cb0-e165-4cc3-9406-3a9c13f7c0bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043146 Jul 27 23:00:06.265131 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 994/1863] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:06 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:06.269457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4062de76-a0e8-494a-9203-fa201a041eac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:06.271500 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4062de76-a0e8-494a-9203-fa201a041eac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:06.277011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4062de76-a0e8-494a-9203-fa201a041eac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:06.277447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4062de76-a0e8-494a-9203-fa201a041eac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:06.278188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4062de76-a0e8-494a-9203-fa201a041eac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:06.278615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4062de76-a0e8-494a-9203-fa201a041eac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:06.306662 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4062de76-a0e8-494a-9203-fa201a041eac tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040591 Jul 27 23:00:06.307764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 995/1864] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:06 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:07.241129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9442f81c-49fe-4c87-af93-0d2c6811f131 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:07.241734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9442f81c-49fe-4c87-af93-0d2c6811f131 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:07.248834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9442f81c-49fe-4c87-af93-0d2c6811f131 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:07.249273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9442f81c-49fe-4c87-af93-0d2c6811f131 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:07.250016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9442f81c-49fe-4c87-af93-0d2c6811f131 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:07.250443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9442f81c-49fe-4c87-af93-0d2c6811f131 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:07.312061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9442f81c-49fe-4c87-af93-0d2c6811f131 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:07.319517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9442f81c-49fe-4c87-af93-0d2c6811f131 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082202 Jul 27 23:00:07.320065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 996/1865] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:07 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:07.324495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6e2198bb-7b1b-4449-b708-86b2d4aff138 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:07.326620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6e2198bb-7b1b-4449-b708-86b2d4aff138 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:07.334426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e2198bb-7b1b-4449-b708-86b2d4aff138 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:07.335222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e2198bb-7b1b-4449-b708-86b2d4aff138 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:07.336582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e2198bb-7b1b-4449-b708-86b2d4aff138 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:07.337370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e2198bb-7b1b-4449-b708-86b2d4aff138 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:07.367922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6e2198bb-7b1b-4449-b708-86b2d4aff138 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046877 Jul 27 23:00:07.368462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 997/1866] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:07 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:07.372955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-820a0426-3893-45c1-be7d-e5d1865c8af2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:07.375010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-820a0426-3893-45c1-be7d-e5d1865c8af2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:07.380481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-820a0426-3893-45c1-be7d-e5d1865c8af2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:07.380949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-820a0426-3893-45c1-be7d-e5d1865c8af2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:07.381695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-820a0426-3893-45c1-be7d-e5d1865c8af2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:07.382120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-820a0426-3893-45c1-be7d-e5d1865c8af2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:07.410494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-820a0426-3893-45c1-be7d-e5d1865c8af2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040514 Jul 27 23:00:07.410667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 998/1867] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:07 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:08.340295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4ff94d86-684f-4791-989e-095237041037 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:08.340946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4ff94d86-684f-4791-989e-095237041037 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:08.347570 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ff94d86-684f-4791-989e-095237041037 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:08.348015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ff94d86-684f-4791-989e-095237041037 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:08.348802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ff94d86-684f-4791-989e-095237041037 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:08.349236 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4ff94d86-684f-4791-989e-095237041037 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:08.409282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4ff94d86-684f-4791-989e-095237041037 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:08.417180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4ff94d86-684f-4791-989e-095237041037 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080645 Jul 27 23:00:08.417825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 999/1868] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:08 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:08.422407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8ec0e3ea-d7d6-4c61-a818-5d0f0f3f541e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:08.424510 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8ec0e3ea-d7d6-4c61-a818-5d0f0f3f541e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:08.430064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8ec0e3ea-d7d6-4c61-a818-5d0f0f3f541e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:08.430506 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8ec0e3ea-d7d6-4c61-a818-5d0f0f3f541e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:08.431260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8ec0e3ea-d7d6-4c61-a818-5d0f0f3f541e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:08.431690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8ec0e3ea-d7d6-4c61-a818-5d0f0f3f541e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:08.459276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8ec0e3ea-d7d6-4c61-a818-5d0f0f3f541e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040441 Jul 27 23:00:08.459808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1000/1869] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:08 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:08.464271 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-98efb3f7-e38d-4de2-bbc3-ecfe5c2af359 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:08.466379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-98efb3f7-e38d-4de2-bbc3-ecfe5c2af359 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:08.471820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98efb3f7-e38d-4de2-bbc3-ecfe5c2af359 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:08.472266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98efb3f7-e38d-4de2-bbc3-ecfe5c2af359 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:08.473057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98efb3f7-e38d-4de2-bbc3-ecfe5c2af359 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:08.473494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98efb3f7-e38d-4de2-bbc3-ecfe5c2af359 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:08.503449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-98efb3f7-e38d-4de2-bbc3-ecfe5c2af359 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042607 Jul 27 23:00:08.503999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1001/1870] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:08 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:09.438550 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3cc1a715-7eda-49a9-9665-6baa980f6015 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:09.439225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3cc1a715-7eda-49a9-9665-6baa980f6015 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:09.445677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3cc1a715-7eda-49a9-9665-6baa980f6015 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:09.446122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3cc1a715-7eda-49a9-9665-6baa980f6015 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:09.446880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3cc1a715-7eda-49a9-9665-6baa980f6015 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:09.447313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3cc1a715-7eda-49a9-9665-6baa980f6015 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:09.510211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3cc1a715-7eda-49a9-9665-6baa980f6015 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:09.517481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3cc1a715-7eda-49a9-9665-6baa980f6015 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082964 Jul 27 23:00:09.518062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1002/1871] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:09 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:09.522472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d482729f-98df-4ed7-aa1d-5f6b8f0380ff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:09.524588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d482729f-98df-4ed7-aa1d-5f6b8f0380ff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:09.530671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d482729f-98df-4ed7-aa1d-5f6b8f0380ff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:09.531116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d482729f-98df-4ed7-aa1d-5f6b8f0380ff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:09.531872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d482729f-98df-4ed7-aa1d-5f6b8f0380ff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:09.532304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d482729f-98df-4ed7-aa1d-5f6b8f0380ff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:09.560402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d482729f-98df-4ed7-aa1d-5f6b8f0380ff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041357 Jul 27 23:00:09.560983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1003/1872] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:09 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:09.565337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-52ced245-7d36-4425-a5c7-090ae491d94f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:09.567377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-52ced245-7d36-4425-a5c7-090ae491d94f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:09.572963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52ced245-7d36-4425-a5c7-090ae491d94f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:09.573404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52ced245-7d36-4425-a5c7-090ae491d94f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:09.574151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52ced245-7d36-4425-a5c7-090ae491d94f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:09.574584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52ced245-7d36-4425-a5c7-090ae491d94f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:09.602521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-52ced245-7d36-4425-a5c7-090ae491d94f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040594 Jul 27 23:00:09.603064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1004/1873] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:09 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:10.538834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-73b37766-0fa4-4667-ae76-371064293873 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:10.539451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-73b37766-0fa4-4667-ae76-371064293873 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:10.546560 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73b37766-0fa4-4667-ae76-371064293873 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:10.547031 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73b37766-0fa4-4667-ae76-371064293873 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:10.547787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73b37766-0fa4-4667-ae76-371064293873 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:10.548219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73b37766-0fa4-4667-ae76-371064293873 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:10.611788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-73b37766-0fa4-4667-ae76-371064293873 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:10.619244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-73b37766-0fa4-4667-ae76-371064293873 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084314 Jul 27 23:00:10.619792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1005/1874] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:10 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:10.624185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b67eefaf-cf7e-4503-9b4c-62147951e6cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:10.626293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b67eefaf-cf7e-4503-9b4c-62147951e6cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:10.631773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b67eefaf-cf7e-4503-9b4c-62147951e6cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:10.632200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b67eefaf-cf7e-4503-9b4c-62147951e6cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:10.632988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b67eefaf-cf7e-4503-9b4c-62147951e6cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:10.633466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b67eefaf-cf7e-4503-9b4c-62147951e6cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:10.661792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b67eefaf-cf7e-4503-9b4c-62147951e6cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041049 Jul 27 23:00:10.662323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1006/1875] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:10 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:10.666618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9563a4fd-52e0-4556-8835-6e4095f08069 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:10.668733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9563a4fd-52e0-4556-8835-6e4095f08069 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:10.674096 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9563a4fd-52e0-4556-8835-6e4095f08069 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:10.674532 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9563a4fd-52e0-4556-8835-6e4095f08069 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:10.675268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9563a4fd-52e0-4556-8835-6e4095f08069 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:10.675692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9563a4fd-52e0-4556-8835-6e4095f08069 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:10.702999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9563a4fd-52e0-4556-8835-6e4095f08069 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039760 Jul 27 23:00:10.703526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1007/1876] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:10 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:10.956174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.objects.instance [None req-89948f4c-90c3-4599-bd19-026f44fb0e7a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lazy-loading 'services' on Instance uuid b19fab65-5354-4383-ba3a-9eb6614382ff {{(pid=129294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 23:00:11.639579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2bc235a5-85ae-464c-ace0-c056e87d6473 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:11.640219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2bc235a5-85ae-464c-ace0-c056e87d6473 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:11.646868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2bc235a5-85ae-464c-ace0-c056e87d6473 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:11.647313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2bc235a5-85ae-464c-ace0-c056e87d6473 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:11.648105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2bc235a5-85ae-464c-ace0-c056e87d6473 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:11.648541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2bc235a5-85ae-464c-ace0-c056e87d6473 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:11.708581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2bc235a5-85ae-464c-ace0-c056e87d6473 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:11.716724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2bc235a5-85ae-464c-ace0-c056e87d6473 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081475 Jul 27 23:00:11.717288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1008/1877] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:11 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:11.721729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3065084f-2722-4b74-954c-c5cfd1cf0c15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:11.723877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3065084f-2722-4b74-954c-c5cfd1cf0c15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:11.729775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3065084f-2722-4b74-954c-c5cfd1cf0c15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:11.730223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3065084f-2722-4b74-954c-c5cfd1cf0c15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:11.730989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3065084f-2722-4b74-954c-c5cfd1cf0c15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:11.731426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3065084f-2722-4b74-954c-c5cfd1cf0c15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:11.759658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3065084f-2722-4b74-954c-c5cfd1cf0c15 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041395 Jul 27 23:00:11.760891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1009/1878] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:11 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:11.765255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e4232d66-23d4-4dc5-870b-55a3c4f7e89a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:11.767339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e4232d66-23d4-4dc5-870b-55a3c4f7e89a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:11.772840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4232d66-23d4-4dc5-870b-55a3c4f7e89a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:11.773290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4232d66-23d4-4dc5-870b-55a3c4f7e89a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:11.774044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4232d66-23d4-4dc5-870b-55a3c4f7e89a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:11.774482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4232d66-23d4-4dc5-870b-55a3c4f7e89a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:11.797820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:00:11.802419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e4232d66-23d4-4dc5-870b-55a3c4f7e89a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040605 Jul 27 23:00:11.802965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1010/1879] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:11 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:12.738394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-347a1692-ede2-4c87-a07c-65c5c89a99e4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:12.739034 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-347a1692-ede2-4c87-a07c-65c5c89a99e4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:12.745365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-347a1692-ede2-4c87-a07c-65c5c89a99e4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:12.745811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-347a1692-ede2-4c87-a07c-65c5c89a99e4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:12.746578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-347a1692-ede2-4c87-a07c-65c5c89a99e4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:12.747012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-347a1692-ede2-4c87-a07c-65c5c89a99e4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:12.808723 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-347a1692-ede2-4c87-a07c-65c5c89a99e4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:12.816287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-347a1692-ede2-4c87-a07c-65c5c89a99e4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082065 Jul 27 23:00:12.816957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1011/1880] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:12 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:12.821507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-320296e8-0d66-4bc1-8e75-68173c9c0928 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:12.823745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-320296e8-0d66-4bc1-8e75-68173c9c0928 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:12.829598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-320296e8-0d66-4bc1-8e75-68173c9c0928 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:12.830047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-320296e8-0d66-4bc1-8e75-68173c9c0928 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:12.830841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-320296e8-0d66-4bc1-8e75-68173c9c0928 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:12.831275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-320296e8-0d66-4bc1-8e75-68173c9c0928 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:12.861355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-320296e8-0d66-4bc1-8e75-68173c9c0928 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043280 Jul 27 23:00:12.861841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1012/1881] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:12 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:12.866503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-808ae3e2-6ace-4cd3-a538-17b32821b1e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:12.868618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-808ae3e2-6ace-4cd3-a538-17b32821b1e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:12.874471 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-808ae3e2-6ace-4cd3-a538-17b32821b1e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:12.874921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-808ae3e2-6ace-4cd3-a538-17b32821b1e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:12.875690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-808ae3e2-6ace-4cd3-a538-17b32821b1e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:12.876126 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-808ae3e2-6ace-4cd3-a538-17b32821b1e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:12.905598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-808ae3e2-6ace-4cd3-a538-17b32821b1e8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042743 Jul 27 23:00:12.906353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1013/1882] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:12 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:13.836863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-60dcd08a-0147-482c-a2ce-85721d5e479e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:13.837467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-60dcd08a-0147-482c-a2ce-85721d5e479e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:13.843999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-60dcd08a-0147-482c-a2ce-85721d5e479e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:13.844441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-60dcd08a-0147-482c-a2ce-85721d5e479e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:13.845226 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-60dcd08a-0147-482c-a2ce-85721d5e479e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:13.845665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-60dcd08a-0147-482c-a2ce-85721d5e479e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:13.909007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-60dcd08a-0147-482c-a2ce-85721d5e479e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:13.917296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-60dcd08a-0147-482c-a2ce-85721d5e479e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084224 Jul 27 23:00:13.917787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1014/1883] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:13 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:13.922260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a38cebe9-1b37-418f-b6e4-1d816c6c799f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:13.924343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a38cebe9-1b37-418f-b6e4-1d816c6c799f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:13.930105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a38cebe9-1b37-418f-b6e4-1d816c6c799f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:13.930544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a38cebe9-1b37-418f-b6e4-1d816c6c799f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:13.931294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a38cebe9-1b37-418f-b6e4-1d816c6c799f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:13.931803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a38cebe9-1b37-418f-b6e4-1d816c6c799f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:13.961099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a38cebe9-1b37-418f-b6e4-1d816c6c799f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042256 Jul 27 23:00:13.961651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1015/1884] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:13 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:13.966222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7b436adf-1cec-43da-a8c4-18f691400353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:13.968324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7b436adf-1cec-43da-a8c4-18f691400353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:13.974006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b436adf-1cec-43da-a8c4-18f691400353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:13.974453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b436adf-1cec-43da-a8c4-18f691400353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:13.975206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b436adf-1cec-43da-a8c4-18f691400353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:13.975640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b436adf-1cec-43da-a8c4-18f691400353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:14.004501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7b436adf-1cec-43da-a8c4-18f691400353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041879 Jul 27 23:00:14.005071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1016/1885] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:13 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:14.939151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-830dc5f7-6fec-4364-b622-3cd1c15c149f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:14.939804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-830dc5f7-6fec-4364-b622-3cd1c15c149f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:14.946266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-830dc5f7-6fec-4364-b622-3cd1c15c149f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:14.946705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-830dc5f7-6fec-4364-b622-3cd1c15c149f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:14.948175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-830dc5f7-6fec-4364-b622-3cd1c15c149f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:14.948650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-830dc5f7-6fec-4364-b622-3cd1c15c149f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:15.010554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-830dc5f7-6fec-4364-b622-3cd1c15c149f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:15.018534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-830dc5f7-6fec-4364-b622-3cd1c15c149f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083229 Jul 27 23:00:15.019097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1017/1886] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:14 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:15.023638 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-33c40300-2fb2-4dcb-b90a-77eb47c61b1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:15.025795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-33c40300-2fb2-4dcb-b90a-77eb47c61b1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:15.031564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33c40300-2fb2-4dcb-b90a-77eb47c61b1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:15.032005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33c40300-2fb2-4dcb-b90a-77eb47c61b1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:15.032792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33c40300-2fb2-4dcb-b90a-77eb47c61b1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:15.033221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-33c40300-2fb2-4dcb-b90a-77eb47c61b1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:15.061604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-33c40300-2fb2-4dcb-b90a-77eb47c61b1b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041470 Jul 27 23:00:15.062144 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1018/1887] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:15 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:15.066602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8c4ab769-88f6-41c0-99c4-92f9b163e2eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:15.068753 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8c4ab769-88f6-41c0-99c4-92f9b163e2eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:15.075109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c4ab769-88f6-41c0-99c4-92f9b163e2eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:15.075553 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c4ab769-88f6-41c0-99c4-92f9b163e2eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:15.076305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c4ab769-88f6-41c0-99c4-92f9b163e2eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:15.076830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c4ab769-88f6-41c0-99c4-92f9b163e2eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:15.105264 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8c4ab769-88f6-41c0-99c4-92f9b163e2eb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042088 Jul 27 23:00:15.105827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1019/1888] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:16.039340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6af1d26d-da4a-4af4-b3eb-def6add17f63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:16.039932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6af1d26d-da4a-4af4-b3eb-def6add17f63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:16.046480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6af1d26d-da4a-4af4-b3eb-def6add17f63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:16.046932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6af1d26d-da4a-4af4-b3eb-def6add17f63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:16.047693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6af1d26d-da4a-4af4-b3eb-def6add17f63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:16.048134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6af1d26d-da4a-4af4-b3eb-def6add17f63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:16.109622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6af1d26d-da4a-4af4-b3eb-def6add17f63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:16.117039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6af1d26d-da4a-4af4-b3eb-def6add17f63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081572 Jul 27 23:00:16.117601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1020/1889] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:16 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:16.122209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9d26f050-d089-4abf-bb59-c6b2b31dfe04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:16.124314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9d26f050-d089-4abf-bb59-c6b2b31dfe04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:16.129864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d26f050-d089-4abf-bb59-c6b2b31dfe04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:16.130313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d26f050-d089-4abf-bb59-c6b2b31dfe04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:16.131074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d26f050-d089-4abf-bb59-c6b2b31dfe04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:16.131538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d26f050-d089-4abf-bb59-c6b2b31dfe04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:16.160490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9d26f050-d089-4abf-bb59-c6b2b31dfe04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041887 Jul 27 23:00:16.161075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1021/1890] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:16 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:16.165477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b78c14e8-0bf3-4ea2-a00b-3e5cd00f1942 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:16.167588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b78c14e8-0bf3-4ea2-a00b-3e5cd00f1942 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:16.173147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b78c14e8-0bf3-4ea2-a00b-3e5cd00f1942 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:16.173600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b78c14e8-0bf3-4ea2-a00b-3e5cd00f1942 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:16.174360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b78c14e8-0bf3-4ea2-a00b-3e5cd00f1942 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:16.174796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b78c14e8-0bf3-4ea2-a00b-3e5cd00f1942 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:16.202755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b78c14e8-0bf3-4ea2-a00b-3e5cd00f1942 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040725 Jul 27 23:00:16.203294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1022/1891] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:16 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:17.137500 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-240cbcd5-c542-4175-90b0-44259d20b401 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:17.138265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-240cbcd5-c542-4175-90b0-44259d20b401 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:17.144960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-240cbcd5-c542-4175-90b0-44259d20b401 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:17.145403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-240cbcd5-c542-4175-90b0-44259d20b401 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:17.146149 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-240cbcd5-c542-4175-90b0-44259d20b401 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:17.146606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-240cbcd5-c542-4175-90b0-44259d20b401 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:17.206410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-240cbcd5-c542-4175-90b0-44259d20b401 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:17.214447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-240cbcd5-c542-4175-90b0-44259d20b401 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080802 Jul 27 23:00:17.215007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1023/1892] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:17 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:17.219566 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bc931be8-7ef3-418a-9dde-d52accf703f1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:17.221706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bc931be8-7ef3-418a-9dde-d52accf703f1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:17.227276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bc931be8-7ef3-418a-9dde-d52accf703f1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:17.227723 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bc931be8-7ef3-418a-9dde-d52accf703f1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:17.228490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bc931be8-7ef3-418a-9dde-d52accf703f1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:17.229836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bc931be8-7ef3-418a-9dde-d52accf703f1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:17.262098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bc931be8-7ef3-418a-9dde-d52accf703f1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046019 Jul 27 23:00:17.262653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1024/1893] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:17 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:17.267923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-35c0adb1-3cb8-4e36-b931-b68c2143ba71 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:17.271221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-35c0adb1-3cb8-4e36-b931-b68c2143ba71 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:17.278916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35c0adb1-3cb8-4e36-b931-b68c2143ba71 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:17.279359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35c0adb1-3cb8-4e36-b931-b68c2143ba71 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:17.280117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35c0adb1-3cb8-4e36-b931-b68c2143ba71 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:17.280575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35c0adb1-3cb8-4e36-b931-b68c2143ba71 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:17.309474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-35c0adb1-3cb8-4e36-b931-b68c2143ba71 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045751 Jul 27 23:00:17.310033 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1025/1894] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:17 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:18.235611 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4b773a5f-d5de-4224-86a8-738f1cc6af93 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:18.236213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4b773a5f-d5de-4224-86a8-738f1cc6af93 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:18.242725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4b773a5f-d5de-4224-86a8-738f1cc6af93 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:18.243171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4b773a5f-d5de-4224-86a8-738f1cc6af93 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:18.243924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4b773a5f-d5de-4224-86a8-738f1cc6af93 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:18.244957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4b773a5f-d5de-4224-86a8-738f1cc6af93 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:18.307465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4b773a5f-d5de-4224-86a8-738f1cc6af93 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:18.315050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4b773a5f-d5de-4224-86a8-738f1cc6af93 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083289 Jul 27 23:00:18.324832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1026/1895] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:18 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:18.324832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a627556e-622a-4e3c-ad90-35376b9511a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:18.324832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a627556e-622a-4e3c-ad90-35376b9511a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:18.328216 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a627556e-622a-4e3c-ad90-35376b9511a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:18.328726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a627556e-622a-4e3c-ad90-35376b9511a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:18.329481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a627556e-622a-4e3c-ad90-35376b9511a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:18.329912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a627556e-622a-4e3c-ad90-35376b9511a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:18.345990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:00:18.359820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a627556e-622a-4e3c-ad90-35376b9511a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043054 Jul 27 23:00:18.360377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1027/1896] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:18 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:18.364762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fd252a0e-c62a-4fce-b7c2-cf0923246708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:18.366844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fd252a0e-c62a-4fce-b7c2-cf0923246708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:18.372921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd252a0e-c62a-4fce-b7c2-cf0923246708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:18.373370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd252a0e-c62a-4fce-b7c2-cf0923246708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:18.374121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd252a0e-c62a-4fce-b7c2-cf0923246708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:18.374555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd252a0e-c62a-4fce-b7c2-cf0923246708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:18.402121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fd252a0e-c62a-4fce-b7c2-cf0923246708 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040765 Jul 27 23:00:18.402659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1028/1897] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:18 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:19.335473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2b0d9932-e475-4ccc-a466-d226d43d6df3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:19.336085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2b0d9932-e475-4ccc-a466-d226d43d6df3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:19.342612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b0d9932-e475-4ccc-a466-d226d43d6df3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:19.343053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b0d9932-e475-4ccc-a466-d226d43d6df3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:19.343802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b0d9932-e475-4ccc-a466-d226d43d6df3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:19.344227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b0d9932-e475-4ccc-a466-d226d43d6df3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:19.405647 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2b0d9932-e475-4ccc-a466-d226d43d6df3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:19.413765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2b0d9932-e475-4ccc-a466-d226d43d6df3 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082126 Jul 27 23:00:19.414326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1029/1898] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:19 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:19.418954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-538ab559-be95-49e6-9bc1-f65953902222 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:19.421148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-538ab559-be95-49e6-9bc1-f65953902222 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:19.426842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-538ab559-be95-49e6-9bc1-f65953902222 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:19.427287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-538ab559-be95-49e6-9bc1-f65953902222 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:19.428032 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-538ab559-be95-49e6-9bc1-f65953902222 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:19.428458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-538ab559-be95-49e6-9bc1-f65953902222 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:19.457597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-538ab559-be95-49e6-9bc1-f65953902222 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042282 Jul 27 23:00:19.458144 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1030/1899] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:19 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:19.462539 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0a0f74c3-d149-40f5-aaa9-fb4340f0e65a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:19.464669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0a0f74c3-d149-40f5-aaa9-fb4340f0e65a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:19.470285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a0f74c3-d149-40f5-aaa9-fb4340f0e65a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:19.470724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a0f74c3-d149-40f5-aaa9-fb4340f0e65a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:19.471474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a0f74c3-d149-40f5-aaa9-fb4340f0e65a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:19.471901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a0f74c3-d149-40f5-aaa9-fb4340f0e65a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:19.500337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0a0f74c3-d149-40f5-aaa9-fb4340f0e65a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 Jul 27 23:00:19.500908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1031/1900] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:19 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:20.434129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6aea6cda-e096-443a-b791-2a2d76a591ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:20.434752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6aea6cda-e096-443a-b791-2a2d76a591ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:20.441134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6aea6cda-e096-443a-b791-2a2d76a591ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:20.441571 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6aea6cda-e096-443a-b791-2a2d76a591ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:20.442316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6aea6cda-e096-443a-b791-2a2d76a591ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:20.442743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6aea6cda-e096-443a-b791-2a2d76a591ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:20.502574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6aea6cda-e096-443a-b791-2a2d76a591ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:20.510359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6aea6cda-e096-443a-b791-2a2d76a591ba tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079744 Jul 27 23:00:20.510908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1032/1901] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:20 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:20.515279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-239f42ef-253d-49ad-9892-4a961b863943 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:20.517396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-239f42ef-253d-49ad-9892-4a961b863943 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:20.519006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:00:20.524405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-239f42ef-253d-49ad-9892-4a961b863943 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:20.524883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-239f42ef-253d-49ad-9892-4a961b863943 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:20.526257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-239f42ef-253d-49ad-9892-4a961b863943 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:20.526684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-239f42ef-253d-49ad-9892-4a961b863943 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:20.554140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-239f42ef-253d-49ad-9892-4a961b863943 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042292 Jul 27 23:00:20.554678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1033/1902] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:20 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:20.559205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9a267f50-336d-4114-90db-05c9704a3156 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:20.561279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9a267f50-336d-4114-90db-05c9704a3156 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:20.566739 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a267f50-336d-4114-90db-05c9704a3156 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:20.567182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a267f50-336d-4114-90db-05c9704a3156 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:20.567916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a267f50-336d-4114-90db-05c9704a3156 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:20.568344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a267f50-336d-4114-90db-05c9704a3156 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:20.596874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9a267f50-336d-4114-90db-05c9704a3156 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041152 Jul 27 23:00:20.597413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1034/1903] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:20 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:20.960244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=4 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:00:21.530559 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e61ba0c3-d6f1-4afe-9e8f-b3a8ae5fb426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:21.531174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e61ba0c3-d6f1-4afe-9e8f-b3a8ae5fb426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:21.537756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e61ba0c3-d6f1-4afe-9e8f-b3a8ae5fb426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:21.538201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e61ba0c3-d6f1-4afe-9e8f-b3a8ae5fb426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:21.538953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e61ba0c3-d6f1-4afe-9e8f-b3a8ae5fb426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:21.539384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e61ba0c3-d6f1-4afe-9e8f-b3a8ae5fb426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:21.600622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e61ba0c3-d6f1-4afe-9e8f-b3a8ae5fb426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:21.608442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e61ba0c3-d6f1-4afe-9e8f-b3a8ae5fb426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081682 Jul 27 23:00:21.609030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1035/1904] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:21 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:21.613459 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f6eff7c2-1068-43ac-9461-029a806bfedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:21.615574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f6eff7c2-1068-43ac-9461-029a806bfedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:21.621743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f6eff7c2-1068-43ac-9461-029a806bfedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:21.622187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f6eff7c2-1068-43ac-9461-029a806bfedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:21.622942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f6eff7c2-1068-43ac-9461-029a806bfedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:21.623372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f6eff7c2-1068-43ac-9461-029a806bfedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:21.651265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f6eff7c2-1068-43ac-9461-029a806bfedf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041281 Jul 27 23:00:21.651805 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1036/1905] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:21 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:21.656093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5fc4417e-f942-4024-9e3b-614a95645b5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:21.658152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5fc4417e-f942-4024-9e3b-614a95645b5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:21.663610 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5fc4417e-f942-4024-9e3b-614a95645b5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:21.664060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5fc4417e-f942-4024-9e3b-614a95645b5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:21.664825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5fc4417e-f942-4024-9e3b-614a95645b5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:21.665256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5fc4417e-f942-4024-9e3b-614a95645b5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:21.692768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5fc4417e-f942-4024-9e3b-614a95645b5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040006 Jul 27 23:00:21.693297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1037/1906] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:21 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:22.629460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-147758e5-9011-4c0f-9610-14e4b91d6c7e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:22.630167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-147758e5-9011-4c0f-9610-14e4b91d6c7e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:22.637239 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-147758e5-9011-4c0f-9610-14e4b91d6c7e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:22.637679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-147758e5-9011-4c0f-9610-14e4b91d6c7e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:22.638425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-147758e5-9011-4c0f-9610-14e4b91d6c7e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:22.638854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-147758e5-9011-4c0f-9610-14e4b91d6c7e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:22.702678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-147758e5-9011-4c0f-9610-14e4b91d6c7e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:22.710188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-147758e5-9011-4c0f-9610-14e4b91d6c7e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084521 Jul 27 23:00:22.710735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1038/1907] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:22 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:22.715095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-217596db-3828-4659-8c16-e73e16c29ca6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:22.717202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-217596db-3828-4659-8c16-e73e16c29ca6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:22.722663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-217596db-3828-4659-8c16-e73e16c29ca6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:22.723102 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-217596db-3828-4659-8c16-e73e16c29ca6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:22.723875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-217596db-3828-4659-8c16-e73e16c29ca6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:22.724301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-217596db-3828-4659-8c16-e73e16c29ca6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:22.752824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-217596db-3828-4659-8c16-e73e16c29ca6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041113 Jul 27 23:00:22.753355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1039/1908] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:22 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:22.757607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ed3dff66-3669-452f-9be9-d3426c598fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:22.759808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ed3dff66-3669-452f-9be9-d3426c598fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:22.765248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed3dff66-3669-452f-9be9-d3426c598fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:22.765687 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed3dff66-3669-452f-9be9-d3426c598fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:22.766445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed3dff66-3669-452f-9be9-d3426c598fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:22.766872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed3dff66-3669-452f-9be9-d3426c598fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:22.794438 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ed3dff66-3669-452f-9be9-d3426c598fa0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040167 Jul 27 23:00:22.794973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1040/1909] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:22 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:23.730737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3f3fbc51-501d-420b-a650-3aeb6934dad1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:23.731267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3f3fbc51-501d-420b-a650-3aeb6934dad1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:23.737650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f3fbc51-501d-420b-a650-3aeb6934dad1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:23.738088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f3fbc51-501d-420b-a650-3aeb6934dad1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:23.739297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f3fbc51-501d-420b-a650-3aeb6934dad1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:23.739297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f3fbc51-501d-420b-a650-3aeb6934dad1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:23.799172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3f3fbc51-501d-420b-a650-3aeb6934dad1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:00:23.807052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3f3fbc51-501d-420b-a650-3aeb6934dad1 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079952 Jul 27 23:00:23.807603 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1041/1910] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:00:23 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:00:23.811969 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-df3a3e93-377b-4d5e-ac05-32689e09660f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:23.814071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-df3a3e93-377b-4d5e-ac05-32689e09660f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:23.819680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df3a3e93-377b-4d5e-ac05-32689e09660f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:23.820119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df3a3e93-377b-4d5e-ac05-32689e09660f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:23.820900 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df3a3e93-377b-4d5e-ac05-32689e09660f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:23.821356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df3a3e93-377b-4d5e-ac05-32689e09660f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:23.848922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-df3a3e93-377b-4d5e-ac05-32689e09660f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040336 Jul 27 23:00:23.849456 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1042/1911] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:23 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:23.854145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b1c11288-1bc5-43e1-b31e-abaf85224f4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:23.856183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b1c11288-1bc5-43e1-b31e-abaf85224f4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:23.861496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1c11288-1bc5-43e1-b31e-abaf85224f4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:23.861937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1c11288-1bc5-43e1-b31e-abaf85224f4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:23.862674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1c11288-1bc5-43e1-b31e-abaf85224f4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:23.863100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1c11288-1bc5-43e1-b31e-abaf85224f4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:23.891393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b1c11288-1bc5-43e1-b31e-abaf85224f4c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040936 Jul 27 23:00:23.891935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1043/1912] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:00:23 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:00:24.294086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5f92a563-9a38-4d42-a2a9-e41bbbfa341b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:00:24.294577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5f92a563-9a38-4d42-a2a9-e41bbbfa341b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:00:24.300538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f92a563-9a38-4d42-a2a9-e41bbbfa341b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:24.301016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f92a563-9a38-4d42-a2a9-e41bbbfa341b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:24.301768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f92a563-9a38-4d42-a2a9-e41bbbfa341b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:00:24.302197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f92a563-9a38-4d42-a2a9-e41bbbfa341b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:00:24.305910 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:00:34.298565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=23 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:00:34.321399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:01:01.369206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:01:01.369877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:01:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e (ip 10.222.0.47) !!! Jul 27 23:01:24.306072 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR oslo.messaging._drivers.impl_rabbit [None req-89948f4c-90c3-4599-bd19-026f44fb0e7a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [f8399fcd-75f1-4b46-b6cc-1a417ab8f422] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 23:01:24.419272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.objects.instance [None req-5f92a563-9a38-4d42-a2a9-e41bbbfa341b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lazy-loading 'services' on Instance uuid b19fab65-5354-4383-ba3a-9eb6614382ff {{(pid=129295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 23:01:25.313783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [None req-89948f4c-90c3-4599-bd19-026f44fb0e7a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [f8399fcd-75f1-4b46-b6cc-1a417ab8f422] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 40068. Jul 27 23:01:25.317141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-89948f4c-90c3-4599-bd19-026f44fb0e7a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e" status: 202 len: 0 microversion: 2.1 time: 121.082551 Jul 27 23:01:25.317721 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 870/1913] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 22:59:24 2022] DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e => generated 0 bytes in 121084 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 23:01:25.323511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-21619815-5918-41a7-9ee6-df61a72dceeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:01:25.324201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-21619815-5918-41a7-9ee6-df61a72dceeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:01:25.330571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21619815-5918-41a7-9ee6-df61a72dceeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:01:25.331019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21619815-5918-41a7-9ee6-df61a72dceeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:01:25.331780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21619815-5918-41a7-9ee6-df61a72dceeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:01:25.332215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21619815-5918-41a7-9ee6-df61a72dceeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:01:25.396385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-21619815-5918-41a7-9ee6-df61a72dceeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:01:25.403980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-21619815-5918-41a7-9ee6-df61a72dceeb tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084982 Jul 27 23:01:25.404486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 871/1914] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:01:25 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:01:25.409057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f848d327-cdef-4863-9b05-ddf7dbf5ef31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:01:25.412067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f848d327-cdef-4863-9b05-ddf7dbf5ef31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:01:25.419697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f848d327-cdef-4863-9b05-ddf7dbf5ef31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:01:25.420169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f848d327-cdef-4863-9b05-ddf7dbf5ef31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:01:25.420962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f848d327-cdef-4863-9b05-ddf7dbf5ef31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:01:25.421397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f848d327-cdef-4863-9b05-ddf7dbf5ef31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:01:25.449473 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f848d327-cdef-4863-9b05-ddf7dbf5ef31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Jul 27 23:01:25.450021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 872/1915] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:01:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:01:25.454488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-309a451c-416f-42a8-89e9-1b9e1c133985 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:01:25.456520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-309a451c-416f-42a8-89e9-1b9e1c133985 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:01:25.461907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-309a451c-416f-42a8-89e9-1b9e1c133985 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:01:25.462352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-309a451c-416f-42a8-89e9-1b9e1c133985 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:01:25.463101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-309a451c-416f-42a8-89e9-1b9e1c133985 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:01:25.463536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-309a451c-416f-42a8-89e9-1b9e1c133985 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:01:25.491725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-309a451c-416f-42a8-89e9-1b9e1c133985 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040685 Jul 27 23:01:25.492261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 873/1916] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:01:25 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:01:25.497253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5614c64d-6374-4507-aac5-8e553c56ec11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:01:25.497735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5614c64d-6374-4507-aac5-8e553c56ec11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:01:25.503252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5614c64d-6374-4507-aac5-8e553c56ec11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:01:25.503697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5614c64d-6374-4507-aac5-8e553c56ec11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:01:25.504448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5614c64d-6374-4507-aac5-8e553c56ec11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:01:25.504914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5614c64d-6374-4507-aac5-8e553c56ec11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:01:34.424008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=4 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:01:35.501026 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=8 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:01:35.522181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:02:11.086478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-5f92a563-9a38-4d42-a2a9-e41bbbfa341b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d2abe80-2dc5-4fbe-9f54-f65d0269a7c4) Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5f92a563-9a38-4d42-a2a9-e41bbbfa341b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Request method failure captured: Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e HTTP/1.1 Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cGauNLN2agGj9qk0DLlOYMfpqG62ydQc4WJxDsWdvJpZae1ldqHpqwssdxk8vea7nKflHqdLzNVyOZXv9rORlsoM_ktOXd0Fv5GoPpRON8vB-GW8-qZfy9lh7ANhvSzDxRdQdYu82IzZGN-WsefR4M-p4dg2WCmK2wp2D-s-JgPp3M Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 002feda86f414d16b592aa9e3100b510 Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-VolumesSnapshotTestJSON-702367403 Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:02:11.088763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:02:11.092115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/002feda86f414d16b592aa9e3100b510"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_002feda86f414d16b592aa9e3100b510", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/002feda86f414d16b592aa9e3100b510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/002feda86f414d16b592aa9e3100b510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:02:11.092115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-VolumesSnapshotTestJSON-702367403 Jul 27 23:02:11.092115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 002feda86f414d16b592aa9e3100b510 Jul 27 23:02:11.092115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-702367403 Jul 27 23:02:11.092115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-VolumesSnapshotTestJSON-702367403-project Jul 27 23:02:11.092115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:02:11.092115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:02:11.092115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 325eac13d04548138b3d541fb4740c4c Jul 27 23:02:11.092115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-VolumesSnapshotTestJSON-702367403-project Jul 27 23:02:11.092115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d2abe80-2dc5-4fbe-9f54-f65d0269a7c4) Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'server_id': 'b19fab65-5354-4383-ba3a-9eb6614382ff', 'id': '128d5bc5-a8f4-4e84-afd1-2109d321af1e'} Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 23:02:11.094000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d2abe80-2dc5-4fbe-9f54-f65d0269a7c4) Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:02:11.096602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d2abe80-2dc5-4fbe-9f54-f65d0269a7c4) Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:02:11.098619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d2abe80-2dc5-4fbe-9f54-f65d0269a7c4) Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:02:11.100228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d2abe80-2dc5-4fbe-9f54-f65d0269a7c4) Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d2abe80-2dc5-4fbe-9f54-f65d0269a7c4) Jul 27 23:02:11.102166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:02:11.103574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5f92a563-9a38-4d42-a2a9-e41bbbfa341b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d2abe80-2dc5-4fbe-9f54-f65d0269a7c4) {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:02:11.103574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5f92a563-9a38-4d42-a2a9-e41bbbfa341b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e" status: 400 len: 269 microversion: 2.1 time: 106.801208 Jul 27 23:02:11.103574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1044/1917] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 23:00:24 2022] DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e => generated 269 bytes in 106802 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 23:02:11.103574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c7b73dbc-a634-4228-b83a-6ea470fe1a6c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:02:11.103916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c7b73dbc-a634-4228-b83a-6ea470fe1a6c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:02:11.106221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7b73dbc-a634-4228-b83a-6ea470fe1a6c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.106668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7b73dbc-a634-4228-b83a-6ea470fe1a6c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:11.107435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7b73dbc-a634-4228-b83a-6ea470fe1a6c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.107868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7b73dbc-a634-4228-b83a-6ea470fe1a6c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:11.132351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c7b73dbc-a634-4228-b83a-6ea470fe1a6c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Going to try to terminate instance {{(pid=129295) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 23:02:11.187697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.objects.instance [None req-5614c64d-6374-4507-aac5-8e553c56ec11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lazy-loading 'services' on Instance uuid b19fab65-5354-4383-ba3a-9eb6614382ff {{(pid=129294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 23:02:11.223290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c7b73dbc-a634-4228-b83a-6ea470fe1a6c tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 204 len: 0 microversion: 2.1 time: 0.130755 Jul 27 23:02:11.223868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1045/1918] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:02:11 2022] DELETE /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 23:02:11.228826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1156ea6b-1ebc-4d84-a656-6a17edc87fe7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:02:11.229847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1156ea6b-1ebc-4d84-a656-6a17edc87fe7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:02:11.235667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1156ea6b-1ebc-4d84-a656-6a17edc87fe7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.236083 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1156ea6b-1ebc-4d84-a656-6a17edc87fe7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:11.236869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1156ea6b-1ebc-4d84-a656-6a17edc87fe7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.237324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1156ea6b-1ebc-4d84-a656-6a17edc87fe7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:11.298515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1156ea6b-1ebc-4d84-a656-6a17edc87fe7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:02:11.305770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1156ea6b-1ebc-4d84-a656-6a17edc87fe7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080823 Jul 27 23:02:11.306326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1046/1919] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:02:11 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:02:11.392827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-23f60d81-d4fa-4b67-937c-bc6d936dc9fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:02:11.395091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-23f60d81-d4fa-4b67-937c-bc6d936dc9fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:02:11.401133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23f60d81-d4fa-4b67-937c-bc6d936dc9fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.401582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23f60d81-d4fa-4b67-937c-bc6d936dc9fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:11.402392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23f60d81-d4fa-4b67-937c-bc6d936dc9fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.402826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-23f60d81-d4fa-4b67-937c-bc6d936dc9fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:11.430695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-23f60d81-d4fa-4b67-937c-bc6d936dc9fd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123361 Jul 27 23:02:11.431438 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1047/1920] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:02:11 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:02:11.436246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-72b444f9-ef60-4727-9908-e06eeed30bdd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:02:11.438394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-72b444f9-ef60-4727-9908-e06eeed30bdd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:02:11.444028 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72b444f9-ef60-4727-9908-e06eeed30bdd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.444475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72b444f9-ef60-4727-9908-e06eeed30bdd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:11.445255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72b444f9-ef60-4727-9908-e06eeed30bdd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.445689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72b444f9-ef60-4727-9908-e06eeed30bdd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:11.473954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-72b444f9-ef60-4727-9908-e06eeed30bdd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041718 Jul 27 23:02:11.474501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1048/1921] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Jul 27 23:02:11 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:02:11.482010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0806880e-3a28-4969-bc83-73f87ffdcdd9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:02:11.482611 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0806880e-3a28-4969-bc83-73f87ffdcdd9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:02:11.488285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0806880e-3a28-4969-bc83-73f87ffdcdd9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.488768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0806880e-3a28-4969-bc83-73f87ffdcdd9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:11.489518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0806880e-3a28-4969-bc83-73f87ffdcdd9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.489947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0806880e-3a28-4969-bc83-73f87ffdcdd9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:11.685526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0806880e-3a28-4969-bc83-73f87ffdcdd9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa05eaf07f14de6b6ef97f08e6e5123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161af2d8dc8f4aa99d4cc112a89ff674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:02:11.693763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0806880e-3a28-4969-bc83-73f87ffdcdd9 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 200 len: 1673 microversion: 2.1 time: 0.218240 Jul 27 23:02:11.707344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1049/1922] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:02:11 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 1673 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:02:11.851974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f90bc07d-b26c-4cdb-abea-ae2333a01fda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:02:11.852543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f90bc07d-b26c-4cdb-abea-ae2333a01fda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:02:11.859621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f90bc07d-b26c-4cdb-abea-ae2333a01fda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.860077 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f90bc07d-b26c-4cdb-abea-ae2333a01fda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:11.861088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f90bc07d-b26c-4cdb-abea-ae2333a01fda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.861699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f90bc07d-b26c-4cdb-abea-ae2333a01fda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:11.886842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f90bc07d-b26c-4cdb-abea-ae2333a01fda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Going to try to terminate instance {{(pid=129295) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 23:02:11.934102 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.compute.api [None req-f90bc07d-b26c-4cdb-abea-ae2333a01fda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Instance is already in deleting state, ignoring this request Jul 27 23:02:11.934919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f90bc07d-b26c-4cdb-abea-ae2333a01fda tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 204 len: 0 microversion: 2.1 time: 0.087172 Jul 27 23:02:11.935491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1050/1923] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:02:11 2022] DELETE /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 23:02:11.943256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bf7c191e-6453-48ee-b797-d39201767720 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:02:11.943859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bf7c191e-6453-48ee-b797-d39201767720 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:02:11.949740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf7c191e-6453-48ee-b797-d39201767720 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.950190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf7c191e-6453-48ee-b797-d39201767720 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:11.950948 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf7c191e-6453-48ee-b797-d39201767720 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:11.951385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf7c191e-6453-48ee-b797-d39201767720 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:12.012395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bf7c191e-6453-48ee-b797-d39201767720 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:02:12.019955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bf7c191e-6453-48ee-b797-d39201767720 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080222 Jul 27 23:02:12.020522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1051/1924] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:02:11 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:02:12.443673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-69c5e058-e4c3-4e75-89d1-c50ac4baec30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:02:12.445949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-69c5e058-e4c3-4e75-89d1-c50ac4baec30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:02:12.452467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-69c5e058-e4c3-4e75-89d1-c50ac4baec30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:12.452950 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-69c5e058-e4c3-4e75-89d1-c50ac4baec30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:12.453716 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-69c5e058-e4c3-4e75-89d1-c50ac4baec30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:12.454153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-69c5e058-e4c3-4e75-89d1-c50ac4baec30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:12.539380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-69c5e058-e4c3-4e75-89d1-c50ac4baec30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "POST /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/action" status: 200 len: 83552 microversion: 2.1 time: 0.099541 Jul 27 23:02:12.540067 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1052/1925] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 23:02:12 2022] POST /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/action => generated 83552 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 23:02:12.548021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-765071f7-ba74-4299-92e0-39c20364ab76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:02:12.552009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-765071f7-ba74-4299-92e0-39c20364ab76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:02:12.560819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-765071f7-ba74-4299-92e0-39c20364ab76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:12.561275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-765071f7-ba74-4299-92e0-39c20364ab76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:12.562080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-765071f7-ba74-4299-92e0-39c20364ab76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:12.562518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-765071f7-ba74-4299-92e0-39c20364ab76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:12.663698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-765071f7-ba74-4299-92e0-39c20364ab76 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "POST /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/action" status: 200 len: 75877 microversion: 2.1 time: 0.121989 Jul 27 23:02:12.671433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1053/1926] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 23:02:12 2022] POST /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469/action => generated 75877 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 23:02:12.671433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a66e74ca-f297-42f6-8baa-3e6a4363f50e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:02:12.671433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a66e74ca-f297-42f6-8baa-3e6a4363f50e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:02:12.678629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a66e74ca-f297-42f6-8baa-3e6a4363f50e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:12.679194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a66e74ca-f297-42f6-8baa-3e6a4363f50e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:12.680209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a66e74ca-f297-42f6-8baa-3e6a4363f50e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:02:12.680781 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a66e74ca-f297-42f6-8baa-3e6a4363f50e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:02:21.192341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=4 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:02:22.675864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:02:22.702171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:02:38.821412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:02:38.821976 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:02:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e (ip 10.222.0.47) !!! Jul 27 23:02:41.855499 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:02:41.855995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:02:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e (ip 10.222.0.47) !!! Jul 27 23:02:42.134072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:02:42.134601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:02:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments/532a5824-f1bb-4b12-a1fc-36d6c5a8edbd (ip 10.222.0.47) !!! Jul 27 23:03:24.667835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-5614c64d-6374-4507-aac5-8e553c56ec11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-88930fc4-59df-4130-bb68-5a7a43f2627a) Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5614c64d-6374-4507-aac5-8e553c56ec11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Request method failure captured: Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e HTTP/1.1 Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cGauNLN2agGj9qk0DLlOYMfpqG62ydQc4WJxDsWdvJpZae1ldqHpqwssdxk8vea7nKflHqdLzNVyOZXv9rORlsoM_ktOXd0Fv5GoPpRON8vB-GW8-qZfy9lh7ANhvSzDxRdQdYu82IzZGN-WsefR4M-p4dg2WCmK2wp2D-s-JgPp3M Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 002feda86f414d16b592aa9e3100b510 Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-VolumesSnapshotTestJSON-702367403 Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 23:03:24.670211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 23:03:24.671589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/002feda86f414d16b592aa9e3100b510"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_002feda86f414d16b592aa9e3100b510", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/002feda86f414d16b592aa9e3100b510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/002feda86f414d16b592aa9e3100b510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:03:24.671589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-VolumesSnapshotTestJSON-702367403 Jul 27 23:03:24.671589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 002feda86f414d16b592aa9e3100b510 Jul 27 23:03:24.671589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-702367403 Jul 27 23:03:24.671589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-VolumesSnapshotTestJSON-702367403-project Jul 27 23:03:24.671589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 23:03:24.671589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 23:03:24.671589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 325eac13d04548138b3d541fb4740c4c Jul 27 23:03:24.671589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-VolumesSnapshotTestJSON-702367403-project Jul 27 23:03:24.671589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-88930fc4-59df-4130-bb68-5a7a43f2627a) Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'server_id': 'b19fab65-5354-4383-ba3a-9eb6614382ff', 'id': '128d5bc5-a8f4-4e84-afd1-2109d321af1e'} Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 23:03:24.672382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-88930fc4-59df-4130-bb68-5a7a43f2627a) Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:03:24.673803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-88930fc4-59df-4130-bb68-5a7a43f2627a) Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:03:24.675388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-88930fc4-59df-4130-bb68-5a7a43f2627a) Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:03:24.677268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-88930fc4-59df-4130-bb68-5a7a43f2627a) Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-88930fc4-59df-4130-bb68-5a7a43f2627a) Jul 27 23:03:24.678778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.680251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5614c64d-6374-4507-aac5-8e553c56ec11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-88930fc4-59df-4130-bb68-5a7a43f2627a) {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:03:24.680251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5614c64d-6374-4507-aac5-8e553c56ec11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e" status: 400 len: 269 microversion: 2.1 time: 119.178377 Jul 27 23:03:24.680251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 874/1927] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 23:01:25 2022] DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e => generated 269 bytes in 119179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 23:03:24.795974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.objects.instance [None req-a66e74ca-f297-42f6-8baa-3e6a4363f50e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lazy-loading 'services' on Instance uuid 69a6fc53-bd93-47c4-9413-39ba0e1b6068 {{(pid=129295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 23:03:24.805109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-a31d02db-fb9f-411e-b340-5636747f2a53 req-8a41aeac-6735-463d-8241-f3839d872707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f087841-5ab3-42d6-ace3-9288c1ff0059", "name": "network-vif-deleted", "tag": "dbb4d703-735b-47ff-a087-f879be275b30"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:03:24.814859 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-a31d02db-fb9f-411e-b340-5636747f2a53 req-8a41aeac-6735-463d-8241-f3839d872707 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:03:24.815527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-a31d02db-fb9f-411e-b340-5636747f2a53 req-8a41aeac-6735-463d-8241-f3839d872707 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:03:24.828833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-a31d02db-fb9f-411e-b340-5636747f2a53 req-8a41aeac-6735-463d-8241-f3839d872707 service nova] Creating event network-vif-deleted:dbb4d703-735b-47ff-a087-f879be275b30 for instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 on hv-cinder-85124 Jul 27 23:03:24.832349 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-a31d02db-fb9f-411e-b340-5636747f2a53 req-8a41aeac-6735-463d-8241-f3839d872707 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158973 Jul 27 23:03:24.833517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 875/1928] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:03:24.839738 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a54b8c9b-6fab-426f-a0cf-a13f097ee282 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:03:24.840429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a54b8c9b-6fab-426f-a0cf-a13f097ee282 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:03:24.846499 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a54b8c9b-6fab-426f-a0cf-a13f097ee282 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:03:24.846945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a54b8c9b-6fab-426f-a0cf-a13f097ee282 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:03:24.848256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a54b8c9b-6fab-426f-a0cf-a13f097ee282 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:03:24.848792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a54b8c9b-6fab-426f-a0cf-a13f097ee282 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:03:24.862039 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-a54b8c9b-6fab-426f-a0cf-a13f097ee282 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] HTTP exception thrown: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a54b8c9b-6fab-426f-a0cf-a13f097ee282 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Request method failure captured: Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 HTTP/1.1 Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cDt2jGYGP9avBKREaegGHX8ZTy2kz44enKKjyjO-15MlSubsYLgwLY9qqYsI5NH_p5bx2zZngNKDjFWu0Fetl0ijXLpmmj1jX_OleBvu1IrRI0woihJrHbEuWy7JlTiK66lBuoyBitOum2D6pploo6gdYnfSGwxZ7CPjAJ7dAswEvg Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 23:03:24.864312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 23:03:24.865910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_161af2d8dc8f4aa99d4cc112a89ff674", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:03:24.865910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:03:24.865910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 23:03:24.865910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:03:24.865910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 23:03:24.865910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 23:03:24.865910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 23:03:24.865910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 3aa05eaf07f14de6b6ef97f08e6e5123 Jul 27 23:03:24.865910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 23:03:24.865910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 23:03:24.865910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:03:24.865910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '8f087841-5ab3-42d6-ace3-9288c1ff0059'} Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:03:24.866725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:03:24.867951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:03:24.869104 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a54b8c9b-6fab-426f-a0cf-a13f097ee282 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Returning 404 to user: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:03:24.869104 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a54b8c9b-6fab-426f-a0cf-a13f097ee282 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 404 len: 111 microversion: 2.1 time: 0.030899 Jul 27 23:03:24.869104 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 876/1929] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:03:24 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:03:25.016803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b810786d-49c6-45e0-b30a-aa6557a99c31 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:03:25.017420 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b810786d-49c6-45e0-b30a-aa6557a99c31 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:03:25.023923 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b810786d-49c6-45e0-b30a-aa6557a99c31 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:03:25.024310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b810786d-49c6-45e0-b30a-aa6557a99c31 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:03:25.025111 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b810786d-49c6-45e0-b30a-aa6557a99c31 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:03:25.025574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b810786d-49c6-45e0-b30a-aa6557a99c31 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:03:25.091580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b810786d-49c6-45e0-b30a-aa6557a99c31 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:03:25.099541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b810786d-49c6-45e0-b30a-aa6557a99c31 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.232460 Jul 27 23:03:25.100090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 877/1930] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:03:24 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:03:25.104498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-08508713-b37f-4fe1-b71a-9c34c96d1849 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:03:25.105257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-08508713-b37f-4fe1-b71a-9c34c96d1849 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:03:25.110586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08508713-b37f-4fe1-b71a-9c34c96d1849 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:03:25.111023 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08508713-b37f-4fe1-b71a-9c34c96d1849 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:03:25.111798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08508713-b37f-4fe1-b71a-9c34c96d1849 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:03:25.112222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08508713-b37f-4fe1-b71a-9c34c96d1849 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:03:34.817708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=4 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:03:35.109173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=8 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:03:35.129236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=14 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:11.243911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-a66e74ca-f297-42f6-8baa-3e6a4363f50e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-205a7245-3ec0-405a-86ba-253f815d80f0) Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a66e74ca-f297-42f6-8baa-3e6a4363f50e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Request method failure captured: Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: DELETE /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments/532a5824-f1bb-4b12-a1fc-36d6c5a8edbd HTTP/1.1 Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cGLTw3e_lXITPw1ax_GwOtw7uKOpTpqZlV5_GBvw-EniHqsOMSzBuL8jxK4Fr8496nJPhBrWAmWx4Gx-QQKELpe4nAUm0BXeEos9_naV4rJY3sdkUXW8L7W_H0hnPCf02L5JiAKXFESkmzSGnIedKhbQOu8UjGbD1SlnUeHb2eJUZI Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 7ecdd80c027f419e93fc7de57dfd70a6 Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-TestMinimumBasicScenario-1503896919 Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:04:11.246442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:04:11.247920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7ecdd80c027f419e93fc7de57dfd70a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7ecdd80c027f419e93fc7de57dfd70a6", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ecdd80c027f419e93fc7de57dfd70a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ecdd80c027f419e93fc7de57dfd70a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:04:11.247920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-TestMinimumBasicScenario-1503896919 Jul 27 23:04:11.247920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 7ecdd80c027f419e93fc7de57dfd70a6 Jul 27 23:04:11.247920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1503896919 Jul 27 23:04:11.247920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-TestMinimumBasicScenario-1503896919-project Jul 27 23:04:11.247920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:04:11.247920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:04:11.247920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 6f834cb4e134470286edcc0f1860f944 Jul 27 23:04:11.247920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-TestMinimumBasicScenario-1503896919-project Jul 27 23:04:11.247920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-205a7245-3ec0-405a-86ba-253f815d80f0) Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'server_id': '69a6fc53-bd93-47c4-9413-39ba0e1b6068', 'id': '532a5824-f1bb-4b12-a1fc-36d6c5a8edbd'} Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 23:04:11.248663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-205a7245-3ec0-405a-86ba-253f815d80f0) Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:04:11.249856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-205a7245-3ec0-405a-86ba-253f815d80f0) Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.251043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-205a7245-3ec0-405a-86ba-253f815d80f0) Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:04:11.252108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-205a7245-3ec0-405a-86ba-253f815d80f0) Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-205a7245-3ec0-405a-86ba-253f815d80f0) Jul 27 23:04:11.253881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.255334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a66e74ca-f297-42f6-8baa-3e6a4363f50e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-205a7245-3ec0-405a-86ba-253f815d80f0) {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:04:11.255334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a66e74ca-f297-42f6-8baa-3e6a4363f50e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "DELETE /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments/532a5824-f1bb-4b12-a1fc-36d6c5a8edbd" status: 400 len: 269 microversion: 2.1 time: 118.581920 Jul 27 23:04:11.255334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1054/1931] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 23:02:12 2022] DELETE /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments/532a5824-f1bb-4b12-a1fc-36d6c5a8edbd => generated 269 bytes in 118584 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 23:04:11.255334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-54550017-fe0f-4179-9496-2c70ec02a633 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:11.255788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-54550017-fe0f-4179-9496-2c70ec02a633 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:11.261527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-54550017-fe0f-4179-9496-2c70ec02a633 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:11.262089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-54550017-fe0f-4179-9496-2c70ec02a633 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:11.262852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-54550017-fe0f-4179-9496-2c70ec02a633 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:11.263281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-54550017-fe0f-4179-9496-2c70ec02a633 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:11.368033 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.objects.instance [None req-08508713-b37f-4fe1-b71a-9c34c96d1849 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lazy-loading 'services' on Instance uuid b19fab65-5354-4383-ba3a-9eb6614382ff {{(pid=129294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 23:04:11.486148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.objects.instance [None req-54550017-fe0f-4179-9496-2c70ec02a633 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lazy-loading 'services' on Instance uuid 69a6fc53-bd93-47c4-9413-39ba0e1b6068 {{(pid=129295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 23:04:11.514566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-08508713-b37f-4fe1-b71a-9c34c96d1849 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a6d6e5eb-3a23-47c7-829e-19d08f719469) Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-08508713-b37f-4fe1-b71a-9c34c96d1849 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Request method failure captured: Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e HTTP/1.1 Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cGauNLN2agGj9qk0DLlOYMfpqG62ydQc4WJxDsWdvJpZae1ldqHpqwssdxk8vea7nKflHqdLzNVyOZXv9rORlsoM_ktOXd0Fv5GoPpRON8vB-GW8-qZfy9lh7ANhvSzDxRdQdYu82IzZGN-WsefR4M-p4dg2WCmK2wp2D-s-JgPp3M Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 002feda86f414d16b592aa9e3100b510 Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-VolumesSnapshotTestJSON-702367403 Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 23:04:11.516762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 23:04:11.518242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/002feda86f414d16b592aa9e3100b510"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_002feda86f414d16b592aa9e3100b510", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/002feda86f414d16b592aa9e3100b510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/002feda86f414d16b592aa9e3100b510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:04:11.518242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-VolumesSnapshotTestJSON-702367403 Jul 27 23:04:11.518242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 002feda86f414d16b592aa9e3100b510 Jul 27 23:04:11.518242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-702367403 Jul 27 23:04:11.518242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-VolumesSnapshotTestJSON-702367403-project Jul 27 23:04:11.518242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 23:04:11.518242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 23:04:11.518242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 325eac13d04548138b3d541fb4740c4c Jul 27 23:04:11.518242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-VolumesSnapshotTestJSON-702367403-project Jul 27 23:04:11.518242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a6d6e5eb-3a23-47c7-829e-19d08f719469) Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'server_id': 'b19fab65-5354-4383-ba3a-9eb6614382ff', 'id': '128d5bc5-a8f4-4e84-afd1-2109d321af1e'} Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 23:04:11.519079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a6d6e5eb-3a23-47c7-829e-19d08f719469) Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:04:11.520126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a6d6e5eb-3a23-47c7-829e-19d08f719469) Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.521278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a6d6e5eb-3a23-47c7-829e-19d08f719469) Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:04:11.522275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a6d6e5eb-3a23-47c7-829e-19d08f719469) Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a6d6e5eb-3a23-47c7-829e-19d08f719469) Jul 27 23:04:11.523382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.524415 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-08508713-b37f-4fe1-b71a-9c34c96d1849 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a6d6e5eb-3a23-47c7-829e-19d08f719469) {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:04:11.524415 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-08508713-b37f-4fe1-b71a-9c34c96d1849 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e" status: 400 len: 269 microversion: 2.1 time: 46.417167 Jul 27 23:04:11.524415 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 878/1932] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 23:03:25 2022] DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e => generated 269 bytes in 46418 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 23:04:11.524985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ad759ce0-e3aa-4037-85f6-696a7f598a6d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:11.525565 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ad759ce0-e3aa-4037-85f6-696a7f598a6d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:11.531555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad759ce0-e3aa-4037-85f6-696a7f598a6d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:11.532006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad759ce0-e3aa-4037-85f6-696a7f598a6d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:11.532798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad759ce0-e3aa-4037-85f6-696a7f598a6d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:11.533231 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad759ce0-e3aa-4037-85f6-696a7f598a6d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:11.546647 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-ad759ce0-e3aa-4037-85f6-696a7f598a6d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] HTTP exception thrown: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ad759ce0-e3aa-4037-85f6-696a7f598a6d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Request method failure captured: Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 HTTP/1.1 Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cDt2jGYGP9avBKREaegGHX8ZTy2kz44enKKjyjO-15MlSubsYLgwLY9qqYsI5NH_p5bx2zZngNKDjFWu0Fetl0ijXLpmmj1jX_OleBvu1IrRI0woihJrHbEuWy7JlTiK66lBuoyBitOum2D6pploo6gdYnfSGwxZ7CPjAJ7dAswEvg Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 23:04:11.548080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 23:04:11.549423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_161af2d8dc8f4aa99d4cc112a89ff674", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:04:11.549423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:04:11.549423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 23:04:11.549423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:04:11.549423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 23:04:11.549423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 23:04:11.549423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 23:04:11.549423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 3aa05eaf07f14de6b6ef97f08e6e5123 Jul 27 23:04:11.549423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 23:04:11.549423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 23:04:11.549423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:04:11.549423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '8f087841-5ab3-42d6-ace3-9288c1ff0059'} Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:04:11.550190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:04:11.551807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.552981 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ad759ce0-e3aa-4037-85f6-696a7f598a6d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Returning 404 to user: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:04:11.553071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-54550017-fe0f-4179-9496-2c70ec02a633 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47879622-9185-4d97-91de-099b5cd09640) Jul 27 23:04:11.553392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ad759ce0-e3aa-4037-85f6-696a7f598a6d tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 404 len: 111 microversion: 2.1 time: 0.029796 Jul 27 23:04:11.553392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 879/1933] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:11 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-54550017-fe0f-4179-9496-2c70ec02a633 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Request method failure captured: Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: DELETE /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments/532a5824-f1bb-4b12-a1fc-36d6c5a8edbd HTTP/1.1 Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cGLTw3e_lXITPw1ax_GwOtw7uKOpTpqZlV5_GBvw-EniHqsOMSzBuL8jxK4Fr8496nJPhBrWAmWx4Gx-QQKELpe4nAUm0BXeEos9_naV4rJY3sdkUXW8L7W_H0hnPCf02L5JiAKXFESkmzSGnIedKhbQOu8UjGbD1SlnUeHb2eJUZI Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 7ecdd80c027f419e93fc7de57dfd70a6 Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-TestMinimumBasicScenario-1503896919 Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:04:11.553593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:04:11.555594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7ecdd80c027f419e93fc7de57dfd70a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7ecdd80c027f419e93fc7de57dfd70a6", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ecdd80c027f419e93fc7de57dfd70a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ecdd80c027f419e93fc7de57dfd70a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:04:11.555594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-TestMinimumBasicScenario-1503896919 Jul 27 23:04:11.555594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 7ecdd80c027f419e93fc7de57dfd70a6 Jul 27 23:04:11.555594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1503896919 Jul 27 23:04:11.555594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-TestMinimumBasicScenario-1503896919-project Jul 27 23:04:11.555594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:04:11.555594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:04:11.555594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 6f834cb4e134470286edcc0f1860f944 Jul 27 23:04:11.555594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-TestMinimumBasicScenario-1503896919-project Jul 27 23:04:11.555594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47879622-9185-4d97-91de-099b5cd09640) Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'server_id': '69a6fc53-bd93-47c4-9413-39ba0e1b6068', 'id': '532a5824-f1bb-4b12-a1fc-36d6c5a8edbd'} Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 23:04:11.556314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47879622-9185-4d97-91de-099b5cd09640) Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:04:11.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47879622-9185-4d97-91de-099b5cd09640) Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.558913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47879622-9185-4d97-91de-099b5cd09640) Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:04:11.560142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47879622-9185-4d97-91de-099b5cd09640) Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47879622-9185-4d97-91de-099b5cd09640) Jul 27 23:04:11.562492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.563809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-54550017-fe0f-4179-9496-2c70ec02a633 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47879622-9185-4d97-91de-099b5cd09640) {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:04:11.563809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-54550017-fe0f-4179-9496-2c70ec02a633 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "DELETE /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments/532a5824-f1bb-4b12-a1fc-36d6c5a8edbd" status: 400 len: 269 microversion: 2.1 time: 0.302470 Jul 27 23:04:11.564047 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f69c1ab4-1b28-47ed-83e4-400c4d8a0bcd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:11.564047 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f69c1ab4-1b28-47ed-83e4-400c4d8a0bcd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:11.564338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1055/1934] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 23:04:11 2022] DELETE /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068/os-volume_attachments/532a5824-f1bb-4b12-a1fc-36d6c5a8edbd => generated 269 bytes in 309 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 23:04:11.564338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-70823386-0772-4071-a970-2a96d5ab7ccb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:11.564706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-70823386-0772-4071-a970-2a96d5ab7ccb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:11.567767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f69c1ab4-1b28-47ed-83e4-400c4d8a0bcd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:11.568218 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f69c1ab4-1b28-47ed-83e4-400c4d8a0bcd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:11.569332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f69c1ab4-1b28-47ed-83e4-400c4d8a0bcd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:11.570386 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f69c1ab4-1b28-47ed-83e4-400c4d8a0bcd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:11.572141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70823386-0772-4071-a970-2a96d5ab7ccb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:11.572141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70823386-0772-4071-a970-2a96d5ab7ccb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:11.572682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70823386-0772-4071-a970-2a96d5ab7ccb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:11.573271 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70823386-0772-4071-a970-2a96d5ab7ccb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:11.634363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f69c1ab4-1b28-47ed-83e4-400c4d8a0bcd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:11.641845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f69c1ab4-1b28-47ed-83e4-400c4d8a0bcd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.090918 Jul 27 23:04:11.642426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 880/1935] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:11 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:11.655933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4d6dcac2-df69-45a6-bebe-a66bf54fcf39 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '.version_select at 0x7f696e951e50>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:11.660197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.objects.instance [None req-70823386-0772-4071-a970-2a96d5ab7ccb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lazy-loading 'services' on Instance uuid b19fab65-5354-4383-ba3a-9eb6614382ff {{(pid=129295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 23:04:11.684779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4d6dcac2-df69-45a6-bebe-a66bf54fcf39 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965918664" status: 202 len: 0 microversion: 2.1 time: 0.032370 Jul 27 23:04:11.685354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 881/1936] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Jul 27 23:04:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965918664 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 23:04:11.732763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-70823386-0772-4071-a970-2a96d5ab7ccb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e57f8fb-ef01-4967-a62d-7d2756e44e57) Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-70823386-0772-4071-a970-2a96d5ab7ccb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Request method failure captured: Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e HTTP/1.1 Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cGauNLN2agGj9qk0DLlOYMfpqG62ydQc4WJxDsWdvJpZae1ldqHpqwssdxk8vea7nKflHqdLzNVyOZXv9rORlsoM_ktOXd0Fv5GoPpRON8vB-GW8-qZfy9lh7ANhvSzDxRdQdYu82IzZGN-WsefR4M-p4dg2WCmK2wp2D-s-JgPp3M Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 002feda86f414d16b592aa9e3100b510 Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-VolumesSnapshotTestJSON-702367403 Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:04:11.734967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:04:11.736501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/002feda86f414d16b592aa9e3100b510"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_002feda86f414d16b592aa9e3100b510", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/002feda86f414d16b592aa9e3100b510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/002feda86f414d16b592aa9e3100b510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:04:11.736501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-VolumesSnapshotTestJSON-702367403 Jul 27 23:04:11.736501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 002feda86f414d16b592aa9e3100b510 Jul 27 23:04:11.736501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-702367403 Jul 27 23:04:11.736501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-VolumesSnapshotTestJSON-702367403-project Jul 27 23:04:11.736501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:04:11.736501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:04:11.736501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 325eac13d04548138b3d541fb4740c4c Jul 27 23:04:11.736501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-VolumesSnapshotTestJSON-702367403-project Jul 27 23:04:11.736501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e57f8fb-ef01-4967-a62d-7d2756e44e57) Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'server_id': 'b19fab65-5354-4383-ba3a-9eb6614382ff', 'id': '128d5bc5-a8f4-4e84-afd1-2109d321af1e'} Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 23:04:11.737270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e57f8fb-ef01-4967-a62d-7d2756e44e57) Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:04:11.738693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e57f8fb-ef01-4967-a62d-7d2756e44e57) Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.739972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e57f8fb-ef01-4967-a62d-7d2756e44e57) Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:04:11.741080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e57f8fb-ef01-4967-a62d-7d2756e44e57) Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e57f8fb-ef01-4967-a62d-7d2756e44e57) Jul 27 23:04:11.742853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:04:11.743960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-70823386-0772-4071-a970-2a96d5ab7ccb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e57f8fb-ef01-4967-a62d-7d2756e44e57) {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:04:11.743960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-70823386-0772-4071-a970-2a96d5ab7ccb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e" status: 400 len: 269 microversion: 2.1 time: 0.176733 Jul 27 23:04:11.743960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1056/1937] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Jul 27 23:04:11 2022] DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff/os-volume_attachments/128d5bc5-a8f4-4e84-afd1-2109d321af1e => generated 269 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 23:04:12.668979 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9d33daca-72f6-400d-a414-24eef6ea5870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:12.669589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9d33daca-72f6-400d-a414-24eef6ea5870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:12.676101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d33daca-72f6-400d-a414-24eef6ea5870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:12.676541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d33daca-72f6-400d-a414-24eef6ea5870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:12.677314 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d33daca-72f6-400d-a414-24eef6ea5870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:12.677742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d33daca-72f6-400d-a414-24eef6ea5870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:12.739789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9d33daca-72f6-400d-a414-24eef6ea5870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:12.747882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9d33daca-72f6-400d-a414-24eef6ea5870 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083272 Jul 27 23:04:12.748462 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 882/1938] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:12 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:13.769048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9c9c1def-4706-4f45-9e6e-98812e61dfa2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:13.769661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9c9c1def-4706-4f45-9e6e-98812e61dfa2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:13.776403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9c9c1def-4706-4f45-9e6e-98812e61dfa2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:13.776949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9c9c1def-4706-4f45-9e6e-98812e61dfa2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:13.777711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9c9c1def-4706-4f45-9e6e-98812e61dfa2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:13.778149 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9c9c1def-4706-4f45-9e6e-98812e61dfa2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:13.837707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9c9c1def-4706-4f45-9e6e-98812e61dfa2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:13.845233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9c9c1def-4706-4f45-9e6e-98812e61dfa2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080645 Jul 27 23:04:13.845803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1057/1939] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:13 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:14.866113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ec138779-acb0-4d7c-959b-dc1ef6573b63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:14.867303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ec138779-acb0-4d7c-959b-dc1ef6573b63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:14.873778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec138779-acb0-4d7c-959b-dc1ef6573b63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:14.874223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec138779-acb0-4d7c-959b-dc1ef6573b63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:14.874981 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec138779-acb0-4d7c-959b-dc1ef6573b63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:14.875411 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec138779-acb0-4d7c-959b-dc1ef6573b63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:14.935606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ec138779-acb0-4d7c-959b-dc1ef6573b63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:14.944013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ec138779-acb0-4d7c-959b-dc1ef6573b63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081687 Jul 27 23:04:14.944765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 883/1940] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:14 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:15.964982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-52e2b93e-0c79-4337-9a32-f38efa9f070b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:15.965624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-52e2b93e-0c79-4337-9a32-f38efa9f070b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:15.972242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52e2b93e-0c79-4337-9a32-f38efa9f070b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:15.972729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52e2b93e-0c79-4337-9a32-f38efa9f070b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:15.973493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52e2b93e-0c79-4337-9a32-f38efa9f070b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:15.973932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52e2b93e-0c79-4337-9a32-f38efa9f070b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:16.034152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-52e2b93e-0c79-4337-9a32-f38efa9f070b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:16.041664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-52e2b93e-0c79-4337-9a32-f38efa9f070b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080547 Jul 27 23:04:16.042212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1058/1941] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:15 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:17.062897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-05b2fc09-4021-4ae5-b61e-f272b1c34088 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:17.063529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-05b2fc09-4021-4ae5-b61e-f272b1c34088 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:17.070621 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05b2fc09-4021-4ae5-b61e-f272b1c34088 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:17.071063 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05b2fc09-4021-4ae5-b61e-f272b1c34088 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:17.071828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05b2fc09-4021-4ae5-b61e-f272b1c34088 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:17.072261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05b2fc09-4021-4ae5-b61e-f272b1c34088 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:17.132435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-05b2fc09-4021-4ae5-b61e-f272b1c34088 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:17.139850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-05b2fc09-4021-4ae5-b61e-f272b1c34088 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080807 Jul 27 23:04:17.140404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 884/1942] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:17 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:18.161328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bd275458-8f2b-4a4b-8a55-7b2b437c8f4d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:18.161970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bd275458-8f2b-4a4b-8a55-7b2b437c8f4d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:18.169152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd275458-8f2b-4a4b-8a55-7b2b437c8f4d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:18.169596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd275458-8f2b-4a4b-8a55-7b2b437c8f4d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:18.170354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd275458-8f2b-4a4b-8a55-7b2b437c8f4d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:18.170788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd275458-8f2b-4a4b-8a55-7b2b437c8f4d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:18.233637 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bd275458-8f2b-4a4b-8a55-7b2b437c8f4d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:18.241894 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bd275458-8f2b-4a4b-8a55-7b2b437c8f4d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084331 Jul 27 23:04:18.242458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1059/1943] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:18 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:19.263297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0739b3db-5119-4b9d-a83b-b11608326798 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:19.263823 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0739b3db-5119-4b9d-a83b-b11608326798 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:19.270148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0739b3db-5119-4b9d-a83b-b11608326798 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:19.270585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0739b3db-5119-4b9d-a83b-b11608326798 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:19.271340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0739b3db-5119-4b9d-a83b-b11608326798 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:19.271763 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0739b3db-5119-4b9d-a83b-b11608326798 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:19.335541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0739b3db-5119-4b9d-a83b-b11608326798 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:19.345183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0739b3db-5119-4b9d-a83b-b11608326798 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.086717 Jul 27 23:04:19.345759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 885/1944] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:19 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:20.366923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cc755fe1-3f80-4071-ab99-27c964173956 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:20.367681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cc755fe1-3f80-4071-ab99-27c964173956 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:20.374123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cc755fe1-3f80-4071-ab99-27c964173956 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:20.374563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cc755fe1-3f80-4071-ab99-27c964173956 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:20.375311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cc755fe1-3f80-4071-ab99-27c964173956 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:20.375737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cc755fe1-3f80-4071-ab99-27c964173956 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:20.435061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cc755fe1-3f80-4071-ab99-27c964173956 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:20.442382 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cc755fe1-3f80-4071-ab99-27c964173956 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079799 Jul 27 23:04:20.442919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1060/1945] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:20 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:21.377738 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:04:21.378265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:04:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:04:21.463193 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-51b9fde7-226f-489b-ac34-9ff60a2d93d8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:21.463732 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-51b9fde7-226f-489b-ac34-9ff60a2d93d8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:21.470383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51b9fde7-226f-489b-ac34-9ff60a2d93d8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:21.470825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51b9fde7-226f-489b-ac34-9ff60a2d93d8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:21.471582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51b9fde7-226f-489b-ac34-9ff60a2d93d8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:21.472013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51b9fde7-226f-489b-ac34-9ff60a2d93d8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:21.531814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-51b9fde7-226f-489b-ac34-9ff60a2d93d8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:21.539295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-51b9fde7-226f-489b-ac34-9ff60a2d93d8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080682 Jul 27 23:04:21.539846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 886/1946] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:21 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:22.559241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f73ee2fc-7f7c-406b-9602-f810ff52b817 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:22.559848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f73ee2fc-7f7c-406b-9602-f810ff52b817 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:22.566400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f73ee2fc-7f7c-406b-9602-f810ff52b817 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:22.566842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f73ee2fc-7f7c-406b-9602-f810ff52b817 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:22.567588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f73ee2fc-7f7c-406b-9602-f810ff52b817 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:22.568019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f73ee2fc-7f7c-406b-9602-f810ff52b817 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:22.630761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f73ee2fc-7f7c-406b-9602-f810ff52b817 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:22.638911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f73ee2fc-7f7c-406b-9602-f810ff52b817 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083526 Jul 27 23:04:22.639469 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1061/1947] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:22 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:23.659152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fb30e800-67d6-4eda-84a3-77b6febe9bf4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:23.659770 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fb30e800-67d6-4eda-84a3-77b6febe9bf4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:23.666832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb30e800-67d6-4eda-84a3-77b6febe9bf4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:23.667284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb30e800-67d6-4eda-84a3-77b6febe9bf4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:23.668047 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb30e800-67d6-4eda-84a3-77b6febe9bf4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:23.668492 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb30e800-67d6-4eda-84a3-77b6febe9bf4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:23.728001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fb30e800-67d6-4eda-84a3-77b6febe9bf4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:23.735686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fb30e800-67d6-4eda-84a3-77b6febe9bf4 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080391 Jul 27 23:04:23.736240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 887/1948] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:23 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:24.755960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2b4ae0b8-a792-4bee-98b9-b2078e543b03 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:24.756580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2b4ae0b8-a792-4bee-98b9-b2078e543b03 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:24.763125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b4ae0b8-a792-4bee-98b9-b2078e543b03 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:24.763570 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b4ae0b8-a792-4bee-98b9-b2078e543b03 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:24.764320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b4ae0b8-a792-4bee-98b9-b2078e543b03 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:24.764786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b4ae0b8-a792-4bee-98b9-b2078e543b03 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:24.933104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2b4ae0b8-a792-4bee-98b9-b2078e543b03 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:24.941040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2b4ae0b8-a792-4bee-98b9-b2078e543b03 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.188819 Jul 27 23:04:24.941599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1062/1949] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:24 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:25.961610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1e2398d9-c5b1-4dbd-bf28-42ccf75ebc68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:25.962224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1e2398d9-c5b1-4dbd-bf28-42ccf75ebc68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:25.968771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1e2398d9-c5b1-4dbd-bf28-42ccf75ebc68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:25.969214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1e2398d9-c5b1-4dbd-bf28-42ccf75ebc68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:25.969961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1e2398d9-c5b1-4dbd-bf28-42ccf75ebc68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:25.970392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1e2398d9-c5b1-4dbd-bf28-42ccf75ebc68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:26.036288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1e2398d9-c5b1-4dbd-bf28-42ccf75ebc68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:26.044370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1e2398d9-c5b1-4dbd-bf28-42ccf75ebc68 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.086575 Jul 27 23:04:26.044975 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 888/1950] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:25 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:27.065498 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e05e1725-81cb-4fbb-ba3f-466553bbfc0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:27.066225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e05e1725-81cb-4fbb-ba3f-466553bbfc0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:27.073201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e05e1725-81cb-4fbb-ba3f-466553bbfc0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:27.073647 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e05e1725-81cb-4fbb-ba3f-466553bbfc0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:27.074398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e05e1725-81cb-4fbb-ba3f-466553bbfc0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:27.074829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e05e1725-81cb-4fbb-ba3f-466553bbfc0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:27.138503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e05e1725-81cb-4fbb-ba3f-466553bbfc0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:27.145979 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e05e1725-81cb-4fbb-ba3f-466553bbfc0b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084326 Jul 27 23:04:27.146537 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1063/1951] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:27 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:28.168926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c95efb20-31bf-4ff8-a3ad-c79ba525f1bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:28.169533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c95efb20-31bf-4ff8-a3ad-c79ba525f1bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:28.176083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c95efb20-31bf-4ff8-a3ad-c79ba525f1bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:28.176521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c95efb20-31bf-4ff8-a3ad-c79ba525f1bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:28.177299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c95efb20-31bf-4ff8-a3ad-c79ba525f1bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:28.177732 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c95efb20-31bf-4ff8-a3ad-c79ba525f1bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:28.238071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c95efb20-31bf-4ff8-a3ad-c79ba525f1bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:28.245559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c95efb20-31bf-4ff8-a3ad-c79ba525f1bc tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082925 Jul 27 23:04:28.246109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 889/1952] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:28 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:29.266859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bce55e1a-89b8-4756-8661-c83fba5c836c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:29.267379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bce55e1a-89b8-4756-8661-c83fba5c836c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:29.273928 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bce55e1a-89b8-4756-8661-c83fba5c836c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:29.274370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bce55e1a-89b8-4756-8661-c83fba5c836c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:29.275122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bce55e1a-89b8-4756-8661-c83fba5c836c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:29.275554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bce55e1a-89b8-4756-8661-c83fba5c836c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:29.335590 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bce55e1a-89b8-4756-8661-c83fba5c836c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:29.342880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bce55e1a-89b8-4756-8661-c83fba5c836c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079936 Jul 27 23:04:29.343433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1064/1953] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:29 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:30.364128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-285e3a9e-c1f2-48ba-a86e-030110c0d379 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:30.364767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-285e3a9e-c1f2-48ba-a86e-030110c0d379 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:30.372883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-285e3a9e-c1f2-48ba-a86e-030110c0d379 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:30.373341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-285e3a9e-c1f2-48ba-a86e-030110c0d379 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:30.374099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-285e3a9e-c1f2-48ba-a86e-030110c0d379 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:30.374526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-285e3a9e-c1f2-48ba-a86e-030110c0d379 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:30.434355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-285e3a9e-c1f2-48ba-a86e-030110c0d379 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:30.441663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-285e3a9e-c1f2-48ba-a86e-030110c0d379 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081384 Jul 27 23:04:30.442213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 890/1954] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:30 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:31.462482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a3636ace-6bd9-4d0a-9231-d571265fef05 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:31.463013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a3636ace-6bd9-4d0a-9231-d571265fef05 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:31.469427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a3636ace-6bd9-4d0a-9231-d571265fef05 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:31.469870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a3636ace-6bd9-4d0a-9231-d571265fef05 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:31.470626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a3636ace-6bd9-4d0a-9231-d571265fef05 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:31.471056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a3636ace-6bd9-4d0a-9231-d571265fef05 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:31.532929 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a3636ace-6bd9-4d0a-9231-d571265fef05 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:31.540866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a3636ace-6bd9-4d0a-9231-d571265fef05 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082355 Jul 27 23:04:31.541414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1065/1955] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:31 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:32.562078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3d8ff1cc-1224-4fa5-aab5-f69559323426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:32.562683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3d8ff1cc-1224-4fa5-aab5-f69559323426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:32.569107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d8ff1cc-1224-4fa5-aab5-f69559323426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:32.570127 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d8ff1cc-1224-4fa5-aab5-f69559323426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:32.570877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d8ff1cc-1224-4fa5-aab5-f69559323426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:32.571302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d8ff1cc-1224-4fa5-aab5-f69559323426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:32.630517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3d8ff1cc-1224-4fa5-aab5-f69559323426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:32.638658 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3d8ff1cc-1224-4fa5-aab5-f69559323426 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080492 Jul 27 23:04:32.639221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 891/1956] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:32 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:33.659166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-386d530d-ad80-42be-9180-06a3ccc14ed5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:33.659766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-386d530d-ad80-42be-9180-06a3ccc14ed5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:33.662046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=23 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:33.667324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-386d530d-ad80-42be-9180-06a3ccc14ed5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:33.667765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-386d530d-ad80-42be-9180-06a3ccc14ed5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:33.668511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-386d530d-ad80-42be-9180-06a3ccc14ed5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:33.668965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-386d530d-ad80-42be-9180-06a3ccc14ed5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:33.728391 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-386d530d-ad80-42be-9180-06a3ccc14ed5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:33.736012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-386d530d-ad80-42be-9180-06a3ccc14ed5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080663 Jul 27 23:04:33.736571 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1066/1957] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:33 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:34.758319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3cb35f93-a895-47fb-b75a-ab2c71e35533 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:34.758932 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3cb35f93-a895-47fb-b75a-ab2c71e35533 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:34.765406 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3cb35f93-a895-47fb-b75a-ab2c71e35533 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:34.765852 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3cb35f93-a895-47fb-b75a-ab2c71e35533 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:34.766617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3cb35f93-a895-47fb-b75a-ab2c71e35533 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:34.767051 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3cb35f93-a895-47fb-b75a-ab2c71e35533 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:34.827818 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3cb35f93-a895-47fb-b75a-ab2c71e35533 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:34.835345 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3cb35f93-a895-47fb-b75a-ab2c71e35533 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081474 Jul 27 23:04:34.835904 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 892/1958] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:34 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:35.856250 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-eda67db9-b326-457e-b11b-ea4253b8310e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:35.856916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-eda67db9-b326-457e-b11b-ea4253b8310e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:35.863362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eda67db9-b326-457e-b11b-ea4253b8310e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:35.864047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eda67db9-b326-457e-b11b-ea4253b8310e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:35.864569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eda67db9-b326-457e-b11b-ea4253b8310e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:35.865025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eda67db9-b326-457e-b11b-ea4253b8310e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:35.868156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=77 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:35.931196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eda67db9-b326-457e-b11b-ea4253b8310e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:35.938644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-eda67db9-b326-457e-b11b-ea4253b8310e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.086435 Jul 27 23:04:35.939208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1067/1959] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:35 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:36.959062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-56ca1de3-c3c0-432c-8d9b-e103a304b53d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:36.959671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-56ca1de3-c3c0-432c-8d9b-e103a304b53d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:36.961998 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:36.967585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-56ca1de3-c3c0-432c-8d9b-e103a304b53d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:36.968029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-56ca1de3-c3c0-432c-8d9b-e103a304b53d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:36.968807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-56ca1de3-c3c0-432c-8d9b-e103a304b53d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:36.969238 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-56ca1de3-c3c0-432c-8d9b-e103a304b53d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:36.972772 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=79 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:37.031788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-56ca1de3-c3c0-432c-8d9b-e103a304b53d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:37.039138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-56ca1de3-c3c0-432c-8d9b-e103a304b53d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083943 Jul 27 23:04:37.039690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 893/1960] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:36 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:38.059245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ab6c2af2-6ce8-412c-86f3-79ecd5b19235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:38.059853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ab6c2af2-6ce8-412c-86f3-79ecd5b19235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:38.066299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ab6c2af2-6ce8-412c-86f3-79ecd5b19235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:38.066738 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ab6c2af2-6ce8-412c-86f3-79ecd5b19235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:38.067481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ab6c2af2-6ce8-412c-86f3-79ecd5b19235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:38.067908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ab6c2af2-6ce8-412c-86f3-79ecd5b19235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:38.127804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ab6c2af2-6ce8-412c-86f3-79ecd5b19235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:38.135133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ab6c2af2-6ce8-412c-86f3-79ecd5b19235 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079695 Jul 27 23:04:38.135684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1068/1961] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:38 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:39.155137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-86d1a160-f576-4050-8564-b01ba172f6a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:39.155739 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-86d1a160-f576-4050-8564-b01ba172f6a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:39.162331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86d1a160-f576-4050-8564-b01ba172f6a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:39.162776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86d1a160-f576-4050-8564-b01ba172f6a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:39.163953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86d1a160-f576-4050-8564-b01ba172f6a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:39.164676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86d1a160-f576-4050-8564-b01ba172f6a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:39.223956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-86d1a160-f576-4050-8564-b01ba172f6a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:39.231539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-86d1a160-f576-4050-8564-b01ba172f6a8 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080268 Jul 27 23:04:39.232092 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 894/1962] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:39 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:40.252702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4211dbc6-c095-4a72-9c41-e166d9c7b17b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:40.253315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4211dbc6-c095-4a72-9c41-e166d9c7b17b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:40.259853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4211dbc6-c095-4a72-9c41-e166d9c7b17b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:40.260294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4211dbc6-c095-4a72-9c41-e166d9c7b17b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:40.261075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4211dbc6-c095-4a72-9c41-e166d9c7b17b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:40.261505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4211dbc6-c095-4a72-9c41-e166d9c7b17b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:40.324885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4211dbc6-c095-4a72-9c41-e166d9c7b17b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:40.332193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4211dbc6-c095-4a72-9c41-e166d9c7b17b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083339 Jul 27 23:04:40.332779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1069/1963] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:40 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:41.353575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-828b0b1e-174b-46ad-9fab-b2d7537ead30 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:41.354183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-828b0b1e-174b-46ad-9fab-b2d7537ead30 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:41.360975 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-828b0b1e-174b-46ad-9fab-b2d7537ead30 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:41.361421 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-828b0b1e-174b-46ad-9fab-b2d7537ead30 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:41.362205 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-828b0b1e-174b-46ad-9fab-b2d7537ead30 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:41.362641 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-828b0b1e-174b-46ad-9fab-b2d7537ead30 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:41.422423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-828b0b1e-174b-46ad-9fab-b2d7537ead30 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:41.429892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-828b0b1e-174b-46ad-9fab-b2d7537ead30 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080995 Jul 27 23:04:41.430456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 895/1964] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:41 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:42.451112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d6495aab-dd60-477b-b044-99a40445b109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:42.451668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d6495aab-dd60-477b-b044-99a40445b109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:42.457586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d6495aab-dd60-477b-b044-99a40445b109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:42.458027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d6495aab-dd60-477b-b044-99a40445b109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:42.458768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d6495aab-dd60-477b-b044-99a40445b109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:42.459197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d6495aab-dd60-477b-b044-99a40445b109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:42.518493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d6495aab-dd60-477b-b044-99a40445b109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:42.526484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d6495aab-dd60-477b-b044-99a40445b109 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079508 Jul 27 23:04:42.527030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1070/1965] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:42 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:43.547490 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-97131937-df2c-4f91-bd4d-aa321994bcfd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:43.548113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-97131937-df2c-4f91-bd4d-aa321994bcfd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:43.554825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97131937-df2c-4f91-bd4d-aa321994bcfd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:43.555282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97131937-df2c-4f91-bd4d-aa321994bcfd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:43.556039 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97131937-df2c-4f91-bd4d-aa321994bcfd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:43.556471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97131937-df2c-4f91-bd4d-aa321994bcfd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:43.616796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-97131937-df2c-4f91-bd4d-aa321994bcfd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:43.624270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-97131937-df2c-4f91-bd4d-aa321994bcfd tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080666 Jul 27 23:04:43.624878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 896/1966] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:43 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:44.645676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e27193a8-8f0f-4a16-b361-ce6443da5883 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:44.646283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e27193a8-8f0f-4a16-b361-ce6443da5883 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:44.652741 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e27193a8-8f0f-4a16-b361-ce6443da5883 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:44.653185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e27193a8-8f0f-4a16-b361-ce6443da5883 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:44.653964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e27193a8-8f0f-4a16-b361-ce6443da5883 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:44.654395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e27193a8-8f0f-4a16-b361-ce6443da5883 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:44.717033 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e27193a8-8f0f-4a16-b361-ce6443da5883 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:44.724390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e27193a8-8f0f-4a16-b361-ce6443da5883 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082579 Jul 27 23:04:44.724989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1071/1967] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:44 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:45.745894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-67fcc5d6-c832-449f-a40c-449e12d98b4e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:45.746428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-67fcc5d6-c832-449f-a40c-449e12d98b4e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:45.752833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67fcc5d6-c832-449f-a40c-449e12d98b4e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:45.753271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67fcc5d6-c832-449f-a40c-449e12d98b4e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:45.754023 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67fcc5d6-c832-449f-a40c-449e12d98b4e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:45.754448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67fcc5d6-c832-449f-a40c-449e12d98b4e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:45.814489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-67fcc5d6-c832-449f-a40c-449e12d98b4e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:45.822378 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-67fcc5d6-c832-449f-a40c-449e12d98b4e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080426 Jul 27 23:04:45.822938 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 897/1968] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:45 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:46.843537 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7066ac68-ac83-4c05-a0df-49c97af62435 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:46.844145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7066ac68-ac83-4c05-a0df-49c97af62435 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:46.851221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7066ac68-ac83-4c05-a0df-49c97af62435 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:46.851671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7066ac68-ac83-4c05-a0df-49c97af62435 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:46.852425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7066ac68-ac83-4c05-a0df-49c97af62435 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:46.852883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7066ac68-ac83-4c05-a0df-49c97af62435 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:46.914586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7066ac68-ac83-4c05-a0df-49c97af62435 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:46.921962 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7066ac68-ac83-4c05-a0df-49c97af62435 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082280 Jul 27 23:04:46.922519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1072/1969] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:46 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:47.942526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a8936bbf-f7d7-41ac-b34d-b421df4cceb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:47.943126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a8936bbf-f7d7-41ac-b34d-b421df4cceb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:47.949544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8936bbf-f7d7-41ac-b34d-b421df4cceb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:47.949986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8936bbf-f7d7-41ac-b34d-b421df4cceb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:47.950741 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8936bbf-f7d7-41ac-b34d-b421df4cceb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:47.951170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8936bbf-f7d7-41ac-b34d-b421df4cceb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:48.013128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a8936bbf-f7d7-41ac-b34d-b421df4cceb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:48.020580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a8936bbf-f7d7-41ac-b34d-b421df4cceb2 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081858 Jul 27 23:04:48.021123 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 898/1970] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:47 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:49.041081 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dbb610f0-618a-4aae-aa63-06ca5c85aea9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:49.041696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dbb610f0-618a-4aae-aa63-06ca5c85aea9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:49.048235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dbb610f0-618a-4aae-aa63-06ca5c85aea9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:49.048727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dbb610f0-618a-4aae-aa63-06ca5c85aea9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:49.049473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dbb610f0-618a-4aae-aa63-06ca5c85aea9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:49.049903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dbb610f0-618a-4aae-aa63-06ca5c85aea9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:49.112419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dbb610f0-618a-4aae-aa63-06ca5c85aea9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:49.120504 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dbb610f0-618a-4aae-aa63-06ca5c85aea9 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083261 Jul 27 23:04:49.121098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1073/1971] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:49 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:50.141771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b218e03a-6fb1-43f5-b85e-0a0ae4425317 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:50.142316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b218e03a-6fb1-43f5-b85e-0a0ae4425317 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:50.148612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b218e03a-6fb1-43f5-b85e-0a0ae4425317 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:50.149050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b218e03a-6fb1-43f5-b85e-0a0ae4425317 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:50.149800 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b218e03a-6fb1-43f5-b85e-0a0ae4425317 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:50.150224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b218e03a-6fb1-43f5-b85e-0a0ae4425317 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:50.209407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b218e03a-6fb1-43f5-b85e-0a0ae4425317 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:50.216688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b218e03a-6fb1-43f5-b85e-0a0ae4425317 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078849 Jul 27 23:04:50.217235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 899/1972] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:50 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:51.237980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0b38a7a4-fb1b-4bb5-a933-db3becd84c64 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:51.238583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0b38a7a4-fb1b-4bb5-a933-db3becd84c64 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:51.245563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0b38a7a4-fb1b-4bb5-a933-db3becd84c64 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:51.246005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0b38a7a4-fb1b-4bb5-a933-db3becd84c64 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:51.246749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0b38a7a4-fb1b-4bb5-a933-db3becd84c64 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:51.247175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0b38a7a4-fb1b-4bb5-a933-db3becd84c64 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:51.306285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0b38a7a4-fb1b-4bb5-a933-db3becd84c64 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:51.313572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0b38a7a4-fb1b-4bb5-a933-db3becd84c64 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079441 Jul 27 23:04:51.314120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1074/1973] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:51 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:52.336062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e9a24c84-0156-4e65-a7f7-d3bd3c98c340 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:52.336824 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e9a24c84-0156-4e65-a7f7-d3bd3c98c340 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:52.343271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e9a24c84-0156-4e65-a7f7-d3bd3c98c340 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:52.343714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e9a24c84-0156-4e65-a7f7-d3bd3c98c340 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:52.344468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e9a24c84-0156-4e65-a7f7-d3bd3c98c340 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:52.344928 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e9a24c84-0156-4e65-a7f7-d3bd3c98c340 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:52.404341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e9a24c84-0156-4e65-a7f7-d3bd3c98c340 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:52.411638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e9a24c84-0156-4e65-a7f7-d3bd3c98c340 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080477 Jul 27 23:04:52.412193 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 900/1974] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:52 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:52.833658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:04:52.834087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:04:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:04:53.431110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-573a7df1-cebb-4841-a937-a340014ffd6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:53.431714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-573a7df1-cebb-4841-a937-a340014ffd6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:53.438325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-573a7df1-cebb-4841-a937-a340014ffd6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:53.438768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-573a7df1-cebb-4841-a937-a340014ffd6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:53.439514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-573a7df1-cebb-4841-a937-a340014ffd6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:53.439936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-573a7df1-cebb-4841-a937-a340014ffd6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:53.503278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-573a7df1-cebb-4841-a937-a340014ffd6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:53.510707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-573a7df1-cebb-4841-a937-a340014ffd6f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083431 Jul 27 23:04:53.511255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1075/1975] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:53 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:54.531857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ee5bc0b3-81fd-4638-985e-fcd69101a542 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:54.532407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ee5bc0b3-81fd-4638-985e-fcd69101a542 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:54.539359 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ee5bc0b3-81fd-4638-985e-fcd69101a542 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:54.539796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ee5bc0b3-81fd-4638-985e-fcd69101a542 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:54.540569 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ee5bc0b3-81fd-4638-985e-fcd69101a542 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:54.541025 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ee5bc0b3-81fd-4638-985e-fcd69101a542 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:54.601596 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ee5bc0b3-81fd-4638-985e-fcd69101a542 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:54.609448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ee5bc0b3-81fd-4638-985e-fcd69101a542 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081501 Jul 27 23:04:54.610007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 901/1976] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:54 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:55.630088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4f6ef0cb-f177-4318-9b6b-43716e479a63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:55.630692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4f6ef0cb-f177-4318-9b6b-43716e479a63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:55.637708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4f6ef0cb-f177-4318-9b6b-43716e479a63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:55.638151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4f6ef0cb-f177-4318-9b6b-43716e479a63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:55.638890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4f6ef0cb-f177-4318-9b6b-43716e479a63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:55.639315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4f6ef0cb-f177-4318-9b6b-43716e479a63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:55.701523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4f6ef0cb-f177-4318-9b6b-43716e479a63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:55.708909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4f6ef0cb-f177-4318-9b6b-43716e479a63 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082655 Jul 27 23:04:55.709481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1076/1977] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:55 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:56.729980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9977598e-340c-487a-9939-78b1038dd95d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:56.730536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9977598e-340c-487a-9939-78b1038dd95d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:56.737181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9977598e-340c-487a-9939-78b1038dd95d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:56.737629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9977598e-340c-487a-9939-78b1038dd95d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:56.738389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9977598e-340c-487a-9939-78b1038dd95d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:56.738817 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9977598e-340c-487a-9939-78b1038dd95d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:56.797764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9977598e-340c-487a-9939-78b1038dd95d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:56.805876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9977598e-340c-487a-9939-78b1038dd95d tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079896 Jul 27 23:04:56.806449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 902/1978] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:56 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:57.826568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a082a7a5-1aa1-42be-89e6-1d9e38560e74 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:57.827166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a082a7a5-1aa1-42be-89e6-1d9e38560e74 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:57.833571 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a082a7a5-1aa1-42be-89e6-1d9e38560e74 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:57.834009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a082a7a5-1aa1-42be-89e6-1d9e38560e74 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:57.835352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a082a7a5-1aa1-42be-89e6-1d9e38560e74 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:57.835776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a082a7a5-1aa1-42be-89e6-1d9e38560e74 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:57.898204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a082a7a5-1aa1-42be-89e6-1d9e38560e74 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:57.905562 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a082a7a5-1aa1-42be-89e6-1d9e38560e74 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083121 Jul 27 23:04:57.906115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1077/1979] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:57 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:04:58.926068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9a7dee9f-3446-46cb-8cf1-85e5dbe53967 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:04:58.926732 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9a7dee9f-3446-46cb-8cf1-85e5dbe53967 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:04:58.933085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a7dee9f-3446-46cb-8cf1-85e5dbe53967 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:58.933551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a7dee9f-3446-46cb-8cf1-85e5dbe53967 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:58.934302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a7dee9f-3446-46cb-8cf1-85e5dbe53967 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:04:58.934727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a7dee9f-3446-46cb-8cf1-85e5dbe53967 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:04:58.994056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9a7dee9f-3446-46cb-8cf1-85e5dbe53967 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:04:59.001389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9a7dee9f-3446-46cb-8cf1-85e5dbe53967 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079181 Jul 27 23:04:59.001936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 903/1980] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:04:58 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:00.021275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e4303709-06f7-4ce7-adaa-cb1b9d002d8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:00.021907 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e4303709-06f7-4ce7-adaa-cb1b9d002d8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:00.028398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4303709-06f7-4ce7-adaa-cb1b9d002d8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:00.028868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4303709-06f7-4ce7-adaa-cb1b9d002d8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:00.029614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4303709-06f7-4ce7-adaa-cb1b9d002d8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:00.030042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4303709-06f7-4ce7-adaa-cb1b9d002d8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:00.089667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e4303709-06f7-4ce7-adaa-cb1b9d002d8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:00.096915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e4303709-06f7-4ce7-adaa-cb1b9d002d8c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079449 Jul 27 23:05:00.097470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1078/1981] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:00 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:01.118704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6e65c81f-ec20-4803-b176-b7dc47bd07ed tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:01.119310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6e65c81f-ec20-4803-b176-b7dc47bd07ed tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:01.125873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6e65c81f-ec20-4803-b176-b7dc47bd07ed tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:01.126319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6e65c81f-ec20-4803-b176-b7dc47bd07ed tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:01.127073 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6e65c81f-ec20-4803-b176-b7dc47bd07ed tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:01.127505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6e65c81f-ec20-4803-b176-b7dc47bd07ed tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:01.187279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6e65c81f-ec20-4803-b176-b7dc47bd07ed tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:01.195278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6e65c81f-ec20-4803-b176-b7dc47bd07ed tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081051 Jul 27 23:05:01.195839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 904/1982] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:01 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:02.216200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-36f6ae4e-ae2a-47d1-a85e-a1925699b259 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:02.216837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-36f6ae4e-ae2a-47d1-a85e-a1925699b259 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:02.223389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-36f6ae4e-ae2a-47d1-a85e-a1925699b259 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:02.223832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-36f6ae4e-ae2a-47d1-a85e-a1925699b259 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:02.224601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-36f6ae4e-ae2a-47d1-a85e-a1925699b259 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:02.225034 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-36f6ae4e-ae2a-47d1-a85e-a1925699b259 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:02.287301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-36f6ae4e-ae2a-47d1-a85e-a1925699b259 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:02.294612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-36f6ae4e-ae2a-47d1-a85e-a1925699b259 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082232 Jul 27 23:05:02.295163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1079/1983] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:02 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:03.314912 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-50c370b8-9bc0-41fc-8ad4-734b4f49b122 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:03.315515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-50c370b8-9bc0-41fc-8ad4-734b4f49b122 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:03.321899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50c370b8-9bc0-41fc-8ad4-734b4f49b122 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:03.322374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50c370b8-9bc0-41fc-8ad4-734b4f49b122 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:03.323124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50c370b8-9bc0-41fc-8ad4-734b4f49b122 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:03.323550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50c370b8-9bc0-41fc-8ad4-734b4f49b122 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:03.384813 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-50c370b8-9bc0-41fc-8ad4-734b4f49b122 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:03.392219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-50c370b8-9bc0-41fc-8ad4-734b4f49b122 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081139 Jul 27 23:05:03.392804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 905/1984] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:03 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:04.413802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-82c03001-9f3f-4259-a77a-7c09c61f3bb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:04.414322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-82c03001-9f3f-4259-a77a-7c09c61f3bb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:04.416640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=28 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:04.422214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82c03001-9f3f-4259-a77a-7c09c61f3bb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:04.422655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82c03001-9f3f-4259-a77a-7c09c61f3bb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:04.423402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82c03001-9f3f-4259-a77a-7c09c61f3bb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:04.423827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82c03001-9f3f-4259-a77a-7c09c61f3bb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:04.489920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-82c03001-9f3f-4259-a77a-7c09c61f3bb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:04.498051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-82c03001-9f3f-4259-a77a-7c09c61f3bb7 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.088634 Jul 27 23:05:04.498617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1080/1985] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:04 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:05.518781 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1c713970-3db3-4ffe-8f2c-3cdf336b9748 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:05.519324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1c713970-3db3-4ffe-8f2c-3cdf336b9748 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:05.525805 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c713970-3db3-4ffe-8f2c-3cdf336b9748 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:05.526264 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c713970-3db3-4ffe-8f2c-3cdf336b9748 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:05.527011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c713970-3db3-4ffe-8f2c-3cdf336b9748 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:05.527444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c713970-3db3-4ffe-8f2c-3cdf336b9748 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:05.586878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1c713970-3db3-4ffe-8f2c-3cdf336b9748 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:05.594155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1c713970-3db3-4ffe-8f2c-3cdf336b9748 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079387 Jul 27 23:05:05.594718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 906/1986] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:05 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:06.613937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-66b93fb4-0587-422f-ba22-5d91805dd02e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:06.614549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-66b93fb4-0587-422f-ba22-5d91805dd02e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:06.621032 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66b93fb4-0587-422f-ba22-5d91805dd02e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:06.621482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66b93fb4-0587-422f-ba22-5d91805dd02e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:06.622243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66b93fb4-0587-422f-ba22-5d91805dd02e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:06.622679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66b93fb4-0587-422f-ba22-5d91805dd02e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:06.626564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=84 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:06.686839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-66b93fb4-0587-422f-ba22-5d91805dd02e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:06.694871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-66b93fb4-0587-422f-ba22-5d91805dd02e tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.084741 Jul 27 23:05:06.695432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1081/1987] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:06 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:07.715867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-11d62968-fcab-4ebf-9cb7-13cc1c306413 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:07.716511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-11d62968-fcab-4ebf-9cb7-13cc1c306413 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:07.718999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=28 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:07.724421 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-11d62968-fcab-4ebf-9cb7-13cc1c306413 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:07.724892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-11d62968-fcab-4ebf-9cb7-13cc1c306413 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:07.725646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-11d62968-fcab-4ebf-9cb7-13cc1c306413 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:07.726071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-11d62968-fcab-4ebf-9cb7-13cc1c306413 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:07.728726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=84 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:07.787499 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-11d62968-fcab-4ebf-9cb7-13cc1c306413 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:07.794968 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-11d62968-fcab-4ebf-9cb7-13cc1c306413 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083092 Jul 27 23:05:07.795516 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 907/1988] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:07 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:08.815777 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-71190420-9ec4-4ee9-8bbd-0bcae71b370f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:08.816359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-71190420-9ec4-4ee9-8bbd-0bcae71b370f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:08.822783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-71190420-9ec4-4ee9-8bbd-0bcae71b370f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:08.823225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-71190420-9ec4-4ee9-8bbd-0bcae71b370f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:08.823966 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-71190420-9ec4-4ee9-8bbd-0bcae71b370f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:08.824391 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-71190420-9ec4-4ee9-8bbd-0bcae71b370f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:08.887079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-71190420-9ec4-4ee9-8bbd-0bcae71b370f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:08.894422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-71190420-9ec4-4ee9-8bbd-0bcae71b370f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082458 Jul 27 23:05:08.894981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1082/1989] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:08 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:09.915317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-55394b3f-5732-43c1-a023-a03e276eb96f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:09.915920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-55394b3f-5732-43c1-a023-a03e276eb96f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:09.922346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-55394b3f-5732-43c1-a023-a03e276eb96f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:09.922782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-55394b3f-5732-43c1-a023-a03e276eb96f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:09.923524 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-55394b3f-5732-43c1-a023-a03e276eb96f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:09.923950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-55394b3f-5732-43c1-a023-a03e276eb96f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:09.984164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-55394b3f-5732-43c1-a023-a03e276eb96f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:09.991827 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-55394b3f-5732-43c1-a023-a03e276eb96f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080914 Jul 27 23:05:09.992382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 908/1990] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:09 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:11.012160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6bcab2d9-0a6c-4530-9957-f6e01269372f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:11.012806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6bcab2d9-0a6c-4530-9957-f6e01269372f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:11.019271 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bcab2d9-0a6c-4530-9957-f6e01269372f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:11.019709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bcab2d9-0a6c-4530-9957-f6e01269372f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:11.020447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bcab2d9-0a6c-4530-9957-f6e01269372f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:11.020894 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bcab2d9-0a6c-4530-9957-f6e01269372f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:11.081801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6bcab2d9-0a6c-4530-9957-f6e01269372f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:11.089077 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6bcab2d9-0a6c-4530-9957-f6e01269372f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080710 Jul 27 23:05:11.089623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1083/1991] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:11 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:12.110344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-24d6773f-c71d-4509-86fe-07c25b5d6408 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:12.110947 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-24d6773f-c71d-4509-86fe-07c25b5d6408 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:12.118002 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24d6773f-c71d-4509-86fe-07c25b5d6408 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:12.118444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24d6773f-c71d-4509-86fe-07c25b5d6408 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:12.119193 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24d6773f-c71d-4509-86fe-07c25b5d6408 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:12.119617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24d6773f-c71d-4509-86fe-07c25b5d6408 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:12.179444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-24d6773f-c71d-4509-86fe-07c25b5d6408 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:12.186872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-24d6773f-c71d-4509-86fe-07c25b5d6408 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080356 Jul 27 23:05:12.187429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 909/1992] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:12 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:13.208251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b544a682-1771-4937-a065-a1314c82220c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:13.208899 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b544a682-1771-4937-a065-a1314c82220c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:13.215036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b544a682-1771-4937-a065-a1314c82220c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:13.215475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b544a682-1771-4937-a065-a1314c82220c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:13.216218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b544a682-1771-4937-a065-a1314c82220c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:13.216678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b544a682-1771-4937-a065-a1314c82220c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:13.276102 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b544a682-1771-4937-a065-a1314c82220c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:13.283522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b544a682-1771-4937-a065-a1314c82220c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079015 Jul 27 23:05:13.284075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1084/1993] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:13 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:14.304097 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1c256e59-33ae-43a6-940b-de97a67c9b9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:14.304768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1c256e59-33ae-43a6-940b-de97a67c9b9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:14.311330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c256e59-33ae-43a6-940b-de97a67c9b9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:14.311775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c256e59-33ae-43a6-940b-de97a67c9b9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:14.312535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c256e59-33ae-43a6-940b-de97a67c9b9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:14.312992 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c256e59-33ae-43a6-940b-de97a67c9b9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:14.373214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1c256e59-33ae-43a6-940b-de97a67c9b9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:14.380514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1c256e59-33ae-43a6-940b-de97a67c9b9a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080310 Jul 27 23:05:14.381732 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 910/1994] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:14 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:15.401627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dc2acd7a-67ed-4261-9e47-aa1fbbe2818f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:15.402238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dc2acd7a-67ed-4261-9e47-aa1fbbe2818f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:15.408688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc2acd7a-67ed-4261-9e47-aa1fbbe2818f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:15.409137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc2acd7a-67ed-4261-9e47-aa1fbbe2818f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:15.409887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc2acd7a-67ed-4261-9e47-aa1fbbe2818f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:15.410318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc2acd7a-67ed-4261-9e47-aa1fbbe2818f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:15.471995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dc2acd7a-67ed-4261-9e47-aa1fbbe2818f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:15.479864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dc2acd7a-67ed-4261-9e47-aa1fbbe2818f tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082098 Jul 27 23:05:15.480419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1085/1995] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:15 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:16.501511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e00424a1-f994-4d3a-8bba-7bb190d98796 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:16.502062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e00424a1-f994-4d3a-8bba-7bb190d98796 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:16.509070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e00424a1-f994-4d3a-8bba-7bb190d98796 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:16.509502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e00424a1-f994-4d3a-8bba-7bb190d98796 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:16.510259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e00424a1-f994-4d3a-8bba-7bb190d98796 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:16.510687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e00424a1-f994-4d3a-8bba-7bb190d98796 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:16.573516 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e00424a1-f994-4d3a-8bba-7bb190d98796 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:16.581017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e00424a1-f994-4d3a-8bba-7bb190d98796 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083441 Jul 27 23:05:16.581576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 911/1996] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:16 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:17.602053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-57d6a1c5-3439-497d-a8a6-84212c81a866 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:17.602703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-57d6a1c5-3439-497d-a8a6-84212c81a866 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:17.609476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-57d6a1c5-3439-497d-a8a6-84212c81a866 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:17.609926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-57d6a1c5-3439-497d-a8a6-84212c81a866 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:17.610681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-57d6a1c5-3439-497d-a8a6-84212c81a866 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:17.611115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-57d6a1c5-3439-497d-a8a6-84212c81a866 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:17.673062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-57d6a1c5-3439-497d-a8a6-84212c81a866 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:17.681176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-57d6a1c5-3439-497d-a8a6-84212c81a866 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.082958 Jul 27 23:05:17.681737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1086/1997] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:17 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:18.702578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7316bbe3-968c-423f-9c78-33a1e55ede3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:18.703110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7316bbe3-968c-423f-9c78-33a1e55ede3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:18.709176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7316bbe3-968c-423f-9c78-33a1e55ede3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:18.709615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7316bbe3-968c-423f-9c78-33a1e55ede3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:18.710357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7316bbe3-968c-423f-9c78-33a1e55ede3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:18.710782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7316bbe3-968c-423f-9c78-33a1e55ede3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:18.769972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7316bbe3-968c-423f-9c78-33a1e55ede3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:18.777296 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7316bbe3-968c-423f-9c78-33a1e55ede3b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.078630 Jul 27 23:05:18.777845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 912/1998] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:18 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:19.799251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e3ddb558-fd2c-4d42-9555-5733167eb3f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:19.799878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e3ddb558-fd2c-4d42-9555-5733167eb3f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:19.806944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3ddb558-fd2c-4d42-9555-5733167eb3f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:19.807388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3ddb558-fd2c-4d42-9555-5733167eb3f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:19.808144 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3ddb558-fd2c-4d42-9555-5733167eb3f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:19.808594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3ddb558-fd2c-4d42-9555-5733167eb3f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:19.871109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e3ddb558-fd2c-4d42-9555-5733167eb3f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:19.878466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e3ddb558-fd2c-4d42-9555-5733167eb3f5 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.083942 Jul 27 23:05:19.879016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1087/1999] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:19 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:20.899812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ed25c8e3-4ccd-4a24-a417-49dbf6f48762 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:20.900411 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ed25c8e3-4ccd-4a24-a417-49dbf6f48762 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:20.906960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed25c8e3-4ccd-4a24-a417-49dbf6f48762 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:20.907414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed25c8e3-4ccd-4a24-a417-49dbf6f48762 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:20.908177 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed25c8e3-4ccd-4a24-a417-49dbf6f48762 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:20.908639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed25c8e3-4ccd-4a24-a417-49dbf6f48762 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:20.969379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ed25c8e3-4ccd-4a24-a417-49dbf6f48762 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:20.977199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ed25c8e3-4ccd-4a24-a417-49dbf6f48762 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.081630 Jul 27 23:05:20.977780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 913/2000] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:20 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:21.998144 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a61a776f-dfc6-4236-acc5-255538935e23 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:21.998753 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a61a776f-dfc6-4236-acc5-255538935e23 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:22.005383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a61a776f-dfc6-4236-acc5-255538935e23 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:22.005827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a61a776f-dfc6-4236-acc5-255538935e23 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:22.006581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a61a776f-dfc6-4236-acc5-255538935e23 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:22.007016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a61a776f-dfc6-4236-acc5-255538935e23 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:22.066413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a61a776f-dfc6-4236-acc5-255538935e23 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:22.073895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a61a776f-dfc6-4236-acc5-255538935e23 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.079609 Jul 27 23:05:22.074462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1088/2001] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:21 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:23.094867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-54ad1889-7d8f-4417-9e91-dafc1031e531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:23.095478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-54ad1889-7d8f-4417-9e91-dafc1031e531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:23.102558 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54ad1889-7d8f-4417-9e91-dafc1031e531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:23.103028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54ad1889-7d8f-4417-9e91-dafc1031e531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:23.103874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54ad1889-7d8f-4417-9e91-dafc1031e531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:23.104240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54ad1889-7d8f-4417-9e91-dafc1031e531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:23.164260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-54ad1889-7d8f-4417-9e91-dafc1031e531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:23.171805 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-54ad1889-7d8f-4417-9e91-dafc1031e531 tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.080817 Jul 27 23:05:23.172341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 914/2002] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:23 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:24.194016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8fb7912c-7918-4296-9387-ede12ecd967a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:24.194667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8fb7912c-7918-4296-9387-ede12ecd967a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:24.201173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8fb7912c-7918-4296-9387-ede12ecd967a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:24.201624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8fb7912c-7918-4296-9387-ede12ecd967a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:24.202385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8fb7912c-7918-4296-9387-ede12ecd967a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:24.202822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8fb7912c-7918-4296-9387-ede12ecd967a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:24.267065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8fb7912c-7918-4296-9387-ede12ecd967a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:24.274515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8fb7912c-7918-4296-9387-ede12ecd967a tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1226 microversion: 2.1 time: 0.085024 Jul 27 23:05:24.275072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1089/2003] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:24 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:25.295077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4776e3f1-7e32-4e47-a2a1-a4d66dd080ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:25.295688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4776e3f1-7e32-4e47-a2a1-a4d66dd080ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:25.302048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4776e3f1-7e32-4e47-a2a1-a4d66dd080ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:25.302493 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4776e3f1-7e32-4e47-a2a1-a4d66dd080ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:25.303253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4776e3f1-7e32-4e47-a2a1-a4d66dd080ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:25.303683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4776e3f1-7e32-4e47-a2a1-a4d66dd080ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:25.333991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4776e3f1-7e32-4e47-a2a1-a4d66dd080ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:25.334970 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4776e3f1-7e32-4e47-a2a1-a4d66dd080ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:25.335417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.objects.instance [None req-4776e3f1-7e32-4e47-a2a1-a4d66dd080ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lazy-loading 'fault' on Instance uuid d13f7184-9f3c-4be1-858c-c9bae2a28713 {{(pid=129294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 23:05:25.375891 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4776e3f1-7e32-4e47-a2a1-a4d66dd080ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0ac767fd754bdeb5307a1a234607e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df7953219954eeeb7279f310cdea955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:05:25.384121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4776e3f1-7e32-4e47-a2a1-a4d66dd080ac tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 200 len: 1231 microversion: 2.1 time: 0.093139 Jul 27 23:05:25.384717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 915/2004] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:25 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 1231 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:05:26.405737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-556ddc62-8262-4510-8ed5-87082b1a0f9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:05:26.406351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-556ddc62-8262-4510-8ed5-87082b1a0f9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] [instance: d13f7184-9f3c-4be1-858c-c9bae2a28713] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:05:26.413499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-556ddc62-8262-4510-8ed5-87082b1a0f9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:26.413889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-556ddc62-8262-4510-8ed5-87082b1a0f9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:26.414645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-556ddc62-8262-4510-8ed5-87082b1a0f9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:05:26.415081 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-556ddc62-8262-4510-8ed5-87082b1a0f9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:05:26.427957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-556ddc62-8262-4510-8ed5-87082b1a0f9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] HTTP exception thrown: Instance d13f7184-9f3c-4be1-858c-c9bae2a28713 could not be found. Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-556ddc62-8262-4510-8ed5-87082b1a0f9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Request method failure captured: Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 HTTP/1.1 Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cGmaUH-UJxPuK1uFJKFZqMZ7mV6qgghvmtmg9hc4Wy49hsShowk7RDHd3JsoI3RQXJbgrwJC5Tkb5mC-3GnKQGuSFiXwjecEYm4LkrLky42Eql4V1jiMbMv5IBZeW8ZukWe2qfpydJSWj_Nl1232bzYrVT7l6fx2j9-EtPbtlW7hO4 Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 8df7953219954eeeb7279f310cdea955 Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-TestVolumeBootPattern-48669183 Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:05:26.429484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:05:26.431200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8df7953219954eeeb7279f310cdea955"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8df7953219954eeeb7279f310cdea955", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8df7953219954eeeb7279f310cdea955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8df7953219954eeeb7279f310cdea955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:05:26.431200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-TestVolumeBootPattern-48669183 Jul 27 23:05:26.431200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 8df7953219954eeeb7279f310cdea955 Jul 27 23:05:26.431200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-TestVolumeBootPattern-48669183 Jul 27 23:05:26.431200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-TestVolumeBootPattern-48669183-project Jul 27 23:05:26.431200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:05:26.431200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:05:26.431200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: fa0ac767fd754bdeb5307a1a234607e7 Jul 27 23:05:26.431200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-TestVolumeBootPattern-48669183-project Jul 27 23:05:26.431200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:05:26.431200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance d13f7184-9f3c-4be1-858c-c9bae2a28713 could not be found. Jul 27 23:05:26.431200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': 'd13f7184-9f3c-4be1-858c-c9bae2a28713'} Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13f7184-9f3c-4be1-858c-c9bae2a28713 could not be found. Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:05:26.432136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13f7184-9f3c-4be1-858c-c9bae2a28713 could not be found. Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13f7184-9f3c-4be1-858c-c9bae2a28713 could not be found. Jul 27 23:05:26.433698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:05:26.435091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-556ddc62-8262-4510-8ed5-87082b1a0f9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Returning 404 to user: Instance d13f7184-9f3c-4be1-858c-c9bae2a28713 could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:05:26.435091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-556ddc62-8262-4510-8ed5-87082b1a0f9b tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713" status: 404 len: 111 microversion: 2.1 time: 0.028977 Jul 27 23:05:26.435091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1090/2005] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:05:26 2022] GET /compute/v2.1/servers/d13f7184-9f3c-4be1-858c-c9bae2a28713 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:06:01.865735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:06:01.866250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:06:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:06:02.142108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:06:02.142644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:06:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:06:11.059804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f25e01a7-9432-486a-8dc2-c45b80271dbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:11.060399 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f25e01a7-9432-486a-8dc2-c45b80271dbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:11.062455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=19 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:06:11.063086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=55 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:06:11.068933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f25e01a7-9432-486a-8dc2-c45b80271dbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:11.069379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f25e01a7-9432-486a-8dc2-c45b80271dbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:11.070140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f25e01a7-9432-486a-8dc2-c45b80271dbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:11.070565 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f25e01a7-9432-486a-8dc2-c45b80271dbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:11.107079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f25e01a7-9432-486a-8dc2-c45b80271dbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Going to try to terminate instance {{(pid=129294) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 23:06:11.164368 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f25e01a7-9432-486a-8dc2-c45b80271dbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [f8399fcd-75f1-4b46-b6cc-1a417ab8f422] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 23:06:12.172012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [None req-f25e01a7-9432-486a-8dc2-c45b80271dbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [f8399fcd-75f1-4b46-b6cc-1a417ab8f422] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 40938. Jul 27 23:06:12.194125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f25e01a7-9432-486a-8dc2-c45b80271dbe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 204 len: 0 microversion: 2.20 time: 1.137964 Jul 27 23:06:12.195595 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 916/2006] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Jul 27 23:06:11 2022] DELETE /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 0 bytes in 1140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 23:06:12.203648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-20d8b75e-689a-40b7-8791-c06290d96735 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:12.204995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-20d8b75e-689a-40b7-8791-c06290d96735 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:12.206487 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=21 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:06:12.207115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=55 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:06:12.212767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20d8b75e-689a-40b7-8791-c06290d96735 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:12.213211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20d8b75e-689a-40b7-8791-c06290d96735 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:12.213966 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20d8b75e-689a-40b7-8791-c06290d96735 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:12.214396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20d8b75e-689a-40b7-8791-c06290d96735 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:12.341537 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-20d8b75e-689a-40b7-8791-c06290d96735 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:12.352361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-20d8b75e-689a-40b7-8791-c06290d96735 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:12.353885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-20d8b75e-689a-40b7-8791-c06290d96735 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:12.355044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-20d8b75e-689a-40b7-8791-c06290d96735 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1800 microversion: 2.20 time: 0.155242 Jul 27 23:06:12.355597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1091/2007] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:13.378657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a9de2377-1ad9-4d6a-80e7-3ec52a1297d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:13.380149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a9de2377-1ad9-4d6a-80e7-3ec52a1297d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:13.388590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9de2377-1ad9-4d6a-80e7-3ec52a1297d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:13.391345 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9de2377-1ad9-4d6a-80e7-3ec52a1297d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:13.392530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9de2377-1ad9-4d6a-80e7-3ec52a1297d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:13.393103 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9de2377-1ad9-4d6a-80e7-3ec52a1297d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:13.479972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a9de2377-1ad9-4d6a-80e7-3ec52a1297d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:13.488694 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a9de2377-1ad9-4d6a-80e7-3ec52a1297d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:13.490198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a9de2377-1ad9-4d6a-80e7-3ec52a1297d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:13.491950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a9de2377-1ad9-4d6a-80e7-3ec52a1297d4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1732 microversion: 2.20 time: 0.117025 Jul 27 23:06:13.492513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 917/2008] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1732 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:13.666251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-893369ec-a0f9-4e34-8783-8b63200b5aba req-6c46f123-86b2-4427-8e4a-d68feefbe03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e457f5fc-ae83-4b88-87be-ba1007c5865e", "name": "network-vif-deleted", "tag": "977e384c-b17c-446d-945e-7c6a9e7c3e88"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:06:13.677076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-893369ec-a0f9-4e34-8783-8b63200b5aba req-6c46f123-86b2-4427-8e4a-d68feefbe03d service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:13.677522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-893369ec-a0f9-4e34-8783-8b63200b5aba req-6c46f123-86b2-4427-8e4a-d68feefbe03d service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:13.689592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-893369ec-a0f9-4e34-8783-8b63200b5aba req-6c46f123-86b2-4427-8e4a-d68feefbe03d service nova] Creating event network-vif-deleted:977e384c-b17c-446d-945e-7c6a9e7c3e88 for instance e457f5fc-ae83-4b88-87be-ba1007c5865e on hv-cinder-85124 Jul 27 23:06:13.695924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-893369ec-a0f9-4e34-8783-8b63200b5aba req-6c46f123-86b2-4427-8e4a-d68feefbe03d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034124 Jul 27 23:06:13.696527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1092/2009] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:06:14.515293 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8229ce5c-9aff-4edb-91a0-fb3076e78204 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:14.515961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8229ce5c-9aff-4edb-91a0-fb3076e78204 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:14.522704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8229ce5c-9aff-4edb-91a0-fb3076e78204 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:14.523150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8229ce5c-9aff-4edb-91a0-fb3076e78204 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:14.523933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8229ce5c-9aff-4edb-91a0-fb3076e78204 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:14.524374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8229ce5c-9aff-4edb-91a0-fb3076e78204 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:14.787161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8229ce5c-9aff-4edb-91a0-fb3076e78204 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:14.795658 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8229ce5c-9aff-4edb-91a0-fb3076e78204 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:14.797180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8229ce5c-9aff-4edb-91a0-fb3076e78204 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:14.798313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8229ce5c-9aff-4edb-91a0-fb3076e78204 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.286972 Jul 27 23:06:14.798864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 918/2010] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:14 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:15.821838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5a420eb4-4f7a-4c3c-b3d3-469c623ca4ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:15.822533 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5a420eb4-4f7a-4c3c-b3d3-469c623ca4ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:15.828867 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a420eb4-4f7a-4c3c-b3d3-469c623ca4ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:15.829311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a420eb4-4f7a-4c3c-b3d3-469c623ca4ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:15.830068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a420eb4-4f7a-4c3c-b3d3-469c623ca4ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:15.830502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5a420eb4-4f7a-4c3c-b3d3-469c623ca4ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:15.890934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5a420eb4-4f7a-4c3c-b3d3-469c623ca4ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:15.899459 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5a420eb4-4f7a-4c3c-b3d3-469c623ca4ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:15.900999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5a420eb4-4f7a-4c3c-b3d3-469c623ca4ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:15.902134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5a420eb4-4f7a-4c3c-b3d3-469c623ca4ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085682 Jul 27 23:06:15.902692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1093/2011] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:15 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:16.924651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-93350b4a-14c7-4ab5-8556-50077f079781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:16.925249 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-93350b4a-14c7-4ab5-8556-50077f079781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:16.932238 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-93350b4a-14c7-4ab5-8556-50077f079781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:16.932698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-93350b4a-14c7-4ab5-8556-50077f079781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:16.933447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-93350b4a-14c7-4ab5-8556-50077f079781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:16.933876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-93350b4a-14c7-4ab5-8556-50077f079781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:16.993346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-93350b4a-14c7-4ab5-8556-50077f079781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:17.001814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-93350b4a-14c7-4ab5-8556-50077f079781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:17.003307 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-93350b4a-14c7-4ab5-8556-50077f079781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:17.004447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-93350b4a-14c7-4ab5-8556-50077f079781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083708 Jul 27 23:06:17.005046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 919/2012] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:16 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:18.027572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d939c8ad-867e-4072-9637-d6030ca72efe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:18.028182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d939c8ad-867e-4072-9637-d6030ca72efe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:18.034759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d939c8ad-867e-4072-9637-d6030ca72efe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:18.035198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d939c8ad-867e-4072-9637-d6030ca72efe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:18.035951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d939c8ad-867e-4072-9637-d6030ca72efe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:18.036384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d939c8ad-867e-4072-9637-d6030ca72efe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:18.096043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d939c8ad-867e-4072-9637-d6030ca72efe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:18.104932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d939c8ad-867e-4072-9637-d6030ca72efe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:18.106696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d939c8ad-867e-4072-9637-d6030ca72efe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:18.107815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d939c8ad-867e-4072-9637-d6030ca72efe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084148 Jul 27 23:06:18.108358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1094/2013] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:19.129598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cb62fdda-96b2-4fc1-94a8-c22f40a4a1f8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:19.130200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cb62fdda-96b2-4fc1-94a8-c22f40a4a1f8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:19.136795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb62fdda-96b2-4fc1-94a8-c22f40a4a1f8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:19.137226 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb62fdda-96b2-4fc1-94a8-c22f40a4a1f8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:19.137974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb62fdda-96b2-4fc1-94a8-c22f40a4a1f8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:19.138399 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb62fdda-96b2-4fc1-94a8-c22f40a4a1f8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:19.200563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cb62fdda-96b2-4fc1-94a8-c22f40a4a1f8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:19.208704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cb62fdda-96b2-4fc1-94a8-c22f40a4a1f8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:19.210220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cb62fdda-96b2-4fc1-94a8-c22f40a4a1f8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:19.211332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cb62fdda-96b2-4fc1-94a8-c22f40a4a1f8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085756 Jul 27 23:06:19.211874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 920/2014] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:19 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:20.234676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1b44bada-d017-4206-811d-5da8c37a99d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:20.235343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1b44bada-d017-4206-811d-5da8c37a99d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:20.241803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1b44bada-d017-4206-811d-5da8c37a99d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:20.242246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1b44bada-d017-4206-811d-5da8c37a99d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:20.242994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1b44bada-d017-4206-811d-5da8c37a99d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:20.243425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1b44bada-d017-4206-811d-5da8c37a99d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:20.302941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1b44bada-d017-4206-811d-5da8c37a99d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:20.311654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1b44bada-d017-4206-811d-5da8c37a99d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:20.313176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1b44bada-d017-4206-811d-5da8c37a99d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:20.314299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1b44bada-d017-4206-811d-5da8c37a99d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083748 Jul 27 23:06:20.314855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1095/2015] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:21.337094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2b73b7a6-023b-4b13-9bb6-5fb98c074874 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:21.337820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2b73b7a6-023b-4b13-9bb6-5fb98c074874 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:21.345444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2b73b7a6-023b-4b13-9bb6-5fb98c074874 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:21.345886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2b73b7a6-023b-4b13-9bb6-5fb98c074874 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:21.346663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2b73b7a6-023b-4b13-9bb6-5fb98c074874 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:21.347094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2b73b7a6-023b-4b13-9bb6-5fb98c074874 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:21.412484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2b73b7a6-023b-4b13-9bb6-5fb98c074874 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:21.428802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2b73b7a6-023b-4b13-9bb6-5fb98c074874 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:21.432005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2b73b7a6-023b-4b13-9bb6-5fb98c074874 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:21.433188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2b73b7a6-023b-4b13-9bb6-5fb98c074874 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.100561 Jul 27 23:06:21.433749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 921/2016] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:21 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:22.455169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e4109d10-da4d-4410-9120-77b447287f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:22.455776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e4109d10-da4d-4410-9120-77b447287f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:22.463040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4109d10-da4d-4410-9120-77b447287f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:22.463486 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4109d10-da4d-4410-9120-77b447287f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:22.464236 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4109d10-da4d-4410-9120-77b447287f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:22.464694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4109d10-da4d-4410-9120-77b447287f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:22.526289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e4109d10-da4d-4410-9120-77b447287f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:22.534581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e4109d10-da4d-4410-9120-77b447287f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:22.536071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e4109d10-da4d-4410-9120-77b447287f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:22.537221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e4109d10-da4d-4410-9120-77b447287f0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085938 Jul 27 23:06:22.537766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1096/2017] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:22 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:23.559490 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5f998f73-3f00-4259-ba85-83180bd27912 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:23.560090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5f998f73-3f00-4259-ba85-83180bd27912 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:23.566785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f998f73-3f00-4259-ba85-83180bd27912 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:23.567224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f998f73-3f00-4259-ba85-83180bd27912 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:23.567980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f998f73-3f00-4259-ba85-83180bd27912 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:23.568428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f998f73-3f00-4259-ba85-83180bd27912 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:23.631168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5f998f73-3f00-4259-ba85-83180bd27912 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:23.640196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5f998f73-3f00-4259-ba85-83180bd27912 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:23.641731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5f998f73-3f00-4259-ba85-83180bd27912 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:23.642861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5f998f73-3f00-4259-ba85-83180bd27912 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087354 Jul 27 23:06:23.643406 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 922/2018] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:23 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:24.666125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-161fd4af-c225-404a-916c-7960f2fc6497 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:24.666734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-161fd4af-c225-404a-916c-7960f2fc6497 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:24.673262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-161fd4af-c225-404a-916c-7960f2fc6497 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:24.673709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-161fd4af-c225-404a-916c-7960f2fc6497 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:24.674461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-161fd4af-c225-404a-916c-7960f2fc6497 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:24.674892 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-161fd4af-c225-404a-916c-7960f2fc6497 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:24.734000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-161fd4af-c225-404a-916c-7960f2fc6497 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:24.742865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-161fd4af-c225-404a-916c-7960f2fc6497 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:24.744377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-161fd4af-c225-404a-916c-7960f2fc6497 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:24.745541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-161fd4af-c225-404a-916c-7960f2fc6497 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083852 Jul 27 23:06:24.746091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1097/2019] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:24 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:25.769342 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-211c195a-fa60-47cf-bf26-2e6c0b7f260f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:25.769943 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-211c195a-fa60-47cf-bf26-2e6c0b7f260f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:25.776952 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-211c195a-fa60-47cf-bf26-2e6c0b7f260f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:25.777398 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-211c195a-fa60-47cf-bf26-2e6c0b7f260f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:25.778149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-211c195a-fa60-47cf-bf26-2e6c0b7f260f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:25.778578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-211c195a-fa60-47cf-bf26-2e6c0b7f260f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:25.838269 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-211c195a-fa60-47cf-bf26-2e6c0b7f260f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:25.846515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-211c195a-fa60-47cf-bf26-2e6c0b7f260f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:25.848001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-211c195a-fa60-47cf-bf26-2e6c0b7f260f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:25.849161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-211c195a-fa60-47cf-bf26-2e6c0b7f260f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083718 Jul 27 23:06:25.849730 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 923/2020] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:25 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:26.873065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-72232e76-678a-480c-89dd-445a903078a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:26.873685 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-72232e76-678a-480c-89dd-445a903078a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:26.880050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72232e76-678a-480c-89dd-445a903078a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:26.880487 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72232e76-678a-480c-89dd-445a903078a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:26.881257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72232e76-678a-480c-89dd-445a903078a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:26.881703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72232e76-678a-480c-89dd-445a903078a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:26.945437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-72232e76-678a-480c-89dd-445a903078a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:26.953713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-72232e76-678a-480c-89dd-445a903078a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:26.955205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-72232e76-678a-480c-89dd-445a903078a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:26.956351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-72232e76-678a-480c-89dd-445a903078a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087186 Jul 27 23:06:26.956937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1098/2021] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:26 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:27.979625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c295e3c5-1782-47fe-8e62-21ef12f84e9e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:27.980252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c295e3c5-1782-47fe-8e62-21ef12f84e9e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:27.987003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c295e3c5-1782-47fe-8e62-21ef12f84e9e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:27.987439 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c295e3c5-1782-47fe-8e62-21ef12f84e9e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:27.988190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c295e3c5-1782-47fe-8e62-21ef12f84e9e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:27.988640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c295e3c5-1782-47fe-8e62-21ef12f84e9e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:28.051432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c295e3c5-1782-47fe-8e62-21ef12f84e9e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:28.059754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c295e3c5-1782-47fe-8e62-21ef12f84e9e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:28.061287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c295e3c5-1782-47fe-8e62-21ef12f84e9e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:28.062422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c295e3c5-1782-47fe-8e62-21ef12f84e9e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087308 Jul 27 23:06:28.062975 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 924/2022] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:27 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:29.084993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-298b3f47-4759-4987-8f15-8bcd54384ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:29.085587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-298b3f47-4759-4987-8f15-8bcd54384ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:29.091975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-298b3f47-4759-4987-8f15-8bcd54384ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:29.092419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-298b3f47-4759-4987-8f15-8bcd54384ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:29.093203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-298b3f47-4759-4987-8f15-8bcd54384ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:29.093634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-298b3f47-4759-4987-8f15-8bcd54384ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:29.154478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-298b3f47-4759-4987-8f15-8bcd54384ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:29.162409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-298b3f47-4759-4987-8f15-8bcd54384ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:29.164465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-298b3f47-4759-4987-8f15-8bcd54384ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:29.165617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-298b3f47-4759-4987-8f15-8bcd54384ab6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084553 Jul 27 23:06:29.166160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1099/2023] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:29 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:30.188698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9c0f8c6d-d59a-47d2-918f-3a3aaf8a0146 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:30.189242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9c0f8c6d-d59a-47d2-918f-3a3aaf8a0146 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:30.196338 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c0f8c6d-d59a-47d2-918f-3a3aaf8a0146 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:30.196818 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c0f8c6d-d59a-47d2-918f-3a3aaf8a0146 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:30.197571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c0f8c6d-d59a-47d2-918f-3a3aaf8a0146 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:30.198000 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c0f8c6d-d59a-47d2-918f-3a3aaf8a0146 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:30.259094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9c0f8c6d-d59a-47d2-918f-3a3aaf8a0146 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:30.267325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9c0f8c6d-d59a-47d2-918f-3a3aaf8a0146 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:30.268850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9c0f8c6d-d59a-47d2-918f-3a3aaf8a0146 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:30.269981 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9c0f8c6d-d59a-47d2-918f-3a3aaf8a0146 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085246 Jul 27 23:06:30.270527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 925/2024] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:31.292634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1c1372f0-f50e-456d-97d5-c8dec867c35f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:31.293235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1c1372f0-f50e-456d-97d5-c8dec867c35f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:31.299589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c1372f0-f50e-456d-97d5-c8dec867c35f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:31.300024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c1372f0-f50e-456d-97d5-c8dec867c35f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:31.300802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c1372f0-f50e-456d-97d5-c8dec867c35f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:31.301230 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c1372f0-f50e-456d-97d5-c8dec867c35f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:31.360365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1c1372f0-f50e-456d-97d5-c8dec867c35f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:31.368585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1c1372f0-f50e-456d-97d5-c8dec867c35f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:31.370068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1c1372f0-f50e-456d-97d5-c8dec867c35f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:31.371185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1c1372f0-f50e-456d-97d5-c8dec867c35f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.082563 Jul 27 23:06:31.371732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1100/2025] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:31 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:32.394165 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ac85faab-b428-474b-92f3-c3bbc22d3d01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:32.394773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ac85faab-b428-474b-92f3-c3bbc22d3d01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:32.401407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac85faab-b428-474b-92f3-c3bbc22d3d01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:32.401851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac85faab-b428-474b-92f3-c3bbc22d3d01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:32.402613 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac85faab-b428-474b-92f3-c3bbc22d3d01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:32.403043 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac85faab-b428-474b-92f3-c3bbc22d3d01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:32.465187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ac85faab-b428-474b-92f3-c3bbc22d3d01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:32.473524 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ac85faab-b428-474b-92f3-c3bbc22d3d01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:32.475050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ac85faab-b428-474b-92f3-c3bbc22d3d01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:32.476224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ac85faab-b428-474b-92f3-c3bbc22d3d01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085984 Jul 27 23:06:32.476812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 926/2026] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:32 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:33.499774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e9835f0f-19d7-4d1c-9d2f-0fccc191aac1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:33.500310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e9835f0f-19d7-4d1c-9d2f-0fccc191aac1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:33.506872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9835f0f-19d7-4d1c-9d2f-0fccc191aac1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:33.507312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9835f0f-19d7-4d1c-9d2f-0fccc191aac1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:33.508059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9835f0f-19d7-4d1c-9d2f-0fccc191aac1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:33.508486 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9835f0f-19d7-4d1c-9d2f-0fccc191aac1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:33.568298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e9835f0f-19d7-4d1c-9d2f-0fccc191aac1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:33.576625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e9835f0f-19d7-4d1c-9d2f-0fccc191aac1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:33.578118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e9835f0f-19d7-4d1c-9d2f-0fccc191aac1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:33.579239 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e9835f0f-19d7-4d1c-9d2f-0fccc191aac1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083385 Jul 27 23:06:33.579784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1101/2027] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:34.601752 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e6a92d5d-3375-406f-b1cc-0b5c595416cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:34.602352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e6a92d5d-3375-406f-b1cc-0b5c595416cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:34.609089 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e6a92d5d-3375-406f-b1cc-0b5c595416cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:34.609525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e6a92d5d-3375-406f-b1cc-0b5c595416cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:34.610267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e6a92d5d-3375-406f-b1cc-0b5c595416cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:34.610693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e6a92d5d-3375-406f-b1cc-0b5c595416cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:34.670332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e6a92d5d-3375-406f-b1cc-0b5c595416cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:34.679019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e6a92d5d-3375-406f-b1cc-0b5c595416cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:34.680507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e6a92d5d-3375-406f-b1cc-0b5c595416cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:34.681652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e6a92d5d-3375-406f-b1cc-0b5c595416cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083829 Jul 27 23:06:34.682201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 927/2028] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:34 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:35.704649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1e7fd2ea-4c5d-45fa-8fb3-b150554047ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:35.705257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1e7fd2ea-4c5d-45fa-8fb3-b150554047ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:35.712306 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e7fd2ea-4c5d-45fa-8fb3-b150554047ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:35.712772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e7fd2ea-4c5d-45fa-8fb3-b150554047ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:35.713526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e7fd2ea-4c5d-45fa-8fb3-b150554047ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:35.713959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e7fd2ea-4c5d-45fa-8fb3-b150554047ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:35.776668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1e7fd2ea-4c5d-45fa-8fb3-b150554047ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:35.785049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1e7fd2ea-4c5d-45fa-8fb3-b150554047ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:35.786554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1e7fd2ea-4c5d-45fa-8fb3-b150554047ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:35.787674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1e7fd2ea-4c5d-45fa-8fb3-b150554047ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086895 Jul 27 23:06:35.788226 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1102/2029] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:36.810602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a1bc06b1-4010-46f0-9478-74a3212436bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:36.811201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a1bc06b1-4010-46f0-9478-74a3212436bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:36.817561 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1bc06b1-4010-46f0-9478-74a3212436bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:36.818008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1bc06b1-4010-46f0-9478-74a3212436bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:36.818753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1bc06b1-4010-46f0-9478-74a3212436bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:36.819853 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1bc06b1-4010-46f0-9478-74a3212436bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:36.886473 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1bc06b1-4010-46f0-9478-74a3212436bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:36.894787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1bc06b1-4010-46f0-9478-74a3212436bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:36.896277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1bc06b1-4010-46f0-9478-74a3212436bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:36.897454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a1bc06b1-4010-46f0-9478-74a3212436bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.090792 Jul 27 23:06:36.898002 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 928/2030] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:37.919761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-073e967c-f087-4341-b4f3-e08c925908d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:37.920368 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-073e967c-f087-4341-b4f3-e08c925908d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:37.926819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-073e967c-f087-4341-b4f3-e08c925908d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:37.927258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-073e967c-f087-4341-b4f3-e08c925908d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:37.928004 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-073e967c-f087-4341-b4f3-e08c925908d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:37.929111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-073e967c-f087-4341-b4f3-e08c925908d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:37.992050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-073e967c-f087-4341-b4f3-e08c925908d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:38.000256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-073e967c-f087-4341-b4f3-e08c925908d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:38.001969 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-073e967c-f087-4341-b4f3-e08c925908d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:38.003093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-073e967c-f087-4341-b4f3-e08c925908d6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087208 Jul 27 23:06:38.003639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1103/2031] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:39.026436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-45055224-5978-4783-ad5b-3711c3ad3a57 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:39.026971 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-45055224-5978-4783-ad5b-3711c3ad3a57 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:39.033397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45055224-5978-4783-ad5b-3711c3ad3a57 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:39.033841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45055224-5978-4783-ad5b-3711c3ad3a57 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:39.034596 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45055224-5978-4783-ad5b-3711c3ad3a57 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:39.035029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45055224-5978-4783-ad5b-3711c3ad3a57 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:39.095227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-45055224-5978-4783-ad5b-3711c3ad3a57 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:39.103569 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-45055224-5978-4783-ad5b-3711c3ad3a57 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:39.105112 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-45055224-5978-4783-ad5b-3711c3ad3a57 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:39.106248 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-45055224-5978-4783-ad5b-3711c3ad3a57 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084466 Jul 27 23:06:39.107073 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 929/2032] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:06:40.129253 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9d11a0fd-56bc-4779-ab93-088c80723b51 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:40.129861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9d11a0fd-56bc-4779-ab93-088c80723b51 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:40.136943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d11a0fd-56bc-4779-ab93-088c80723b51 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:40.137384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d11a0fd-56bc-4779-ab93-088c80723b51 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:40.138130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d11a0fd-56bc-4779-ab93-088c80723b51 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:40.138557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9d11a0fd-56bc-4779-ab93-088c80723b51 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:40.199029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9d11a0fd-56bc-4779-ab93-088c80723b51 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:40.207347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9d11a0fd-56bc-4779-ab93-088c80723b51 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:40.208854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9d11a0fd-56bc-4779-ab93-088c80723b51 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:40.209976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9d11a0fd-56bc-4779-ab93-088c80723b51 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084552 Jul 27 23:06:40.210519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1104/2033] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:41.232486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-87ffbf00-6ff4-4524-b207-47d3bb421bd6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:41.238745 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-87ffbf00-6ff4-4524-b207-47d3bb421bd6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:41.238745 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:06:41.241777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-87ffbf00-6ff4-4524-b207-47d3bb421bd6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:41.242217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-87ffbf00-6ff4-4524-b207-47d3bb421bd6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:41.242968 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-87ffbf00-6ff4-4524-b207-47d3bb421bd6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:41.243397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-87ffbf00-6ff4-4524-b207-47d3bb421bd6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:41.246687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:06:41.307738 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-87ffbf00-6ff4-4524-b207-47d3bb421bd6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:41.315956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-87ffbf00-6ff4-4524-b207-47d3bb421bd6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:41.317464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-87ffbf00-6ff4-4524-b207-47d3bb421bd6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:41.318585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-87ffbf00-6ff4-4524-b207-47d3bb421bd6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.090358 Jul 27 23:06:41.319785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 930/2034] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:42.342072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-306568d0-7a05-4362-8853-f7f1f7403960 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:42.342679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-306568d0-7a05-4362-8853-f7f1f7403960 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:42.344798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=29 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:06:42.350316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-306568d0-7a05-4362-8853-f7f1f7403960 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:42.350759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-306568d0-7a05-4362-8853-f7f1f7403960 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:42.351510 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-306568d0-7a05-4362-8853-f7f1f7403960 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:42.351942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-306568d0-7a05-4362-8853-f7f1f7403960 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:42.355754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=81 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:06:42.411964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-306568d0-7a05-4362-8853-f7f1f7403960 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:42.420664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-306568d0-7a05-4362-8853-f7f1f7403960 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:42.422144 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-306568d0-7a05-4362-8853-f7f1f7403960 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:42.423260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-306568d0-7a05-4362-8853-f7f1f7403960 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085114 Jul 27 23:06:42.423810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1105/2035] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:43.447094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3b183369-b435-4035-a58c-f50ce86c0ba8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:43.447626 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3b183369-b435-4035-a58c-f50ce86c0ba8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:43.454371 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b183369-b435-4035-a58c-f50ce86c0ba8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:43.454818 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b183369-b435-4035-a58c-f50ce86c0ba8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:43.455573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b183369-b435-4035-a58c-f50ce86c0ba8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:43.456003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b183369-b435-4035-a58c-f50ce86c0ba8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:43.517924 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3b183369-b435-4035-a58c-f50ce86c0ba8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:43.526880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3b183369-b435-4035-a58c-f50ce86c0ba8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:43.528361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3b183369-b435-4035-a58c-f50ce86c0ba8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:43.529524 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3b183369-b435-4035-a58c-f50ce86c0ba8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086967 Jul 27 23:06:43.530076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 931/2036] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:44.551176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0c0acdf4-7f96-4549-b9df-7aa51ce28126 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:44.551777 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0c0acdf4-7f96-4549-b9df-7aa51ce28126 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:44.558344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c0acdf4-7f96-4549-b9df-7aa51ce28126 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:44.558784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c0acdf4-7f96-4549-b9df-7aa51ce28126 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:44.559525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c0acdf4-7f96-4549-b9df-7aa51ce28126 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:44.559952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c0acdf4-7f96-4549-b9df-7aa51ce28126 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:44.620625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0c0acdf4-7f96-4549-b9df-7aa51ce28126 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:44.629029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0c0acdf4-7f96-4549-b9df-7aa51ce28126 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:44.630536 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0c0acdf4-7f96-4549-b9df-7aa51ce28126 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:44.632209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0c0acdf4-7f96-4549-b9df-7aa51ce28126 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084388 Jul 27 23:06:44.632789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1106/2037] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:44 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:45.655293 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a0cdff4b-e75f-4cfa-a887-4beb057b9929 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:45.655890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a0cdff4b-e75f-4cfa-a887-4beb057b9929 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:45.663163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a0cdff4b-e75f-4cfa-a887-4beb057b9929 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:45.663600 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a0cdff4b-e75f-4cfa-a887-4beb057b9929 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:45.664353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a0cdff4b-e75f-4cfa-a887-4beb057b9929 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:45.664806 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a0cdff4b-e75f-4cfa-a887-4beb057b9929 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:45.730287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a0cdff4b-e75f-4cfa-a887-4beb057b9929 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:45.738752 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a0cdff4b-e75f-4cfa-a887-4beb057b9929 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:45.740218 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a0cdff4b-e75f-4cfa-a887-4beb057b9929 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:45.742076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a0cdff4b-e75f-4cfa-a887-4beb057b9929 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.090639 Jul 27 23:06:45.742622 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 932/2038] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:45 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:46.764497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ffd74cb6-ff3e-4e53-b8ae-e7e6c3cca560 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:46.765116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ffd74cb6-ff3e-4e53-b8ae-e7e6c3cca560 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:46.771575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffd74cb6-ff3e-4e53-b8ae-e7e6c3cca560 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:46.772066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffd74cb6-ff3e-4e53-b8ae-e7e6c3cca560 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:46.772843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffd74cb6-ff3e-4e53-b8ae-e7e6c3cca560 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:46.773268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffd74cb6-ff3e-4e53-b8ae-e7e6c3cca560 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:46.832462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ffd74cb6-ff3e-4e53-b8ae-e7e6c3cca560 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:46.840769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ffd74cb6-ff3e-4e53-b8ae-e7e6c3cca560 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:46.842258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ffd74cb6-ff3e-4e53-b8ae-e7e6c3cca560 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:46.843369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ffd74cb6-ff3e-4e53-b8ae-e7e6c3cca560 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.082761 Jul 27 23:06:46.843922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1107/2039] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:47.866169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3e7b4da2-7db0-4768-a3be-afa2bd0f8ca7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:47.866848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3e7b4da2-7db0-4768-a3be-afa2bd0f8ca7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:47.873304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e7b4da2-7db0-4768-a3be-afa2bd0f8ca7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:47.873754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e7b4da2-7db0-4768-a3be-afa2bd0f8ca7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:47.874523 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e7b4da2-7db0-4768-a3be-afa2bd0f8ca7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:47.874955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e7b4da2-7db0-4768-a3be-afa2bd0f8ca7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:47.935385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3e7b4da2-7db0-4768-a3be-afa2bd0f8ca7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:47.944263 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3e7b4da2-7db0-4768-a3be-afa2bd0f8ca7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:47.945803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3e7b4da2-7db0-4768-a3be-afa2bd0f8ca7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:47.946938 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3e7b4da2-7db0-4768-a3be-afa2bd0f8ca7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084718 Jul 27 23:06:47.947486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 933/2040] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:48.970070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fa5de19f-bce5-4fcd-8bcd-77ac824187b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:48.970585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fa5de19f-bce5-4fcd-8bcd-77ac824187b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:48.977696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fa5de19f-bce5-4fcd-8bcd-77ac824187b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:48.978135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fa5de19f-bce5-4fcd-8bcd-77ac824187b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:48.978879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fa5de19f-bce5-4fcd-8bcd-77ac824187b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:48.979303 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fa5de19f-bce5-4fcd-8bcd-77ac824187b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:49.038477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fa5de19f-bce5-4fcd-8bcd-77ac824187b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:49.047145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fa5de19f-bce5-4fcd-8bcd-77ac824187b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:49.048648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fa5de19f-bce5-4fcd-8bcd-77ac824187b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:49.049763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fa5de19f-bce5-4fcd-8bcd-77ac824187b3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083604 Jul 27 23:06:49.050303 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1108/2041] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:48 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:50.071294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-07e5329e-625f-406f-8335-62db4817bb03 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:50.071902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-07e5329e-625f-406f-8335-62db4817bb03 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:50.078291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07e5329e-625f-406f-8335-62db4817bb03 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:50.078731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07e5329e-625f-406f-8335-62db4817bb03 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:50.079483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07e5329e-625f-406f-8335-62db4817bb03 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:50.079909 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07e5329e-625f-406f-8335-62db4817bb03 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:50.141873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-07e5329e-625f-406f-8335-62db4817bb03 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:50.150608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-07e5329e-625f-406f-8335-62db4817bb03 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:50.152163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-07e5329e-625f-406f-8335-62db4817bb03 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:50.153368 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-07e5329e-625f-406f-8335-62db4817bb03 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085999 Jul 27 23:06:50.153955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 934/2042] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:50 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:51.176472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2c892b18-e6e7-4c62-be45-a812f21824a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:51.177147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2c892b18-e6e7-4c62-be45-a812f21824a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:51.185562 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2c892b18-e6e7-4c62-be45-a812f21824a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:51.186008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2c892b18-e6e7-4c62-be45-a812f21824a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:51.186763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2c892b18-e6e7-4c62-be45-a812f21824a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:51.187209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2c892b18-e6e7-4c62-be45-a812f21824a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:51.247136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2c892b18-e6e7-4c62-be45-a812f21824a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:51.255386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2c892b18-e6e7-4c62-be45-a812f21824a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:51.257613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2c892b18-e6e7-4c62-be45-a812f21824a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:51.258744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2c892b18-e6e7-4c62-be45-a812f21824a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086366 Jul 27 23:06:51.259279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1109/2043] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:51 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:52.281156 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e4996fe2-f3bb-41e5-ab91-7ed4d8eed661 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:52.281707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e4996fe2-f3bb-41e5-ab91-7ed4d8eed661 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:52.288286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4996fe2-f3bb-41e5-ab91-7ed4d8eed661 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:52.288783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4996fe2-f3bb-41e5-ab91-7ed4d8eed661 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:52.289548 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4996fe2-f3bb-41e5-ab91-7ed4d8eed661 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:52.289985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4996fe2-f3bb-41e5-ab91-7ed4d8eed661 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:52.349904 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e4996fe2-f3bb-41e5-ab91-7ed4d8eed661 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:52.358502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e4996fe2-f3bb-41e5-ab91-7ed4d8eed661 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:52.360003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e4996fe2-f3bb-41e5-ab91-7ed4d8eed661 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:52.361179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e4996fe2-f3bb-41e5-ab91-7ed4d8eed661 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084099 Jul 27 23:06:52.361744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 935/2044] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:52 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:53.384316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d156eab5-d291-4cef-b5e5-7b1f19e174f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:53.384948 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d156eab5-d291-4cef-b5e5-7b1f19e174f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:53.391361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d156eab5-d291-4cef-b5e5-7b1f19e174f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:53.391798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d156eab5-d291-4cef-b5e5-7b1f19e174f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:53.392570 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d156eab5-d291-4cef-b5e5-7b1f19e174f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:53.393000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d156eab5-d291-4cef-b5e5-7b1f19e174f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:53.454614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d156eab5-d291-4cef-b5e5-7b1f19e174f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:53.462978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d156eab5-d291-4cef-b5e5-7b1f19e174f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:53.464472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d156eab5-d291-4cef-b5e5-7b1f19e174f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:53.465637 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d156eab5-d291-4cef-b5e5-7b1f19e174f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085843 Jul 27 23:06:53.466185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1110/2045] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:53 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:54.490006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3a2e130c-f6a2-4b35-893a-b29995b6dabe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:54.491223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3a2e130c-f6a2-4b35-893a-b29995b6dabe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:54.497735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3a2e130c-f6a2-4b35-893a-b29995b6dabe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:54.498171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3a2e130c-f6a2-4b35-893a-b29995b6dabe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:54.498916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3a2e130c-f6a2-4b35-893a-b29995b6dabe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:54.499344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3a2e130c-f6a2-4b35-893a-b29995b6dabe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:54.561621 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3a2e130c-f6a2-4b35-893a-b29995b6dabe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:54.569916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3a2e130c-f6a2-4b35-893a-b29995b6dabe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:54.572078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3a2e130c-f6a2-4b35-893a-b29995b6dabe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:54.573328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3a2e130c-f6a2-4b35-893a-b29995b6dabe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087285 Jul 27 23:06:54.573888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 936/2046] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:54 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:55.596729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-838d850e-ffa1-4d07-8f9f-ae8acf1964e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:55.597333 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-838d850e-ffa1-4d07-8f9f-ae8acf1964e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:55.603893 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-838d850e-ffa1-4d07-8f9f-ae8acf1964e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:55.604330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-838d850e-ffa1-4d07-8f9f-ae8acf1964e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:55.605099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-838d850e-ffa1-4d07-8f9f-ae8acf1964e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:55.605527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-838d850e-ffa1-4d07-8f9f-ae8acf1964e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:55.666180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-838d850e-ffa1-4d07-8f9f-ae8acf1964e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:55.674366 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-838d850e-ffa1-4d07-8f9f-ae8acf1964e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:55.675848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-838d850e-ffa1-4d07-8f9f-ae8acf1964e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:55.676991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-838d850e-ffa1-4d07-8f9f-ae8acf1964e3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084179 Jul 27 23:06:55.677538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1111/2047] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:55 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:56.700473 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-95e834cf-dd69-4636-a9f1-05b20b2c6801 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:56.701024 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-95e834cf-dd69-4636-a9f1-05b20b2c6801 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:56.707437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-95e834cf-dd69-4636-a9f1-05b20b2c6801 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:56.707871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-95e834cf-dd69-4636-a9f1-05b20b2c6801 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:56.708651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-95e834cf-dd69-4636-a9f1-05b20b2c6801 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:56.709077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-95e834cf-dd69-4636-a9f1-05b20b2c6801 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:56.772437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-95e834cf-dd69-4636-a9f1-05b20b2c6801 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:56.781612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-95e834cf-dd69-4636-a9f1-05b20b2c6801 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:56.783108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-95e834cf-dd69-4636-a9f1-05b20b2c6801 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:56.784273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-95e834cf-dd69-4636-a9f1-05b20b2c6801 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087779 Jul 27 23:06:56.788606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 937/2048] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:57.806810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7b271d18-f56e-4ef5-9ee4-f8e86b4f9d15 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:57.807412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7b271d18-f56e-4ef5-9ee4-f8e86b4f9d15 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:57.813776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b271d18-f56e-4ef5-9ee4-f8e86b4f9d15 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:57.814210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b271d18-f56e-4ef5-9ee4-f8e86b4f9d15 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:57.814960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b271d18-f56e-4ef5-9ee4-f8e86b4f9d15 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:57.815378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b271d18-f56e-4ef5-9ee4-f8e86b4f9d15 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:57.875630 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7b271d18-f56e-4ef5-9ee4-f8e86b4f9d15 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:57.883889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7b271d18-f56e-4ef5-9ee4-f8e86b4f9d15 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:57.885455 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7b271d18-f56e-4ef5-9ee4-f8e86b4f9d15 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:57.886568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7b271d18-f56e-4ef5-9ee4-f8e86b4f9d15 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083773 Jul 27 23:06:57.887123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1112/2049] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:57 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:06:58.909575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-01f161a7-f717-4af0-bc45-fc8ec1b42b47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:06:58.910178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-01f161a7-f717-4af0-bc45-fc8ec1b42b47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:06:58.917151 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01f161a7-f717-4af0-bc45-fc8ec1b42b47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:58.917592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01f161a7-f717-4af0-bc45-fc8ec1b42b47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:58.918351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01f161a7-f717-4af0-bc45-fc8ec1b42b47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:06:58.918773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-01f161a7-f717-4af0-bc45-fc8ec1b42b47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:06:58.984762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-01f161a7-f717-4af0-bc45-fc8ec1b42b47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:58.993741 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-01f161a7-f717-4af0-bc45-fc8ec1b42b47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:58.995234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-01f161a7-f717-4af0-bc45-fc8ec1b42b47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:06:58.996359 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-01f161a7-f717-4af0-bc45-fc8ec1b42b47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.090662 Jul 27 23:06:58.996944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 938/2050] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:06:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:00.019053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1d5a01b0-ba3c-4189-ae7a-3aa5f0adc434 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:00.019656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1d5a01b0-ba3c-4189-ae7a-3aa5f0adc434 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:00.026684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d5a01b0-ba3c-4189-ae7a-3aa5f0adc434 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:00.027137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d5a01b0-ba3c-4189-ae7a-3aa5f0adc434 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:00.027894 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d5a01b0-ba3c-4189-ae7a-3aa5f0adc434 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:00.028326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d5a01b0-ba3c-4189-ae7a-3aa5f0adc434 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:00.088744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1d5a01b0-ba3c-4189-ae7a-3aa5f0adc434 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:00.096894 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1d5a01b0-ba3c-4189-ae7a-3aa5f0adc434 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:00.098389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1d5a01b0-ba3c-4189-ae7a-3aa5f0adc434 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:00.099513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1d5a01b0-ba3c-4189-ae7a-3aa5f0adc434 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084358 Jul 27 23:07:00.100071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1113/2051] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:00 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:07:01.122575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ff2fffd2-e898-4c97-ad21-70b1797ba516 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:01.123181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ff2fffd2-e898-4c97-ad21-70b1797ba516 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:01.129634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff2fffd2-e898-4c97-ad21-70b1797ba516 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:01.130072 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff2fffd2-e898-4c97-ad21-70b1797ba516 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:01.130823 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff2fffd2-e898-4c97-ad21-70b1797ba516 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:01.131752 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff2fffd2-e898-4c97-ad21-70b1797ba516 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:01.194492 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ff2fffd2-e898-4c97-ad21-70b1797ba516 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:01.202789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ff2fffd2-e898-4c97-ad21-70b1797ba516 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:01.204290 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ff2fffd2-e898-4c97-ad21-70b1797ba516 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:01.205456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ff2fffd2-e898-4c97-ad21-70b1797ba516 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086812 Jul 27 23:07:01.206016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 939/2052] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:01 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:02.229050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1d0a84f2-5e50-44ce-ac94-5b3ef1f82a85 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:02.229661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1d0a84f2-5e50-44ce-ac94-5b3ef1f82a85 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:02.236384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d0a84f2-5e50-44ce-ac94-5b3ef1f82a85 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:02.236861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d0a84f2-5e50-44ce-ac94-5b3ef1f82a85 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:02.237615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d0a84f2-5e50-44ce-ac94-5b3ef1f82a85 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:02.238049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d0a84f2-5e50-44ce-ac94-5b3ef1f82a85 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:02.297988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1d0a84f2-5e50-44ce-ac94-5b3ef1f82a85 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:02.306319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1d0a84f2-5e50-44ce-ac94-5b3ef1f82a85 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:02.307815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1d0a84f2-5e50-44ce-ac94-5b3ef1f82a85 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:02.308976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1d0a84f2-5e50-44ce-ac94-5b3ef1f82a85 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084305 Jul 27 23:07:02.309531 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1114/2053] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:02 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:03.331240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b5fdbcd0-e5a1-4067-8640-b0116c14a575 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:03.331844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b5fdbcd0-e5a1-4067-8640-b0116c14a575 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:03.338386 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b5fdbcd0-e5a1-4067-8640-b0116c14a575 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:03.338829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b5fdbcd0-e5a1-4067-8640-b0116c14a575 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:03.339583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b5fdbcd0-e5a1-4067-8640-b0116c14a575 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:03.340024 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b5fdbcd0-e5a1-4067-8640-b0116c14a575 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:03.403134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b5fdbcd0-e5a1-4067-8640-b0116c14a575 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:03.411534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b5fdbcd0-e5a1-4067-8640-b0116c14a575 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:03.413543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b5fdbcd0-e5a1-4067-8640-b0116c14a575 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:03.414679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b5fdbcd0-e5a1-4067-8640-b0116c14a575 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087331 Jul 27 23:07:03.415237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 940/2054] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:04.437785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9f6f78c9-2525-44c1-9c92-433aa513d72b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:04.438311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9f6f78c9-2525-44c1-9c92-433aa513d72b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:04.444742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f6f78c9-2525-44c1-9c92-433aa513d72b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:04.445182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f6f78c9-2525-44c1-9c92-433aa513d72b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:04.445926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f6f78c9-2525-44c1-9c92-433aa513d72b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:04.446349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f6f78c9-2525-44c1-9c92-433aa513d72b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:04.506599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9f6f78c9-2525-44c1-9c92-433aa513d72b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:04.514825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9f6f78c9-2525-44c1-9c92-433aa513d72b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:04.516303 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9f6f78c9-2525-44c1-9c92-433aa513d72b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:04.517437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9f6f78c9-2525-44c1-9c92-433aa513d72b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083657 Jul 27 23:07:04.517987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1115/2055] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:04 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:05.541042 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9996e11e-8cd8-4ced-8afa-981419fa4c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:05.541648 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9996e11e-8cd8-4ced-8afa-981419fa4c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:05.548274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9996e11e-8cd8-4ced-8afa-981419fa4c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:05.548753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9996e11e-8cd8-4ced-8afa-981419fa4c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:05.549509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9996e11e-8cd8-4ced-8afa-981419fa4c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:05.549937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9996e11e-8cd8-4ced-8afa-981419fa4c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:05.610020 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9996e11e-8cd8-4ced-8afa-981419fa4c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:05.618384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9996e11e-8cd8-4ced-8afa-981419fa4c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:05.619886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9996e11e-8cd8-4ced-8afa-981419fa4c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:05.621045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9996e11e-8cd8-4ced-8afa-981419fa4c58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084565 Jul 27 23:07:05.621600 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 941/2056] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:05 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:06.643886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1ee93188-fd09-4ca7-8f60-0d07de19c4a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:06.644577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1ee93188-fd09-4ca7-8f60-0d07de19c4a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:06.651749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ee93188-fd09-4ca7-8f60-0d07de19c4a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:06.652198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ee93188-fd09-4ca7-8f60-0d07de19c4a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:06.652991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ee93188-fd09-4ca7-8f60-0d07de19c4a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:06.653426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ee93188-fd09-4ca7-8f60-0d07de19c4a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:06.717360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1ee93188-fd09-4ca7-8f60-0d07de19c4a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:06.725674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1ee93188-fd09-4ca7-8f60-0d07de19c4a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:06.727173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1ee93188-fd09-4ca7-8f60-0d07de19c4a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:06.728303 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1ee93188-fd09-4ca7-8f60-0d07de19c4a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088287 Jul 27 23:07:06.728892 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1116/2057] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:07.752825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-740ef8cc-1cc0-47ed-95a7-8675fef9c7eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:07.753474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-740ef8cc-1cc0-47ed-95a7-8675fef9c7eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:07.761566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-740ef8cc-1cc0-47ed-95a7-8675fef9c7eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:07.762002 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-740ef8cc-1cc0-47ed-95a7-8675fef9c7eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:07.762755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-740ef8cc-1cc0-47ed-95a7-8675fef9c7eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:07.763180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-740ef8cc-1cc0-47ed-95a7-8675fef9c7eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:07.826588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-740ef8cc-1cc0-47ed-95a7-8675fef9c7eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:07.834917 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-740ef8cc-1cc0-47ed-95a7-8675fef9c7eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:07.836402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-740ef8cc-1cc0-47ed-95a7-8675fef9c7eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:07.837559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-740ef8cc-1cc0-47ed-95a7-8675fef9c7eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.089561 Jul 27 23:07:07.838101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 942/2058] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:07 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:08.860344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f07415da-30a9-47fc-858e-c39f2dee9b93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:08.860964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f07415da-30a9-47fc-858e-c39f2dee9b93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:08.867318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f07415da-30a9-47fc-858e-c39f2dee9b93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:08.867757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f07415da-30a9-47fc-858e-c39f2dee9b93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:08.868494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f07415da-30a9-47fc-858e-c39f2dee9b93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:08.868943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f07415da-30a9-47fc-858e-c39f2dee9b93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:08.928713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f07415da-30a9-47fc-858e-c39f2dee9b93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:08.939847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f07415da-30a9-47fc-858e-c39f2dee9b93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:08.941711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f07415da-30a9-47fc-858e-c39f2dee9b93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:08.942833 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f07415da-30a9-47fc-858e-c39f2dee9b93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086635 Jul 27 23:07:08.943380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1117/2059] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:08 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:09.966715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3c12fb9d-4c06-40e2-93a7-4394cc3e0210 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:09.967319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3c12fb9d-4c06-40e2-93a7-4394cc3e0210 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:09.974384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c12fb9d-4c06-40e2-93a7-4394cc3e0210 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:09.974932 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c12fb9d-4c06-40e2-93a7-4394cc3e0210 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:09.976286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c12fb9d-4c06-40e2-93a7-4394cc3e0210 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:09.976907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c12fb9d-4c06-40e2-93a7-4394cc3e0210 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:10.037335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3c12fb9d-4c06-40e2-93a7-4394cc3e0210 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:10.046186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3c12fb9d-4c06-40e2-93a7-4394cc3e0210 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:10.047683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3c12fb9d-4c06-40e2-93a7-4394cc3e0210 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:10.048837 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3c12fb9d-4c06-40e2-93a7-4394cc3e0210 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086020 Jul 27 23:07:10.049389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 943/2060] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:09 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:11.071250 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9bfa0677-5f06-4979-a3d9-18a022641868 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:11.071870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9bfa0677-5f06-4979-a3d9-18a022641868 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:11.078262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9bfa0677-5f06-4979-a3d9-18a022641868 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:11.078932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9bfa0677-5f06-4979-a3d9-18a022641868 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:11.079680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9bfa0677-5f06-4979-a3d9-18a022641868 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:11.080125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9bfa0677-5f06-4979-a3d9-18a022641868 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:11.140232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9bfa0677-5f06-4979-a3d9-18a022641868 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:11.148642 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9bfa0677-5f06-4979-a3d9-18a022641868 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:11.150129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9bfa0677-5f06-4979-a3d9-18a022641868 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:11.151435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9bfa0677-5f06-4979-a3d9-18a022641868 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084087 Jul 27 23:07:11.151989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1118/2061] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:11 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:12.175022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-eeacae01-0099-4dfa-b9a1-6cf760f23be2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:12.175623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-eeacae01-0099-4dfa-b9a1-6cf760f23be2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:12.177936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=28 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:07:12.183603 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eeacae01-0099-4dfa-b9a1-6cf760f23be2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:12.184041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eeacae01-0099-4dfa-b9a1-6cf760f23be2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:12.184822 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eeacae01-0099-4dfa-b9a1-6cf760f23be2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:12.185246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eeacae01-0099-4dfa-b9a1-6cf760f23be2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:12.189623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=84 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:07:12.248526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eeacae01-0099-4dfa-b9a1-6cf760f23be2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:12.257453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eeacae01-0099-4dfa-b9a1-6cf760f23be2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:12.258944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eeacae01-0099-4dfa-b9a1-6cf760f23be2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:12.260067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-eeacae01-0099-4dfa-b9a1-6cf760f23be2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.089284 Jul 27 23:07:12.260631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 944/2062] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:13.282829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-27942af8-e109-4c4e-8389-268df0303f94 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:13.283468 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-27942af8-e109-4c4e-8389-268df0303f94 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:13.285350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=28 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:07:13.290577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-27942af8-e109-4c4e-8389-268df0303f94 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:13.291024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-27942af8-e109-4c4e-8389-268df0303f94 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:13.291772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-27942af8-e109-4c4e-8389-268df0303f94 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:13.292203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-27942af8-e109-4c4e-8389-268df0303f94 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:13.296190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=84 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:07:13.352067 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-27942af8-e109-4c4e-8389-268df0303f94 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:13.360546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-27942af8-e109-4c4e-8389-268df0303f94 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:13.362058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-27942af8-e109-4c4e-8389-268df0303f94 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:13.363177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-27942af8-e109-4c4e-8389-268df0303f94 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084360 Jul 27 23:07:13.363732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1119/2063] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:14.386296 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e6cbf217-f0b8-46c3-9777-1b0c3d4d6cf5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:14.386901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e6cbf217-f0b8-46c3-9777-1b0c3d4d6cf5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:14.393455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e6cbf217-f0b8-46c3-9777-1b0c3d4d6cf5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:14.393892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e6cbf217-f0b8-46c3-9777-1b0c3d4d6cf5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:14.394640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e6cbf217-f0b8-46c3-9777-1b0c3d4d6cf5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:14.395066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e6cbf217-f0b8-46c3-9777-1b0c3d4d6cf5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:14.456132 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e6cbf217-f0b8-46c3-9777-1b0c3d4d6cf5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:14.464437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e6cbf217-f0b8-46c3-9777-1b0c3d4d6cf5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:14.465964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e6cbf217-f0b8-46c3-9777-1b0c3d4d6cf5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:14.467531 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e6cbf217-f0b8-46c3-9777-1b0c3d4d6cf5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085382 Jul 27 23:07:14.467953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 945/2064] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:14 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:15.489872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6d7d01a6-0246-4f1a-ab72-7856f9241153 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:15.490411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6d7d01a6-0246-4f1a-ab72-7856f9241153 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:15.497486 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d7d01a6-0246-4f1a-ab72-7856f9241153 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:15.497921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d7d01a6-0246-4f1a-ab72-7856f9241153 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:15.498664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d7d01a6-0246-4f1a-ab72-7856f9241153 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:15.499090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6d7d01a6-0246-4f1a-ab72-7856f9241153 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:15.559215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6d7d01a6-0246-4f1a-ab72-7856f9241153 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:15.567430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6d7d01a6-0246-4f1a-ab72-7856f9241153 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:15.569015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6d7d01a6-0246-4f1a-ab72-7856f9241153 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:15.570176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6d7d01a6-0246-4f1a-ab72-7856f9241153 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084275 Jul 27 23:07:15.570728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1120/2065] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:15 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:16.592758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-de75d383-addd-4bb9-a36b-9051fd25e3df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:16.593432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-de75d383-addd-4bb9-a36b-9051fd25e3df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:16.599923 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de75d383-addd-4bb9-a36b-9051fd25e3df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:16.600361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de75d383-addd-4bb9-a36b-9051fd25e3df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:16.601287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de75d383-addd-4bb9-a36b-9051fd25e3df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:16.601716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de75d383-addd-4bb9-a36b-9051fd25e3df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:16.826118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-de75d383-addd-4bb9-a36b-9051fd25e3df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:16.834365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-de75d383-addd-4bb9-a36b-9051fd25e3df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:16.836001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-de75d383-addd-4bb9-a36b-9051fd25e3df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:16.837160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-de75d383-addd-4bb9-a36b-9051fd25e3df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.248309 Jul 27 23:07:16.837697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 946/2066] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:16 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:17.860771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-965a4312-547e-4d8b-8fb6-8f2391a727fe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:17.861352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-965a4312-547e-4d8b-8fb6-8f2391a727fe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:17.867817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-965a4312-547e-4d8b-8fb6-8f2391a727fe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:17.868256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-965a4312-547e-4d8b-8fb6-8f2391a727fe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:17.869029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-965a4312-547e-4d8b-8fb6-8f2391a727fe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:17.869459 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-965a4312-547e-4d8b-8fb6-8f2391a727fe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:17.929308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-965a4312-547e-4d8b-8fb6-8f2391a727fe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:17.937731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-965a4312-547e-4d8b-8fb6-8f2391a727fe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:17.939242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-965a4312-547e-4d8b-8fb6-8f2391a727fe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:17.940369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-965a4312-547e-4d8b-8fb6-8f2391a727fe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083786 Jul 27 23:07:17.941169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1121/2067] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:17 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:18.964048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-914e5f32-68c0-4b3f-bbaa-8c3109e035c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:18.964612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-914e5f32-68c0-4b3f-bbaa-8c3109e035c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:18.970690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-914e5f32-68c0-4b3f-bbaa-8c3109e035c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:18.971131 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-914e5f32-68c0-4b3f-bbaa-8c3109e035c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:18.971883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-914e5f32-68c0-4b3f-bbaa-8c3109e035c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:18.972316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-914e5f32-68c0-4b3f-bbaa-8c3109e035c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:19.036777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-914e5f32-68c0-4b3f-bbaa-8c3109e035c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:19.046158 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-914e5f32-68c0-4b3f-bbaa-8c3109e035c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:19.047650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-914e5f32-68c0-4b3f-bbaa-8c3109e035c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:19.048819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-914e5f32-68c0-4b3f-bbaa-8c3109e035c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.089307 Jul 27 23:07:19.049365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 947/2068] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:20.071978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c68d6b67-8ec9-4b0c-9314-aae8b22ec8e2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:20.072594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c68d6b67-8ec9-4b0c-9314-aae8b22ec8e2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:20.079004 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c68d6b67-8ec9-4b0c-9314-aae8b22ec8e2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:20.079444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c68d6b67-8ec9-4b0c-9314-aae8b22ec8e2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:20.080186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c68d6b67-8ec9-4b0c-9314-aae8b22ec8e2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:20.080638 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c68d6b67-8ec9-4b0c-9314-aae8b22ec8e2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:20.142064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c68d6b67-8ec9-4b0c-9314-aae8b22ec8e2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:20.152347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c68d6b67-8ec9-4b0c-9314-aae8b22ec8e2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:20.152347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c68d6b67-8ec9-4b0c-9314-aae8b22ec8e2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:20.153106 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c68d6b67-8ec9-4b0c-9314-aae8b22ec8e2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085049 Jul 27 23:07:20.153652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1122/2069] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:21.176801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9d00316e-bafe-481b-b98f-a09b3d182181 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:21.177651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9d00316e-bafe-481b-b98f-a09b3d182181 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:21.186012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d00316e-bafe-481b-b98f-a09b3d182181 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:21.186388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d00316e-bafe-481b-b98f-a09b3d182181 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:21.189428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d00316e-bafe-481b-b98f-a09b3d182181 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:21.189921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9d00316e-bafe-481b-b98f-a09b3d182181 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:21.257937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9d00316e-bafe-481b-b98f-a09b3d182181 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:21.266302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9d00316e-bafe-481b-b98f-a09b3d182181 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:21.267789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9d00316e-bafe-481b-b98f-a09b3d182181 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:21.268954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9d00316e-bafe-481b-b98f-a09b3d182181 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.096238 Jul 27 23:07:21.269520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 948/2070] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:21 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:22.292765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-630f6612-c75a-42e9-b12a-fb6ab4a0aac5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:22.293371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-630f6612-c75a-42e9-b12a-fb6ab4a0aac5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:22.299831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-630f6612-c75a-42e9-b12a-fb6ab4a0aac5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:22.300272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-630f6612-c75a-42e9-b12a-fb6ab4a0aac5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:22.301045 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-630f6612-c75a-42e9-b12a-fb6ab4a0aac5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:22.301479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-630f6612-c75a-42e9-b12a-fb6ab4a0aac5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:22.363357 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-630f6612-c75a-42e9-b12a-fb6ab4a0aac5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:22.372295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-630f6612-c75a-42e9-b12a-fb6ab4a0aac5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:22.373821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-630f6612-c75a-42e9-b12a-fb6ab4a0aac5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:22.374947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-630f6612-c75a-42e9-b12a-fb6ab4a0aac5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086669 Jul 27 23:07:22.375505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1123/2071] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:22 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:23.398672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-89f5c7e7-a016-49fb-b668-4ae8fe911f53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:23.399278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-89f5c7e7-a016-49fb-b668-4ae8fe911f53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:23.405786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89f5c7e7-a016-49fb-b668-4ae8fe911f53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:23.406173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89f5c7e7-a016-49fb-b668-4ae8fe911f53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:23.406928 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89f5c7e7-a016-49fb-b668-4ae8fe911f53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:23.407360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-89f5c7e7-a016-49fb-b668-4ae8fe911f53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:23.467100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-89f5c7e7-a016-49fb-b668-4ae8fe911f53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:23.477911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-89f5c7e7-a016-49fb-b668-4ae8fe911f53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:23.481292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-89f5c7e7-a016-49fb-b668-4ae8fe911f53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:23.483749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-89f5c7e7-a016-49fb-b668-4ae8fe911f53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088670 Jul 27 23:07:23.484354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 949/2072] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:23 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:24.506033 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f734cc0e-9193-4a77-ac3a-5830be352a11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:24.506665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f734cc0e-9193-4a77-ac3a-5830be352a11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:24.513605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f734cc0e-9193-4a77-ac3a-5830be352a11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:24.514048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f734cc0e-9193-4a77-ac3a-5830be352a11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:24.514795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f734cc0e-9193-4a77-ac3a-5830be352a11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:24.515229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f734cc0e-9193-4a77-ac3a-5830be352a11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:24.574722 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f734cc0e-9193-4a77-ac3a-5830be352a11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:24.583162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f734cc0e-9193-4a77-ac3a-5830be352a11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:24.584749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f734cc0e-9193-4a77-ac3a-5830be352a11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:24.586496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f734cc0e-9193-4a77-ac3a-5830be352a11 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084341 Jul 27 23:07:24.587053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1124/2073] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:24 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:25.609572 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-eccbce13-b2c4-4cca-a89b-ff84f93acc8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:25.610211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-eccbce13-b2c4-4cca-a89b-ff84f93acc8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:25.616622 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eccbce13-b2c4-4cca-a89b-ff84f93acc8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:25.617087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eccbce13-b2c4-4cca-a89b-ff84f93acc8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:25.617836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eccbce13-b2c4-4cca-a89b-ff84f93acc8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:25.618263 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eccbce13-b2c4-4cca-a89b-ff84f93acc8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:25.680722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eccbce13-b2c4-4cca-a89b-ff84f93acc8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:25.689275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eccbce13-b2c4-4cca-a89b-ff84f93acc8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:25.690786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eccbce13-b2c4-4cca-a89b-ff84f93acc8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:25.691945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-eccbce13-b2c4-4cca-a89b-ff84f93acc8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086481 Jul 27 23:07:25.692535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 950/2074] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:25 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:26.714576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d3f1ebca-68e8-4100-a482-542fdfd26d20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:26.715091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d3f1ebca-68e8-4100-a482-542fdfd26d20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:26.721585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d3f1ebca-68e8-4100-a482-542fdfd26d20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:26.722026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d3f1ebca-68e8-4100-a482-542fdfd26d20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:26.722773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d3f1ebca-68e8-4100-a482-542fdfd26d20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:26.723221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d3f1ebca-68e8-4100-a482-542fdfd26d20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:26.782909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d3f1ebca-68e8-4100-a482-542fdfd26d20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:26.793766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d3f1ebca-68e8-4100-a482-542fdfd26d20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:26.795578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d3f1ebca-68e8-4100-a482-542fdfd26d20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:26.796810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d3f1ebca-68e8-4100-a482-542fdfd26d20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086133 Jul 27 23:07:26.797422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1125/2075] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:26 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:27.819920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e40f7649-7424-4cf3-98ba-a0073d39380e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:27.821183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e40f7649-7424-4cf3-98ba-a0073d39380e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:27.827962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e40f7649-7424-4cf3-98ba-a0073d39380e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:27.828402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e40f7649-7424-4cf3-98ba-a0073d39380e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:27.829192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e40f7649-7424-4cf3-98ba-a0073d39380e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:27.830874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e40f7649-7424-4cf3-98ba-a0073d39380e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:27.892372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e40f7649-7424-4cf3-98ba-a0073d39380e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:27.900759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e40f7649-7424-4cf3-98ba-a0073d39380e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:27.902246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e40f7649-7424-4cf3-98ba-a0073d39380e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:27.903381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e40f7649-7424-4cf3-98ba-a0073d39380e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087399 Jul 27 23:07:27.903929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 951/2076] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:27 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:28.925891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-95a6e343-ab1f-4512-99b4-868406b3f70d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:28.926438 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-95a6e343-ab1f-4512-99b4-868406b3f70d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:28.932953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-95a6e343-ab1f-4512-99b4-868406b3f70d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:28.933398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-95a6e343-ab1f-4512-99b4-868406b3f70d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:28.934149 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-95a6e343-ab1f-4512-99b4-868406b3f70d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:28.934580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-95a6e343-ab1f-4512-99b4-868406b3f70d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:28.994926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-95a6e343-ab1f-4512-99b4-868406b3f70d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:29.003374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-95a6e343-ab1f-4512-99b4-868406b3f70d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:29.004904 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-95a6e343-ab1f-4512-99b4-868406b3f70d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:29.006032 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-95a6e343-ab1f-4512-99b4-868406b3f70d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084091 Jul 27 23:07:29.006582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1126/2077] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:28 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:30.033705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-94176ed5-688c-48e9-9df7-f85d6be7d1c8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:30.034315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-94176ed5-688c-48e9-9df7-f85d6be7d1c8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:30.041395 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94176ed5-688c-48e9-9df7-f85d6be7d1c8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:30.041846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94176ed5-688c-48e9-9df7-f85d6be7d1c8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:30.042615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94176ed5-688c-48e9-9df7-f85d6be7d1c8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:30.043050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94176ed5-688c-48e9-9df7-f85d6be7d1c8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:30.105826 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-94176ed5-688c-48e9-9df7-f85d6be7d1c8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:30.114469 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-94176ed5-688c-48e9-9df7-f85d6be7d1c8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:30.115980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-94176ed5-688c-48e9-9df7-f85d6be7d1c8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:30.117256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-94176ed5-688c-48e9-9df7-f85d6be7d1c8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087449 Jul 27 23:07:30.117812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 952/2078] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:07:31.139522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7e40581f-69c1-438e-a015-0af440c7745d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:31.140099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7e40581f-69c1-438e-a015-0af440c7745d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:31.146501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e40581f-69c1-438e-a015-0af440c7745d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:31.146941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e40581f-69c1-438e-a015-0af440c7745d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:31.147681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e40581f-69c1-438e-a015-0af440c7745d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:31.148138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e40581f-69c1-438e-a015-0af440c7745d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:31.208527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7e40581f-69c1-438e-a015-0af440c7745d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:31.216804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7e40581f-69c1-438e-a015-0af440c7745d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:31.218297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7e40581f-69c1-438e-a015-0af440c7745d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:31.219418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7e40581f-69c1-438e-a015-0af440c7745d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083845 Jul 27 23:07:31.219968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1127/2079] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:31 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:32.243211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-046f0fd1-0167-4b49-91ee-2f3a7f553ef2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:32.243764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-046f0fd1-0167-4b49-91ee-2f3a7f553ef2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:32.250367 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-046f0fd1-0167-4b49-91ee-2f3a7f553ef2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:32.250814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-046f0fd1-0167-4b49-91ee-2f3a7f553ef2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:32.251574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-046f0fd1-0167-4b49-91ee-2f3a7f553ef2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:32.252011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-046f0fd1-0167-4b49-91ee-2f3a7f553ef2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:32.311838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-046f0fd1-0167-4b49-91ee-2f3a7f553ef2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:32.320091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-046f0fd1-0167-4b49-91ee-2f3a7f553ef2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:32.322268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-046f0fd1-0167-4b49-91ee-2f3a7f553ef2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:32.323413 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-046f0fd1-0167-4b49-91ee-2f3a7f553ef2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084680 Jul 27 23:07:32.323965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 953/2080] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:32 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:33.345444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9275bf82-4bda-42a4-a9f8-496e4124219b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:33.346051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9275bf82-4bda-42a4-a9f8-496e4124219b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:33.352591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9275bf82-4bda-42a4-a9f8-496e4124219b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:33.353041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9275bf82-4bda-42a4-a9f8-496e4124219b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:33.353789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9275bf82-4bda-42a4-a9f8-496e4124219b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:33.354219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9275bf82-4bda-42a4-a9f8-496e4124219b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:33.414351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9275bf82-4bda-42a4-a9f8-496e4124219b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:33.422616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9275bf82-4bda-42a4-a9f8-496e4124219b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:33.424106 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9275bf82-4bda-42a4-a9f8-496e4124219b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:33.425262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9275bf82-4bda-42a4-a9f8-496e4124219b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083674 Jul 27 23:07:33.425842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1128/2081] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:34.447619 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d8d7a5d9-4fb8-48c7-b667-98e8281a15ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:34.448218 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d8d7a5d9-4fb8-48c7-b667-98e8281a15ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:34.454767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8d7a5d9-4fb8-48c7-b667-98e8281a15ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:34.455207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8d7a5d9-4fb8-48c7-b667-98e8281a15ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:34.455960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8d7a5d9-4fb8-48c7-b667-98e8281a15ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:34.456393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8d7a5d9-4fb8-48c7-b667-98e8281a15ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:34.518842 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d8d7a5d9-4fb8-48c7-b667-98e8281a15ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:34.527514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d8d7a5d9-4fb8-48c7-b667-98e8281a15ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:34.529020 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d8d7a5d9-4fb8-48c7-b667-98e8281a15ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:34.530146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d8d7a5d9-4fb8-48c7-b667-98e8281a15ec tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086452 Jul 27 23:07:34.530686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 954/2082] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:34 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:35.553290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1c0e040a-2f0b-46c8-bd76-b1b9d6f2a844 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:35.553898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1c0e040a-2f0b-46c8-bd76-b1b9d6f2a844 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:35.560896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c0e040a-2f0b-46c8-bd76-b1b9d6f2a844 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:35.561340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c0e040a-2f0b-46c8-bd76-b1b9d6f2a844 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:35.562087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c0e040a-2f0b-46c8-bd76-b1b9d6f2a844 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:35.562519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c0e040a-2f0b-46c8-bd76-b1b9d6f2a844 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:35.623783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1c0e040a-2f0b-46c8-bd76-b1b9d6f2a844 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:35.632222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1c0e040a-2f0b-46c8-bd76-b1b9d6f2a844 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:35.633774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1c0e040a-2f0b-46c8-bd76-b1b9d6f2a844 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:35.635059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1c0e040a-2f0b-46c8-bd76-b1b9d6f2a844 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085505 Jul 27 23:07:35.635586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1129/2083] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:36.657531 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-baf39a3a-13f6-4df0-9968-59aac3191247 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:36.658067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-baf39a3a-13f6-4df0-9968-59aac3191247 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:36.664477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-baf39a3a-13f6-4df0-9968-59aac3191247 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:36.664943 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-baf39a3a-13f6-4df0-9968-59aac3191247 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:36.665688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-baf39a3a-13f6-4df0-9968-59aac3191247 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:36.666117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-baf39a3a-13f6-4df0-9968-59aac3191247 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:36.726421 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-baf39a3a-13f6-4df0-9968-59aac3191247 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:36.735101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-baf39a3a-13f6-4df0-9968-59aac3191247 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:36.736603 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-baf39a3a-13f6-4df0-9968-59aac3191247 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:36.737734 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-baf39a3a-13f6-4df0-9968-59aac3191247 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084189 Jul 27 23:07:36.738285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 955/2084] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:37.761311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-662651a3-7017-4c34-8b95-91544dd47900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:37.761853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-662651a3-7017-4c34-8b95-91544dd47900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:37.768641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-662651a3-7017-4c34-8b95-91544dd47900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:37.769086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-662651a3-7017-4c34-8b95-91544dd47900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:37.769838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-662651a3-7017-4c34-8b95-91544dd47900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:37.770327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-662651a3-7017-4c34-8b95-91544dd47900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:37.834377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-662651a3-7017-4c34-8b95-91544dd47900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:37.842874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-662651a3-7017-4c34-8b95-91544dd47900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:37.844363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-662651a3-7017-4c34-8b95-91544dd47900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:37.845523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-662651a3-7017-4c34-8b95-91544dd47900 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088769 Jul 27 23:07:37.846079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1130/2085] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:38.869687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-03afe63c-0201-45aa-9894-8132f07f9ffc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:38.870302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-03afe63c-0201-45aa-9894-8132f07f9ffc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:38.876813 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-03afe63c-0201-45aa-9894-8132f07f9ffc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:38.877252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-03afe63c-0201-45aa-9894-8132f07f9ffc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:38.878017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-03afe63c-0201-45aa-9894-8132f07f9ffc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:38.878427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-03afe63c-0201-45aa-9894-8132f07f9ffc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:38.940380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-03afe63c-0201-45aa-9894-8132f07f9ffc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:38.948643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-03afe63c-0201-45aa-9894-8132f07f9ffc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:38.950125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-03afe63c-0201-45aa-9894-8132f07f9ffc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:38.951283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-03afe63c-0201-45aa-9894-8132f07f9ffc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086259 Jul 27 23:07:38.951829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 956/2086] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:38 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:39.974085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c6f8e7c6-4a6a-416e-ad61-456a966b9fc1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:39.974740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c6f8e7c6-4a6a-416e-ad61-456a966b9fc1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:39.982399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c6f8e7c6-4a6a-416e-ad61-456a966b9fc1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:39.982935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c6f8e7c6-4a6a-416e-ad61-456a966b9fc1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:39.983718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c6f8e7c6-4a6a-416e-ad61-456a966b9fc1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:39.984177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c6f8e7c6-4a6a-416e-ad61-456a966b9fc1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:40.046460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c6f8e7c6-4a6a-416e-ad61-456a966b9fc1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:40.055314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c6f8e7c6-4a6a-416e-ad61-456a966b9fc1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:40.056853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c6f8e7c6-4a6a-416e-ad61-456a966b9fc1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:40.058003 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c6f8e7c6-4a6a-416e-ad61-456a966b9fc1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088477 Jul 27 23:07:40.058542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1131/2087] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:41.081086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c2068b1b-7653-4b3c-b35d-5bdb5614f47b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:41.081692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c2068b1b-7653-4b3c-b35d-5bdb5614f47b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:41.088938 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c2068b1b-7653-4b3c-b35d-5bdb5614f47b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:41.089380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c2068b1b-7653-4b3c-b35d-5bdb5614f47b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:41.090150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c2068b1b-7653-4b3c-b35d-5bdb5614f47b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:41.090582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c2068b1b-7653-4b3c-b35d-5bdb5614f47b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:41.153719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c2068b1b-7653-4b3c-b35d-5bdb5614f47b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:41.162237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c2068b1b-7653-4b3c-b35d-5bdb5614f47b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:41.163726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c2068b1b-7653-4b3c-b35d-5bdb5614f47b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:41.164897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c2068b1b-7653-4b3c-b35d-5bdb5614f47b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087698 Jul 27 23:07:41.165471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 957/2088] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:41.385993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:07:41.386509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:07:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:07:42.188633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ff602c5a-cb38-4325-867a-2986f42e01f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:42.189246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ff602c5a-cb38-4325-867a-2986f42e01f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:42.195335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff602c5a-cb38-4325-867a-2986f42e01f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:42.195785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff602c5a-cb38-4325-867a-2986f42e01f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:42.196540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff602c5a-cb38-4325-867a-2986f42e01f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:42.197002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff602c5a-cb38-4325-867a-2986f42e01f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:42.257079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ff602c5a-cb38-4325-867a-2986f42e01f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:42.265324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ff602c5a-cb38-4325-867a-2986f42e01f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:42.266823 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ff602c5a-cb38-4325-867a-2986f42e01f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:42.267959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ff602c5a-cb38-4325-867a-2986f42e01f6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083357 Jul 27 23:07:42.268509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1132/2089] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:43.291269 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9993de6d-a58c-403d-94ec-fa03f372e24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:43.291895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9993de6d-a58c-403d-94ec-fa03f372e24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:43.294203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=28 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:07:43.299367 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9993de6d-a58c-403d-94ec-fa03f372e24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:43.299808 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9993de6d-a58c-403d-94ec-fa03f372e24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:43.300606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9993de6d-a58c-403d-94ec-fa03f372e24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:43.301046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9993de6d-a58c-403d-94ec-fa03f372e24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:43.305667 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=84 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:07:43.363337 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9993de6d-a58c-403d-94ec-fa03f372e24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:43.372339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9993de6d-a58c-403d-94ec-fa03f372e24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:43.373855 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9993de6d-a58c-403d-94ec-fa03f372e24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:43.374995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9993de6d-a58c-403d-94ec-fa03f372e24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088154 Jul 27 23:07:43.375551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 958/2090] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:44.397625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a9142f32-35b7-465f-baa5-73528d5789a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:44.398230 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a9142f32-35b7-465f-baa5-73528d5789a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:44.400811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=28 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:07:44.406064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9142f32-35b7-465f-baa5-73528d5789a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:44.406507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9142f32-35b7-465f-baa5-73528d5789a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:44.407258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9142f32-35b7-465f-baa5-73528d5789a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:44.407852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9142f32-35b7-465f-baa5-73528d5789a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:44.411889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=84 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:07:44.468241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a9142f32-35b7-465f-baa5-73528d5789a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:44.476461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a9142f32-35b7-465f-baa5-73528d5789a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:44.478056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a9142f32-35b7-465f-baa5-73528d5789a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:44.479213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a9142f32-35b7-465f-baa5-73528d5789a8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085460 Jul 27 23:07:44.479757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1133/2091] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:44 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:45.502438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-60a0c26c-e1e8-4c4b-a627-1b98a6178c50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:45.503061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-60a0c26c-e1e8-4c4b-a627-1b98a6178c50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:45.509975 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60a0c26c-e1e8-4c4b-a627-1b98a6178c50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:45.510410 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60a0c26c-e1e8-4c4b-a627-1b98a6178c50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:45.511159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60a0c26c-e1e8-4c4b-a627-1b98a6178c50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:45.511587 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60a0c26c-e1e8-4c4b-a627-1b98a6178c50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:45.571799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-60a0c26c-e1e8-4c4b-a627-1b98a6178c50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:45.579976 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-60a0c26c-e1e8-4c4b-a627-1b98a6178c50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:45.581499 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-60a0c26c-e1e8-4c4b-a627-1b98a6178c50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:45.582630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-60a0c26c-e1e8-4c4b-a627-1b98a6178c50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084145 Jul 27 23:07:45.583169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 959/2092] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:45 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:46.606073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-89d24fd9-08e8-478e-9c07-1c6aeb470804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:46.607721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-89d24fd9-08e8-478e-9c07-1c6aeb470804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:46.614492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-89d24fd9-08e8-478e-9c07-1c6aeb470804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:46.614940 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-89d24fd9-08e8-478e-9c07-1c6aeb470804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:46.615700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-89d24fd9-08e8-478e-9c07-1c6aeb470804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:46.616132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-89d24fd9-08e8-478e-9c07-1c6aeb470804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:46.676497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-89d24fd9-08e8-478e-9c07-1c6aeb470804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:46.684789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-89d24fd9-08e8-478e-9c07-1c6aeb470804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:46.686274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-89d24fd9-08e8-478e-9c07-1c6aeb470804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:46.687386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-89d24fd9-08e8-478e-9c07-1c6aeb470804 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085747 Jul 27 23:07:46.687933 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1134/2093] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:47.709873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c4dc88b5-bec8-4f69-b252-ea07abb4d80d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:47.710483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c4dc88b5-bec8-4f69-b252-ea07abb4d80d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:47.717551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4dc88b5-bec8-4f69-b252-ea07abb4d80d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:47.718021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4dc88b5-bec8-4f69-b252-ea07abb4d80d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:47.718778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4dc88b5-bec8-4f69-b252-ea07abb4d80d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:47.719208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4dc88b5-bec8-4f69-b252-ea07abb4d80d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:47.781692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c4dc88b5-bec8-4f69-b252-ea07abb4d80d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:47.790115 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c4dc88b5-bec8-4f69-b252-ea07abb4d80d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:47.791618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c4dc88b5-bec8-4f69-b252-ea07abb4d80d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:47.792799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c4dc88b5-bec8-4f69-b252-ea07abb4d80d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086802 Jul 27 23:07:47.793353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 960/2094] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:48.815466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a71c8638-2fb0-4eec-8481-9291812f10cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:48.816056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a71c8638-2fb0-4eec-8481-9291812f10cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:48.822501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a71c8638-2fb0-4eec-8481-9291812f10cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:48.822941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a71c8638-2fb0-4eec-8481-9291812f10cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:48.823681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a71c8638-2fb0-4eec-8481-9291812f10cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:48.824106 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a71c8638-2fb0-4eec-8481-9291812f10cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:48.884078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a71c8638-2fb0-4eec-8481-9291812f10cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:48.892310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a71c8638-2fb0-4eec-8481-9291812f10cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:48.893823 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a71c8638-2fb0-4eec-8481-9291812f10cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:48.894938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a71c8638-2fb0-4eec-8481-9291812f10cb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083377 Jul 27 23:07:48.895478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1135/2095] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:48 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:49.918251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cd46cee4-5489-4eb5-8edc-6e8cfaf84437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:49.918860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cd46cee4-5489-4eb5-8edc-6e8cfaf84437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:49.925095 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd46cee4-5489-4eb5-8edc-6e8cfaf84437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:49.925533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd46cee4-5489-4eb5-8edc-6e8cfaf84437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:49.926280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd46cee4-5489-4eb5-8edc-6e8cfaf84437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:49.926732 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd46cee4-5489-4eb5-8edc-6e8cfaf84437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:49.986667 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cd46cee4-5489-4eb5-8edc-6e8cfaf84437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:49.995644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cd46cee4-5489-4eb5-8edc-6e8cfaf84437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:49.997214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cd46cee4-5489-4eb5-8edc-6e8cfaf84437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:49.998349 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cd46cee4-5489-4eb5-8edc-6e8cfaf84437 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084500 Jul 27 23:07:49.998905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 961/2096] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:49 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:51.020512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-166ea3d8-3a6c-4bf1-896e-c42e0c76ba36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:51.021146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-166ea3d8-3a6c-4bf1-896e-c42e0c76ba36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:51.028770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-166ea3d8-3a6c-4bf1-896e-c42e0c76ba36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:51.029212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-166ea3d8-3a6c-4bf1-896e-c42e0c76ba36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:51.029960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-166ea3d8-3a6c-4bf1-896e-c42e0c76ba36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:51.030385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-166ea3d8-3a6c-4bf1-896e-c42e0c76ba36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:51.094871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-166ea3d8-3a6c-4bf1-896e-c42e0c76ba36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:51.104299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-166ea3d8-3a6c-4bf1-896e-c42e0c76ba36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:51.105814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-166ea3d8-3a6c-4bf1-896e-c42e0c76ba36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:51.106940 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-166ea3d8-3a6c-4bf1-896e-c42e0c76ba36 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.090272 Jul 27 23:07:51.107734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1136/2097] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:51 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:52.129404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a15d50e9-7f9f-4848-95b0-531cbcb90444 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:52.130012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a15d50e9-7f9f-4848-95b0-531cbcb90444 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:52.136680 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a15d50e9-7f9f-4848-95b0-531cbcb90444 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:52.137125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a15d50e9-7f9f-4848-95b0-531cbcb90444 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:52.137883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a15d50e9-7f9f-4848-95b0-531cbcb90444 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:52.138321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a15d50e9-7f9f-4848-95b0-531cbcb90444 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:52.202141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a15d50e9-7f9f-4848-95b0-531cbcb90444 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:52.210539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a15d50e9-7f9f-4848-95b0-531cbcb90444 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:52.212201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a15d50e9-7f9f-4848-95b0-531cbcb90444 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:52.213361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a15d50e9-7f9f-4848-95b0-531cbcb90444 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087878 Jul 27 23:07:52.213915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 962/2098] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:52 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:53.236426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d08f26c4-26da-43c0-b7d4-e2866b84341a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:53.237057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d08f26c4-26da-43c0-b7d4-e2866b84341a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:53.243962 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d08f26c4-26da-43c0-b7d4-e2866b84341a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:53.244399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d08f26c4-26da-43c0-b7d4-e2866b84341a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:53.245168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d08f26c4-26da-43c0-b7d4-e2866b84341a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:53.245595 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d08f26c4-26da-43c0-b7d4-e2866b84341a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:53.304049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d08f26c4-26da-43c0-b7d4-e2866b84341a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:53.312692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d08f26c4-26da-43c0-b7d4-e2866b84341a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:53.314180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d08f26c4-26da-43c0-b7d4-e2866b84341a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:53.315291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d08f26c4-26da-43c0-b7d4-e2866b84341a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083028 Jul 27 23:07:53.315830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1137/2099] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:53 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:54.339210 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-beb4318f-8151-41d5-9ba7-a3fb494e19b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:54.339839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-beb4318f-8151-41d5-9ba7-a3fb494e19b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:54.346344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-beb4318f-8151-41d5-9ba7-a3fb494e19b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:54.346789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-beb4318f-8151-41d5-9ba7-a3fb494e19b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:54.347607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-beb4318f-8151-41d5-9ba7-a3fb494e19b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:54.348036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-beb4318f-8151-41d5-9ba7-a3fb494e19b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:54.407837 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-beb4318f-8151-41d5-9ba7-a3fb494e19b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:54.416100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-beb4318f-8151-41d5-9ba7-a3fb494e19b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:54.417629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-beb4318f-8151-41d5-9ba7-a3fb494e19b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:54.418762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-beb4318f-8151-41d5-9ba7-a3fb494e19b1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084195 Jul 27 23:07:54.419317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 963/2100] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:54 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:55.441416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-79f58cac-db09-4825-8b5e-c33d2fc04ee4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:55.441949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-79f58cac-db09-4825-8b5e-c33d2fc04ee4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:55.448398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79f58cac-db09-4825-8b5e-c33d2fc04ee4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:55.448869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79f58cac-db09-4825-8b5e-c33d2fc04ee4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:55.449618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79f58cac-db09-4825-8b5e-c33d2fc04ee4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:55.450049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79f58cac-db09-4825-8b5e-c33d2fc04ee4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:55.512396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-79f58cac-db09-4825-8b5e-c33d2fc04ee4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:55.520783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-79f58cac-db09-4825-8b5e-c33d2fc04ee4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:55.522295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-79f58cac-db09-4825-8b5e-c33d2fc04ee4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:55.523471 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-79f58cac-db09-4825-8b5e-c33d2fc04ee4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085965 Jul 27 23:07:55.524021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1138/2101] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:55 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:56.553308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d9f39f6c-a6c3-4832-b9ca-c0d08df9e4d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:56.553949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d9f39f6c-a6c3-4832-b9ca-c0d08df9e4d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:56.560954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9f39f6c-a6c3-4832-b9ca-c0d08df9e4d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:56.561400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9f39f6c-a6c3-4832-b9ca-c0d08df9e4d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:56.562161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9f39f6c-a6c3-4832-b9ca-c0d08df9e4d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:56.562586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9f39f6c-a6c3-4832-b9ca-c0d08df9e4d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:56.629090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d9f39f6c-a6c3-4832-b9ca-c0d08df9e4d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:56.637539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d9f39f6c-a6c3-4832-b9ca-c0d08df9e4d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:56.638973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d9f39f6c-a6c3-4832-b9ca-c0d08df9e4d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:56.640119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d9f39f6c-a6c3-4832-b9ca-c0d08df9e4d8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.093649 Jul 27 23:07:56.640697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 964/2102] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:57.662583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-42d2bbc9-1248-4663-993a-ea43a33c8e39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:57.663181 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-42d2bbc9-1248-4663-993a-ea43a33c8e39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:57.670087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42d2bbc9-1248-4663-993a-ea43a33c8e39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:57.670524 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42d2bbc9-1248-4663-993a-ea43a33c8e39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:57.671261 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42d2bbc9-1248-4663-993a-ea43a33c8e39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:57.671686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42d2bbc9-1248-4663-993a-ea43a33c8e39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:57.731870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-42d2bbc9-1248-4663-993a-ea43a33c8e39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:57.740308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-42d2bbc9-1248-4663-993a-ea43a33c8e39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:57.741826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-42d2bbc9-1248-4663-993a-ea43a33c8e39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:57.742946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-42d2bbc9-1248-4663-993a-ea43a33c8e39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084219 Jul 27 23:07:57.743591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1139/2103] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:57 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:58.765287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e2a696e0-97da-465b-ab33-29b1da2b70bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:58.765918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e2a696e0-97da-465b-ab33-29b1da2b70bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:58.772277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e2a696e0-97da-465b-ab33-29b1da2b70bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:58.772765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e2a696e0-97da-465b-ab33-29b1da2b70bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:58.774050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e2a696e0-97da-465b-ab33-29b1da2b70bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:58.774476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e2a696e0-97da-465b-ab33-29b1da2b70bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:58.833916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e2a696e0-97da-465b-ab33-29b1da2b70bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:58.842798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e2a696e0-97da-465b-ab33-29b1da2b70bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:58.844280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e2a696e0-97da-465b-ab33-29b1da2b70bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:58.845444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e2a696e0-97da-465b-ab33-29b1da2b70bd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084096 Jul 27 23:07:58.845992 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 965/2104] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:07:59.868839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2e32708f-007f-4cc0-981c-e88997ed7b4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:07:59.869473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2e32708f-007f-4cc0-981c-e88997ed7b4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:07:59.875854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e32708f-007f-4cc0-981c-e88997ed7b4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:59.876290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e32708f-007f-4cc0-981c-e88997ed7b4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:59.877062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e32708f-007f-4cc0-981c-e88997ed7b4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:07:59.877488 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e32708f-007f-4cc0-981c-e88997ed7b4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:07:59.936577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2e32708f-007f-4cc0-981c-e88997ed7b4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:59.944857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2e32708f-007f-4cc0-981c-e88997ed7b4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:59.946343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2e32708f-007f-4cc0-981c-e88997ed7b4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:07:59.947484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2e32708f-007f-4cc0-981c-e88997ed7b4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083106 Jul 27 23:07:59.948026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1140/2105] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:07:59 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:00.970453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ce34449c-e87f-440e-8709-996203b5af4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:00.971064 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ce34449c-e87f-440e-8709-996203b5af4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:00.977702 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce34449c-e87f-440e-8709-996203b5af4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:00.978149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce34449c-e87f-440e-8709-996203b5af4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:00.978907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce34449c-e87f-440e-8709-996203b5af4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:00.979340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce34449c-e87f-440e-8709-996203b5af4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:01.042183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ce34449c-e87f-440e-8709-996203b5af4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:01.050538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ce34449c-e87f-440e-8709-996203b5af4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:01.052044 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ce34449c-e87f-440e-8709-996203b5af4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:01.053222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ce34449c-e87f-440e-8709-996203b5af4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086699 Jul 27 23:08:01.053800 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 966/2106] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:00 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:02.076888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5dd72428-220c-4c85-8e70-803436cf5d4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:02.077501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5dd72428-220c-4c85-8e70-803436cf5d4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:02.084085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5dd72428-220c-4c85-8e70-803436cf5d4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:02.084533 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5dd72428-220c-4c85-8e70-803436cf5d4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:02.085317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5dd72428-220c-4c85-8e70-803436cf5d4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:02.086364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5dd72428-220c-4c85-8e70-803436cf5d4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:02.146291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5dd72428-220c-4c85-8e70-803436cf5d4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:02.155448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5dd72428-220c-4c85-8e70-803436cf5d4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:02.156878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5dd72428-220c-4c85-8e70-803436cf5d4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:02.158020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5dd72428-220c-4c85-8e70-803436cf5d4e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085065 Jul 27 23:08:02.158579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1141/2107] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:02 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:03.180583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d4dd1cb7-c7ea-41e4-8303-4819c6e0127b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:03.181194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d4dd1cb7-c7ea-41e4-8303-4819c6e0127b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:03.187616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d4dd1cb7-c7ea-41e4-8303-4819c6e0127b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:03.188049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d4dd1cb7-c7ea-41e4-8303-4819c6e0127b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:03.188832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d4dd1cb7-c7ea-41e4-8303-4819c6e0127b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:03.189604 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d4dd1cb7-c7ea-41e4-8303-4819c6e0127b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:03.250587 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d4dd1cb7-c7ea-41e4-8303-4819c6e0127b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:03.259158 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d4dd1cb7-c7ea-41e4-8303-4819c6e0127b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:03.260694 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d4dd1cb7-c7ea-41e4-8303-4819c6e0127b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:03.261834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d4dd1cb7-c7ea-41e4-8303-4819c6e0127b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085217 Jul 27 23:08:03.262390 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 967/2108] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:04.284234 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2f49ef86-fb71-4f39-9022-45588000e886 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:04.284798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2f49ef86-fb71-4f39-9022-45588000e886 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:04.291751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2f49ef86-fb71-4f39-9022-45588000e886 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:04.292193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2f49ef86-fb71-4f39-9022-45588000e886 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:04.292970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2f49ef86-fb71-4f39-9022-45588000e886 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:04.293402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2f49ef86-fb71-4f39-9022-45588000e886 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:04.352712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2f49ef86-fb71-4f39-9022-45588000e886 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:04.361216 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2f49ef86-fb71-4f39-9022-45588000e886 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:04.362714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2f49ef86-fb71-4f39-9022-45588000e886 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:04.363839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2f49ef86-fb71-4f39-9022-45588000e886 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083603 Jul 27 23:08:04.364393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1142/2109] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:04 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:05.387466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-149866e3-afb5-4f3d-ab62-bbd517d7363d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:05.388104 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-149866e3-afb5-4f3d-ab62-bbd517d7363d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:05.394614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-149866e3-afb5-4f3d-ab62-bbd517d7363d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:05.395058 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-149866e3-afb5-4f3d-ab62-bbd517d7363d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:05.395805 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-149866e3-afb5-4f3d-ab62-bbd517d7363d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:05.396231 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-149866e3-afb5-4f3d-ab62-bbd517d7363d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:05.458464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-149866e3-afb5-4f3d-ab62-bbd517d7363d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:05.466750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-149866e3-afb5-4f3d-ab62-bbd517d7363d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:05.468233 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-149866e3-afb5-4f3d-ab62-bbd517d7363d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:05.469384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-149866e3-afb5-4f3d-ab62-bbd517d7363d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086435 Jul 27 23:08:05.469926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 968/2110] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:05 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:06.492460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-558e7dad-d026-49e8-9729-0085b2e7901b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:06.493086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-558e7dad-d026-49e8-9729-0085b2e7901b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:06.499490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-558e7dad-d026-49e8-9729-0085b2e7901b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:06.499925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-558e7dad-d026-49e8-9729-0085b2e7901b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:06.500687 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-558e7dad-d026-49e8-9729-0085b2e7901b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:06.501115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-558e7dad-d026-49e8-9729-0085b2e7901b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:06.562500 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-558e7dad-d026-49e8-9729-0085b2e7901b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:06.571192 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-558e7dad-d026-49e8-9729-0085b2e7901b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:06.572717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-558e7dad-d026-49e8-9729-0085b2e7901b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:06.573841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-558e7dad-d026-49e8-9729-0085b2e7901b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085209 Jul 27 23:08:06.574380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1143/2111] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:07.596977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d0e9fbc1-47c3-4e2a-8e3a-51e39c084ec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:07.597586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d0e9fbc1-47c3-4e2a-8e3a-51e39c084ec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:07.604698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d0e9fbc1-47c3-4e2a-8e3a-51e39c084ec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:07.605146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d0e9fbc1-47c3-4e2a-8e3a-51e39c084ec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:07.605903 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d0e9fbc1-47c3-4e2a-8e3a-51e39c084ec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:07.606338 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d0e9fbc1-47c3-4e2a-8e3a-51e39c084ec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:07.671997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d0e9fbc1-47c3-4e2a-8e3a-51e39c084ec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:07.680484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d0e9fbc1-47c3-4e2a-8e3a-51e39c084ec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:07.682029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d0e9fbc1-47c3-4e2a-8e3a-51e39c084ec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:07.683179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d0e9fbc1-47c3-4e2a-8e3a-51e39c084ec2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.090116 Jul 27 23:08:07.683731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 969/2112] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:07 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:08.704606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-42fb1ea2-a6e3-4068-ba91-36025e0a57d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:08.705216 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-42fb1ea2-a6e3-4068-ba91-36025e0a57d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:08.712275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42fb1ea2-a6e3-4068-ba91-36025e0a57d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:08.712726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42fb1ea2-a6e3-4068-ba91-36025e0a57d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:08.713476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42fb1ea2-a6e3-4068-ba91-36025e0a57d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:08.713907 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42fb1ea2-a6e3-4068-ba91-36025e0a57d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:08.773714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-42fb1ea2-a6e3-4068-ba91-36025e0a57d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:08.781993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-42fb1ea2-a6e3-4068-ba91-36025e0a57d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:08.783484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-42fb1ea2-a6e3-4068-ba91-36025e0a57d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:08.784646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-42fb1ea2-a6e3-4068-ba91-36025e0a57d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083867 Jul 27 23:08:08.785205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1144/2113] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:08 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:09.806755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-21d708ac-d31b-47d7-bd3a-7a2f8e248b99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:09.807366 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-21d708ac-d31b-47d7-bd3a-7a2f8e248b99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:09.813906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21d708ac-d31b-47d7-bd3a-7a2f8e248b99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:09.814355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21d708ac-d31b-47d7-bd3a-7a2f8e248b99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:09.815119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21d708ac-d31b-47d7-bd3a-7a2f8e248b99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:09.815553 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21d708ac-d31b-47d7-bd3a-7a2f8e248b99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:09.879234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-21d708ac-d31b-47d7-bd3a-7a2f8e248b99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:09.887691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-21d708ac-d31b-47d7-bd3a-7a2f8e248b99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:09.889244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-21d708ac-d31b-47d7-bd3a-7a2f8e248b99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:09.890434 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-21d708ac-d31b-47d7-bd3a-7a2f8e248b99 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087690 Jul 27 23:08:09.890994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 970/2114] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:09 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:10.913438 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-249c7b78-0e4a-47ed-ab7c-1ea17df09898 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:10.914038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-249c7b78-0e4a-47ed-ab7c-1ea17df09898 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:10.920427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-249c7b78-0e4a-47ed-ab7c-1ea17df09898 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:10.920898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-249c7b78-0e4a-47ed-ab7c-1ea17df09898 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:10.921642 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-249c7b78-0e4a-47ed-ab7c-1ea17df09898 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:10.922068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-249c7b78-0e4a-47ed-ab7c-1ea17df09898 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:10.982677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-249c7b78-0e4a-47ed-ab7c-1ea17df09898 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:10.990909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-249c7b78-0e4a-47ed-ab7c-1ea17df09898 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:10.992379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-249c7b78-0e4a-47ed-ab7c-1ea17df09898 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:10.993604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-249c7b78-0e4a-47ed-ab7c-1ea17df09898 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084045 Jul 27 23:08:10.994154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1145/2115] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:10 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:12.016377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b0035508-7e3d-4b47-822f-23632c66597e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:12.017027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b0035508-7e3d-4b47-822f-23632c66597e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:12.023790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b0035508-7e3d-4b47-822f-23632c66597e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:12.024234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b0035508-7e3d-4b47-822f-23632c66597e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:12.025027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b0035508-7e3d-4b47-822f-23632c66597e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:12.025457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b0035508-7e3d-4b47-822f-23632c66597e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:12.088262 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b0035508-7e3d-4b47-822f-23632c66597e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:12.096518 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b0035508-7e3d-4b47-822f-23632c66597e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:12.098026 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b0035508-7e3d-4b47-822f-23632c66597e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:12.099156 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b0035508-7e3d-4b47-822f-23632c66597e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086732 Jul 27 23:08:12.099714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 971/2116] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:13.122006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-803105d5-81cf-4b66-a57d-e54f534cddb3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:13.122613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-803105d5-81cf-4b66-a57d-e54f534cddb3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:13.128970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-803105d5-81cf-4b66-a57d-e54f534cddb3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:13.129413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-803105d5-81cf-4b66-a57d-e54f534cddb3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:13.130167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-803105d5-81cf-4b66-a57d-e54f534cddb3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:13.130601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-803105d5-81cf-4b66-a57d-e54f534cddb3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:13.190752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-803105d5-81cf-4b66-a57d-e54f534cddb3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:13.202418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-803105d5-81cf-4b66-a57d-e54f534cddb3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:13.204786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-803105d5-81cf-4b66-a57d-e54f534cddb3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:13.206999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-803105d5-81cf-4b66-a57d-e54f534cddb3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088432 Jul 27 23:08:13.208040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1146/2117] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:14.235090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a07acb36-e92d-45b3-86a1-82c97b46bbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:14.235692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a07acb36-e92d-45b3-86a1-82c97b46bbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:14.237994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=28 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:08:14.243513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a07acb36-e92d-45b3-86a1-82c97b46bbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:14.243961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a07acb36-e92d-45b3-86a1-82c97b46bbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:14.244751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a07acb36-e92d-45b3-86a1-82c97b46bbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:14.245187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a07acb36-e92d-45b3-86a1-82c97b46bbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:14.247766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=84 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:08:14.310643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a07acb36-e92d-45b3-86a1-82c97b46bbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:14.319002 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a07acb36-e92d-45b3-86a1-82c97b46bbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:14.320534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a07acb36-e92d-45b3-86a1-82c97b46bbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:14.321690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a07acb36-e92d-45b3-86a1-82c97b46bbce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.091244 Jul 27 23:08:14.322257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 972/2118] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:14 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:15.344586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-90a207ca-d55d-44d7-81a9-4ee5c4bdadf0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:15.345125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-90a207ca-d55d-44d7-81a9-4ee5c4bdadf0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:15.347443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=28 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:08:15.353352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90a207ca-d55d-44d7-81a9-4ee5c4bdadf0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:15.353798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90a207ca-d55d-44d7-81a9-4ee5c4bdadf0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:15.354549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90a207ca-d55d-44d7-81a9-4ee5c4bdadf0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:15.354981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90a207ca-d55d-44d7-81a9-4ee5c4bdadf0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:15.357906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=84 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:08:15.416089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-90a207ca-d55d-44d7-81a9-4ee5c4bdadf0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:15.424300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-90a207ca-d55d-44d7-81a9-4ee5c4bdadf0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:15.425852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-90a207ca-d55d-44d7-81a9-4ee5c4bdadf0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:15.426957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-90a207ca-d55d-44d7-81a9-4ee5c4bdadf0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086313 Jul 27 23:08:15.427505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1147/2119] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:15 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:16.450509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ef66595c-6fa8-404d-80b5-61618f9e8369 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:16.451051 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ef66595c-6fa8-404d-80b5-61618f9e8369 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:16.457495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ef66595c-6fa8-404d-80b5-61618f9e8369 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:16.457942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ef66595c-6fa8-404d-80b5-61618f9e8369 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:16.458705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ef66595c-6fa8-404d-80b5-61618f9e8369 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:16.459144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ef66595c-6fa8-404d-80b5-61618f9e8369 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:16.519230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ef66595c-6fa8-404d-80b5-61618f9e8369 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:16.527607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ef66595c-6fa8-404d-80b5-61618f9e8369 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:16.529149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ef66595c-6fa8-404d-80b5-61618f9e8369 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:16.530293 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ef66595c-6fa8-404d-80b5-61618f9e8369 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083763 Jul 27 23:08:16.530845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 973/2120] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:16 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:17.553170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b3639520-8de1-4a2b-ae92-f28dec2915f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:17.553774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b3639520-8de1-4a2b-ae92-f28dec2915f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:17.560220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3639520-8de1-4a2b-ae92-f28dec2915f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:17.560689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3639520-8de1-4a2b-ae92-f28dec2915f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:17.561461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3639520-8de1-4a2b-ae92-f28dec2915f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:17.561887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3639520-8de1-4a2b-ae92-f28dec2915f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:17.622628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b3639520-8de1-4a2b-ae92-f28dec2915f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:17.630921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b3639520-8de1-4a2b-ae92-f28dec2915f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:17.632935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b3639520-8de1-4a2b-ae92-f28dec2915f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:17.634052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b3639520-8de1-4a2b-ae92-f28dec2915f0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084860 Jul 27 23:08:17.634601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1148/2121] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:17 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:18.656849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7218bc19-fe78-4def-b8ed-27955c88be49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:18.657439 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7218bc19-fe78-4def-b8ed-27955c88be49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:18.664160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7218bc19-fe78-4def-b8ed-27955c88be49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:18.664628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7218bc19-fe78-4def-b8ed-27955c88be49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:18.665394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7218bc19-fe78-4def-b8ed-27955c88be49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:18.665826 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7218bc19-fe78-4def-b8ed-27955c88be49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:18.730186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7218bc19-fe78-4def-b8ed-27955c88be49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:18.738757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7218bc19-fe78-4def-b8ed-27955c88be49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:18.740239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7218bc19-fe78-4def-b8ed-27955c88be49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:18.741405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7218bc19-fe78-4def-b8ed-27955c88be49 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088748 Jul 27 23:08:18.741957 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 974/2122] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:19.763980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-11238854-6554-4642-b99d-415b43324cc4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:19.764514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-11238854-6554-4642-b99d-415b43324cc4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:19.770883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11238854-6554-4642-b99d-415b43324cc4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:19.771322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11238854-6554-4642-b99d-415b43324cc4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:19.772164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11238854-6554-4642-b99d-415b43324cc4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:19.772620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-11238854-6554-4642-b99d-415b43324cc4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:19.835614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-11238854-6554-4642-b99d-415b43324cc4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:19.843896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-11238854-6554-4642-b99d-415b43324cc4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:19.845410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-11238854-6554-4642-b99d-415b43324cc4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:19.846522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-11238854-6554-4642-b99d-415b43324cc4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086613 Jul 27 23:08:19.847068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1149/2123] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:19 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:20.869895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dbcff67a-6c5d-471d-beba-b8353117ee38 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:20.870504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dbcff67a-6c5d-471d-beba-b8353117ee38 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:20.877072 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dbcff67a-6c5d-471d-beba-b8353117ee38 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:20.877511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dbcff67a-6c5d-471d-beba-b8353117ee38 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:20.878259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dbcff67a-6c5d-471d-beba-b8353117ee38 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:20.878686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dbcff67a-6c5d-471d-beba-b8353117ee38 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:20.939277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-dbcff67a-6c5d-471d-beba-b8353117ee38 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:20.948125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-dbcff67a-6c5d-471d-beba-b8353117ee38 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:20.949655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-dbcff67a-6c5d-471d-beba-b8353117ee38 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:20.950796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dbcff67a-6c5d-471d-beba-b8353117ee38 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084829 Jul 27 23:08:20.951354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 975/2124] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:21.973776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c8be89ca-db8d-46be-a4ed-0e4350c3b19f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:21.974361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c8be89ca-db8d-46be-a4ed-0e4350c3b19f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:21.981018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8be89ca-db8d-46be-a4ed-0e4350c3b19f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:21.981463 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8be89ca-db8d-46be-a4ed-0e4350c3b19f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:21.982469 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8be89ca-db8d-46be-a4ed-0e4350c3b19f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:21.982903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8be89ca-db8d-46be-a4ed-0e4350c3b19f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:22.047791 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c8be89ca-db8d-46be-a4ed-0e4350c3b19f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:22.058123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c8be89ca-db8d-46be-a4ed-0e4350c3b19f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:22.059606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c8be89ca-db8d-46be-a4ed-0e4350c3b19f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:22.060766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c8be89ca-db8d-46be-a4ed-0e4350c3b19f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.091000 Jul 27 23:08:22.061312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1150/2125] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:21 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:23.084112 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1f971ac7-a2cf-47bd-b185-e14ccbcf33ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:23.085982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1f971ac7-a2cf-47bd-b185-e14ccbcf33ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:23.092512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f971ac7-a2cf-47bd-b185-e14ccbcf33ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:23.092994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f971ac7-a2cf-47bd-b185-e14ccbcf33ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:23.093765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f971ac7-a2cf-47bd-b185-e14ccbcf33ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:23.094201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1f971ac7-a2cf-47bd-b185-e14ccbcf33ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:23.158272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1f971ac7-a2cf-47bd-b185-e14ccbcf33ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:23.166576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1f971ac7-a2cf-47bd-b185-e14ccbcf33ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:23.168083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1f971ac7-a2cf-47bd-b185-e14ccbcf33ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:23.169301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1f971ac7-a2cf-47bd-b185-e14ccbcf33ee tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.089151 Jul 27 23:08:23.169871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 976/2126] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:23 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:24.192698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-afbef5b0-8d63-414b-b65a-aca3e2aad6fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:24.193333 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-afbef5b0-8d63-414b-b65a-aca3e2aad6fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:24.200937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afbef5b0-8d63-414b-b65a-aca3e2aad6fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:24.201376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afbef5b0-8d63-414b-b65a-aca3e2aad6fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:24.202156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afbef5b0-8d63-414b-b65a-aca3e2aad6fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:24.202582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afbef5b0-8d63-414b-b65a-aca3e2aad6fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:24.263068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-afbef5b0-8d63-414b-b65a-aca3e2aad6fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:24.271323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-afbef5b0-8d63-414b-b65a-aca3e2aad6fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:24.272838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-afbef5b0-8d63-414b-b65a-aca3e2aad6fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:24.274021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-afbef5b0-8d63-414b-b65a-aca3e2aad6fd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085415 Jul 27 23:08:24.274562 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1151/2127] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:24 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:25.296582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-66fbb6b6-9f96-4b65-a222-39f5f292f9bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:25.297195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-66fbb6b6-9f96-4b65-a222-39f5f292f9bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:25.303804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-66fbb6b6-9f96-4b65-a222-39f5f292f9bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:25.304253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-66fbb6b6-9f96-4b65-a222-39f5f292f9bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:25.305707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-66fbb6b6-9f96-4b65-a222-39f5f292f9bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:25.306144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-66fbb6b6-9f96-4b65-a222-39f5f292f9bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:25.368261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-66fbb6b6-9f96-4b65-a222-39f5f292f9bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:25.376536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-66fbb6b6-9f96-4b65-a222-39f5f292f9bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:25.378058 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-66fbb6b6-9f96-4b65-a222-39f5f292f9bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:25.379225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-66fbb6b6-9f96-4b65-a222-39f5f292f9bb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086591 Jul 27 23:08:25.379782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 977/2128] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:25 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:26.400711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1846ce02-ad57-443a-a9f5-ca9832559a9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:26.401312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1846ce02-ad57-443a-a9f5-ca9832559a9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:26.407651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1846ce02-ad57-443a-a9f5-ca9832559a9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:26.408094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1846ce02-ad57-443a-a9f5-ca9832559a9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:26.408866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1846ce02-ad57-443a-a9f5-ca9832559a9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:26.409290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1846ce02-ad57-443a-a9f5-ca9832559a9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:26.469695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1846ce02-ad57-443a-a9f5-ca9832559a9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:26.478460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1846ce02-ad57-443a-a9f5-ca9832559a9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:26.479954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1846ce02-ad57-443a-a9f5-ca9832559a9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:26.481114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1846ce02-ad57-443a-a9f5-ca9832559a9c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084292 Jul 27 23:08:26.481669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1152/2129] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:26 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:27.504236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2d5f1a76-3348-458b-a057-9f7d55abec2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:27.504891 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2d5f1a76-3348-458b-a057-9f7d55abec2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:27.511806 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a76-3348-458b-a057-9f7d55abec2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:27.512251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a76-3348-458b-a057-9f7d55abec2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:27.513050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a76-3348-458b-a057-9f7d55abec2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:27.513489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a76-3348-458b-a057-9f7d55abec2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:27.577371 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2d5f1a76-3348-458b-a057-9f7d55abec2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:27.585711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2d5f1a76-3348-458b-a057-9f7d55abec2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:27.587877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2d5f1a76-3348-458b-a057-9f7d55abec2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:27.589050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2d5f1a76-3348-458b-a057-9f7d55abec2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088841 Jul 27 23:08:27.589596 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 978/2130] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:27 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:28.611416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e5fd815a-4dc4-4b9d-8b0a-79ec2d37ed0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:28.612020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e5fd815a-4dc4-4b9d-8b0a-79ec2d37ed0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:28.618460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5fd815a-4dc4-4b9d-8b0a-79ec2d37ed0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:28.618901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5fd815a-4dc4-4b9d-8b0a-79ec2d37ed0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:28.619651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5fd815a-4dc4-4b9d-8b0a-79ec2d37ed0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:28.620080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5fd815a-4dc4-4b9d-8b0a-79ec2d37ed0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:28.680595 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e5fd815a-4dc4-4b9d-8b0a-79ec2d37ed0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:28.688871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e5fd815a-4dc4-4b9d-8b0a-79ec2d37ed0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:28.690347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e5fd815a-4dc4-4b9d-8b0a-79ec2d37ed0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:28.691480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e5fd815a-4dc4-4b9d-8b0a-79ec2d37ed0b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084206 Jul 27 23:08:28.692361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1153/2131] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:28 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:29.714069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6ff4ce09-bbf9-4c86-9b8f-bc72744c3c16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:29.714665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6ff4ce09-bbf9-4c86-9b8f-bc72744c3c16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:29.721101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6ff4ce09-bbf9-4c86-9b8f-bc72744c3c16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:29.721544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6ff4ce09-bbf9-4c86-9b8f-bc72744c3c16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:29.722299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6ff4ce09-bbf9-4c86-9b8f-bc72744c3c16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:29.722728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6ff4ce09-bbf9-4c86-9b8f-bc72744c3c16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:29.783253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6ff4ce09-bbf9-4c86-9b8f-bc72744c3c16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:29.791941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6ff4ce09-bbf9-4c86-9b8f-bc72744c3c16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:29.793461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6ff4ce09-bbf9-4c86-9b8f-bc72744c3c16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:29.794590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6ff4ce09-bbf9-4c86-9b8f-bc72744c3c16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084510 Jul 27 23:08:29.795136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 979/2132] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:29 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:30.817620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-064fab19-154b-4e32-8ee7-0e1649ccaaf8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:30.818231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-064fab19-154b-4e32-8ee7-0e1649ccaaf8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:30.824770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-064fab19-154b-4e32-8ee7-0e1649ccaaf8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:30.825217 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-064fab19-154b-4e32-8ee7-0e1649ccaaf8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:30.825962 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-064fab19-154b-4e32-8ee7-0e1649ccaaf8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:30.826392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-064fab19-154b-4e32-8ee7-0e1649ccaaf8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:30.886314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-064fab19-154b-4e32-8ee7-0e1649ccaaf8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:30.894559 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-064fab19-154b-4e32-8ee7-0e1649ccaaf8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:30.896052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-064fab19-154b-4e32-8ee7-0e1649ccaaf8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:30.897210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-064fab19-154b-4e32-8ee7-0e1649ccaaf8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083522 Jul 27 23:08:30.897759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1154/2133] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:08:31.921918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0be3103c-c1cb-4741-8285-18878e7d5792 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:31.922541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0be3103c-c1cb-4741-8285-18878e7d5792 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:31.929088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0be3103c-c1cb-4741-8285-18878e7d5792 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:31.929535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0be3103c-c1cb-4741-8285-18878e7d5792 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:31.930293 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0be3103c-c1cb-4741-8285-18878e7d5792 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:31.930726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0be3103c-c1cb-4741-8285-18878e7d5792 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:31.993218 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0be3103c-c1cb-4741-8285-18878e7d5792 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:32.001496 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0be3103c-c1cb-4741-8285-18878e7d5792 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:32.002981 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0be3103c-c1cb-4741-8285-18878e7d5792 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:32.004114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0be3103c-c1cb-4741-8285-18878e7d5792 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086166 Jul 27 23:08:32.004687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 980/2134] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:31 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:33.026982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-221723b3-613a-45ba-97f7-16502a6bba81 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:33.027578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-221723b3-613a-45ba-97f7-16502a6bba81 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:33.034078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-221723b3-613a-45ba-97f7-16502a6bba81 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:33.034524 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-221723b3-613a-45ba-97f7-16502a6bba81 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:33.035283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-221723b3-613a-45ba-97f7-16502a6bba81 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:33.035719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-221723b3-613a-45ba-97f7-16502a6bba81 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:33.095728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-221723b3-613a-45ba-97f7-16502a6bba81 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:33.104626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-221723b3-613a-45ba-97f7-16502a6bba81 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:33.106123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-221723b3-613a-45ba-97f7-16502a6bba81 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:33.107235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-221723b3-613a-45ba-97f7-16502a6bba81 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084679 Jul 27 23:08:33.108038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1155/2135] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:34.129215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-31ee6e24-c068-43e8-9090-550a86d80350 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:34.129808 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-31ee6e24-c068-43e8-9090-550a86d80350 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:34.137120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-31ee6e24-c068-43e8-9090-550a86d80350 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:34.137575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-31ee6e24-c068-43e8-9090-550a86d80350 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:34.138476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-31ee6e24-c068-43e8-9090-550a86d80350 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:34.138911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-31ee6e24-c068-43e8-9090-550a86d80350 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:34.199844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-31ee6e24-c068-43e8-9090-550a86d80350 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:34.208256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-31ee6e24-c068-43e8-9090-550a86d80350 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:34.209783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-31ee6e24-c068-43e8-9090-550a86d80350 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:34.210920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-31ee6e24-c068-43e8-9090-550a86d80350 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085635 Jul 27 23:08:34.211506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 981/2136] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:34 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:35.233143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0a69eb63-ba5c-41d3-93de-733a7dbc5b37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:35.233747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0a69eb63-ba5c-41d3-93de-733a7dbc5b37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:35.240282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a69eb63-ba5c-41d3-93de-733a7dbc5b37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:35.240755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a69eb63-ba5c-41d3-93de-733a7dbc5b37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:35.241497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a69eb63-ba5c-41d3-93de-733a7dbc5b37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:35.241922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a69eb63-ba5c-41d3-93de-733a7dbc5b37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:35.307987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0a69eb63-ba5c-41d3-93de-733a7dbc5b37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:35.316339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0a69eb63-ba5c-41d3-93de-733a7dbc5b37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:35.317852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0a69eb63-ba5c-41d3-93de-733a7dbc5b37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:35.319005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0a69eb63-ba5c-41d3-93de-733a7dbc5b37 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.090025 Jul 27 23:08:35.319555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1156/2137] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:36.342034 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d7066a73-fc38-4d5d-9272-1773a097264c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:36.342640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d7066a73-fc38-4d5d-9272-1773a097264c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:36.349050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7066a73-fc38-4d5d-9272-1773a097264c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:36.349490 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7066a73-fc38-4d5d-9272-1773a097264c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:36.350237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7066a73-fc38-4d5d-9272-1773a097264c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:36.350666 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7066a73-fc38-4d5d-9272-1773a097264c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:36.413291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d7066a73-fc38-4d5d-9272-1773a097264c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:36.422050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d7066a73-fc38-4d5d-9272-1773a097264c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:36.423533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d7066a73-fc38-4d5d-9272-1773a097264c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:36.424694 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d7066a73-fc38-4d5d-9272-1773a097264c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086617 Jul 27 23:08:36.425242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 982/2138] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:37.448420 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-86391f8b-5c2c-49fd-b9d4-43e41ed21db6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:37.448997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-86391f8b-5c2c-49fd-b9d4-43e41ed21db6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:37.455343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-86391f8b-5c2c-49fd-b9d4-43e41ed21db6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:37.455782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-86391f8b-5c2c-49fd-b9d4-43e41ed21db6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:37.456530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-86391f8b-5c2c-49fd-b9d4-43e41ed21db6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:37.457051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-86391f8b-5c2c-49fd-b9d4-43e41ed21db6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:37.517408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-86391f8b-5c2c-49fd-b9d4-43e41ed21db6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:37.525746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-86391f8b-5c2c-49fd-b9d4-43e41ed21db6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:37.527238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-86391f8b-5c2c-49fd-b9d4-43e41ed21db6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:37.528367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-86391f8b-5c2c-49fd-b9d4-43e41ed21db6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084572 Jul 27 23:08:37.528956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1157/2139] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:38.550870 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4ad84d75-af3c-4408-bf0b-b487aa3a6db0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:38.551487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4ad84d75-af3c-4408-bf0b-b487aa3a6db0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:38.558042 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4ad84d75-af3c-4408-bf0b-b487aa3a6db0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:38.558490 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4ad84d75-af3c-4408-bf0b-b487aa3a6db0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:38.559256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4ad84d75-af3c-4408-bf0b-b487aa3a6db0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:38.559692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4ad84d75-af3c-4408-bf0b-b487aa3a6db0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:38.619859 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4ad84d75-af3c-4408-bf0b-b487aa3a6db0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:38.628164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4ad84d75-af3c-4408-bf0b-b487aa3a6db0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:38.629708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4ad84d75-af3c-4408-bf0b-b487aa3a6db0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:38.630845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4ad84d75-af3c-4408-bf0b-b487aa3a6db0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083905 Jul 27 23:08:38.631409 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 983/2140] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:38 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:39.655000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7bf27349-c373-4f8e-b459-5cdb07490d8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:39.655630 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7bf27349-c373-4f8e-b459-5cdb07490d8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:39.662029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7bf27349-c373-4f8e-b459-5cdb07490d8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:39.662466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7bf27349-c373-4f8e-b459-5cdb07490d8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:39.663207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7bf27349-c373-4f8e-b459-5cdb07490d8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:39.663636 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7bf27349-c373-4f8e-b459-5cdb07490d8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:39.723982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7bf27349-c373-4f8e-b459-5cdb07490d8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:39.732240 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7bf27349-c373-4f8e-b459-5cdb07490d8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:39.734007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7bf27349-c373-4f8e-b459-5cdb07490d8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:39.735137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7bf27349-c373-4f8e-b459-5cdb07490d8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084024 Jul 27 23:08:39.735668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1158/2141] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:40.758079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4cfdfcc6-b2b3-40a7-959c-aae83fcd0bb2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:40.758687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4cfdfcc6-b2b3-40a7-959c-aae83fcd0bb2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:40.765181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4cfdfcc6-b2b3-40a7-959c-aae83fcd0bb2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:40.765626 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4cfdfcc6-b2b3-40a7-959c-aae83fcd0bb2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:40.766383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4cfdfcc6-b2b3-40a7-959c-aae83fcd0bb2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:40.766812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4cfdfcc6-b2b3-40a7-959c-aae83fcd0bb2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:40.831446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4cfdfcc6-b2b3-40a7-959c-aae83fcd0bb2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:40.840366 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4cfdfcc6-b2b3-40a7-959c-aae83fcd0bb2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:40.841892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4cfdfcc6-b2b3-40a7-959c-aae83fcd0bb2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:40.843090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4cfdfcc6-b2b3-40a7-959c-aae83fcd0bb2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088943 Jul 27 23:08:40.843644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 984/2142] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:41.865830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b3fd7828-d6a6-498e-b4e2-84ba65b042a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:41.866437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b3fd7828-d6a6-498e-b4e2-84ba65b042a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:41.873591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3fd7828-d6a6-498e-b4e2-84ba65b042a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:41.874039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3fd7828-d6a6-498e-b4e2-84ba65b042a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:41.874790 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3fd7828-d6a6-498e-b4e2-84ba65b042a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:41.875230 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3fd7828-d6a6-498e-b4e2-84ba65b042a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:41.936128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b3fd7828-d6a6-498e-b4e2-84ba65b042a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:41.944289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b3fd7828-d6a6-498e-b4e2-84ba65b042a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:41.945831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b3fd7828-d6a6-498e-b4e2-84ba65b042a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:41.946943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b3fd7828-d6a6-498e-b4e2-84ba65b042a2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084962 Jul 27 23:08:41.947496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1159/2143] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:42.969733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9ef96b02-2a26-4cd7-9eeb-d9aa1d7da4b9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:42.970348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9ef96b02-2a26-4cd7-9eeb-d9aa1d7da4b9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:42.977476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9ef96b02-2a26-4cd7-9eeb-d9aa1d7da4b9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:42.977921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9ef96b02-2a26-4cd7-9eeb-d9aa1d7da4b9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:42.978691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9ef96b02-2a26-4cd7-9eeb-d9aa1d7da4b9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:42.979126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9ef96b02-2a26-4cd7-9eeb-d9aa1d7da4b9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:43.038311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9ef96b02-2a26-4cd7-9eeb-d9aa1d7da4b9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:43.047213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9ef96b02-2a26-4cd7-9eeb-d9aa1d7da4b9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:43.048761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9ef96b02-2a26-4cd7-9eeb-d9aa1d7da4b9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:43.049901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9ef96b02-2a26-4cd7-9eeb-d9aa1d7da4b9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084141 Jul 27 23:08:43.050449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 985/2144] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:44.072798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-de9916f5-1ba4-4d05-82ff-c71daf90d0d9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:44.073426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-de9916f5-1ba4-4d05-82ff-c71daf90d0d9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:44.079805 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de9916f5-1ba4-4d05-82ff-c71daf90d0d9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:44.080247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de9916f5-1ba4-4d05-82ff-c71daf90d0d9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:44.081010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de9916f5-1ba4-4d05-82ff-c71daf90d0d9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:44.081437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de9916f5-1ba4-4d05-82ff-c71daf90d0d9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:44.141512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-de9916f5-1ba4-4d05-82ff-c71daf90d0d9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:44.150361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-de9916f5-1ba4-4d05-82ff-c71daf90d0d9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:44.152019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-de9916f5-1ba4-4d05-82ff-c71daf90d0d9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:44.153175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-de9916f5-1ba4-4d05-82ff-c71daf90d0d9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084821 Jul 27 23:08:44.153725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1160/2145] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:44 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:45.175602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-41244138-b97d-4e39-b320-cc73f65e7911 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:45.176207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-41244138-b97d-4e39-b320-cc73f65e7911 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:45.178623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=28 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:08:45.183906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41244138-b97d-4e39-b320-cc73f65e7911 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:45.184347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41244138-b97d-4e39-b320-cc73f65e7911 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:45.185137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41244138-b97d-4e39-b320-cc73f65e7911 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:45.185564 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41244138-b97d-4e39-b320-cc73f65e7911 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:45.189558 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=84 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:08:45.248539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-41244138-b97d-4e39-b320-cc73f65e7911 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:45.256799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-41244138-b97d-4e39-b320-cc73f65e7911 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:45.258458 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-41244138-b97d-4e39-b320-cc73f65e7911 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:45.259586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-41244138-b97d-4e39-b320-cc73f65e7911 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087898 Jul 27 23:08:45.260137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 986/2146] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:45 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:46.282285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-56d48855-b33c-45cd-8963-a87645fb6554 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:46.282826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-56d48855-b33c-45cd-8963-a87645fb6554 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:46.285241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=28 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:08:46.290554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56d48855-b33c-45cd-8963-a87645fb6554 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:46.290991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56d48855-b33c-45cd-8963-a87645fb6554 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:46.291731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56d48855-b33c-45cd-8963-a87645fb6554 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:46.292154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56d48855-b33c-45cd-8963-a87645fb6554 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:46.296104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=84 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:08:46.352384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-56d48855-b33c-45cd-8963-a87645fb6554 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:46.360932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-56d48855-b33c-45cd-8963-a87645fb6554 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:46.362414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-56d48855-b33c-45cd-8963-a87645fb6554 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:46.363523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-56d48855-b33c-45cd-8963-a87645fb6554 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085170 Jul 27 23:08:46.364061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1161/2147] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:47.385313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-806b3498-65d6-42d7-8cc2-3714a4bde88e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:47.385919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-806b3498-65d6-42d7-8cc2-3714a4bde88e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:47.392401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-806b3498-65d6-42d7-8cc2-3714a4bde88e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:47.392879 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-806b3498-65d6-42d7-8cc2-3714a4bde88e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:47.393638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-806b3498-65d6-42d7-8cc2-3714a4bde88e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:47.394071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-806b3498-65d6-42d7-8cc2-3714a4bde88e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:47.454030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-806b3498-65d6-42d7-8cc2-3714a4bde88e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:47.463035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-806b3498-65d6-42d7-8cc2-3714a4bde88e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:47.464522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-806b3498-65d6-42d7-8cc2-3714a4bde88e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:47.465676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-806b3498-65d6-42d7-8cc2-3714a4bde88e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084315 Jul 27 23:08:47.466229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 987/2148] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:48.489115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5d649a06-529c-4d40-9345-edcb9e7a61d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:48.489748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5d649a06-529c-4d40-9345-edcb9e7a61d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:48.496865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d649a06-529c-4d40-9345-edcb9e7a61d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:48.497307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d649a06-529c-4d40-9345-edcb9e7a61d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:48.498054 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d649a06-529c-4d40-9345-edcb9e7a61d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:48.498480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5d649a06-529c-4d40-9345-edcb9e7a61d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:48.558381 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5d649a06-529c-4d40-9345-edcb9e7a61d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:48.566585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5d649a06-529c-4d40-9345-edcb9e7a61d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:48.568084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5d649a06-529c-4d40-9345-edcb9e7a61d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:48.569248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5d649a06-529c-4d40-9345-edcb9e7a61d1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083996 Jul 27 23:08:48.569795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1162/2149] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:48 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:49.591437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3b0535c3-060b-42b5-9bb1-f2285b8f03ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:49.592070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3b0535c3-060b-42b5-9bb1-f2285b8f03ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:49.598030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b0535c3-060b-42b5-9bb1-f2285b8f03ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:49.598472 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b0535c3-060b-42b5-9bb1-f2285b8f03ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:49.599253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b0535c3-060b-42b5-9bb1-f2285b8f03ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:49.599680 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b0535c3-060b-42b5-9bb1-f2285b8f03ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:49.661889 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3b0535c3-060b-42b5-9bb1-f2285b8f03ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:49.670116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3b0535c3-060b-42b5-9bb1-f2285b8f03ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:49.671589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3b0535c3-060b-42b5-9bb1-f2285b8f03ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:49.672746 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3b0535c3-060b-42b5-9bb1-f2285b8f03ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085337 Jul 27 23:08:49.673302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 988/2150] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:49 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:08:50.697346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a4cefc8d-6225-4df6-8523-416f16988df8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:50.697934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a4cefc8d-6225-4df6-8523-416f16988df8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:50.704327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4cefc8d-6225-4df6-8523-416f16988df8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:50.704794 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4cefc8d-6225-4df6-8523-416f16988df8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:50.705533 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4cefc8d-6225-4df6-8523-416f16988df8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:50.705959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4cefc8d-6225-4df6-8523-416f16988df8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:50.767167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a4cefc8d-6225-4df6-8523-416f16988df8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:50.775992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a4cefc8d-6225-4df6-8523-416f16988df8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:50.777499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a4cefc8d-6225-4df6-8523-416f16988df8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:50.778611 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a4cefc8d-6225-4df6-8523-416f16988df8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085671 Jul 27 23:08:50.779183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1163/2151] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:50 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:51.801046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0f076daa-b9bb-4f7b-8262-8e93a41f3604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:51.801659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0f076daa-b9bb-4f7b-8262-8e93a41f3604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:51.808629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f076daa-b9bb-4f7b-8262-8e93a41f3604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:51.809076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f076daa-b9bb-4f7b-8262-8e93a41f3604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:51.809834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f076daa-b9bb-4f7b-8262-8e93a41f3604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:51.810268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f076daa-b9bb-4f7b-8262-8e93a41f3604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:51.870684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0f076daa-b9bb-4f7b-8262-8e93a41f3604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:51.878975 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0f076daa-b9bb-4f7b-8262-8e93a41f3604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:51.880470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0f076daa-b9bb-4f7b-8262-8e93a41f3604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:51.881641 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0f076daa-b9bb-4f7b-8262-8e93a41f3604 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084514 Jul 27 23:08:51.882197 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 989/2152] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:51 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:52.904281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bd3aaa86-8ba3-4f16-a9e4-8f84ae708dc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:52.904925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bd3aaa86-8ba3-4f16-a9e4-8f84ae708dc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:52.911336 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd3aaa86-8ba3-4f16-a9e4-8f84ae708dc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:52.911780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd3aaa86-8ba3-4f16-a9e4-8f84ae708dc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:52.912532 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd3aaa86-8ba3-4f16-a9e4-8f84ae708dc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:52.913066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bd3aaa86-8ba3-4f16-a9e4-8f84ae708dc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:52.972874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bd3aaa86-8ba3-4f16-a9e4-8f84ae708dc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:52.981749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bd3aaa86-8ba3-4f16-a9e4-8f84ae708dc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:52.983592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bd3aaa86-8ba3-4f16-a9e4-8f84ae708dc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:52.984755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bd3aaa86-8ba3-4f16-a9e4-8f84ae708dc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084321 Jul 27 23:08:52.985307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1164/2153] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:52 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:54.008389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-232aea8c-fef1-4a8f-a913-55e75e9a312d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:54.009020 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-232aea8c-fef1-4a8f-a913-55e75e9a312d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:54.015507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-232aea8c-fef1-4a8f-a913-55e75e9a312d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:54.015954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-232aea8c-fef1-4a8f-a913-55e75e9a312d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:54.016757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-232aea8c-fef1-4a8f-a913-55e75e9a312d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:54.017192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-232aea8c-fef1-4a8f-a913-55e75e9a312d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:54.079387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-232aea8c-fef1-4a8f-a913-55e75e9a312d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:54.087837 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-232aea8c-fef1-4a8f-a913-55e75e9a312d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:54.089366 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-232aea8c-fef1-4a8f-a913-55e75e9a312d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:54.090497 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-232aea8c-fef1-4a8f-a913-55e75e9a312d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086706 Jul 27 23:08:54.091043 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 990/2154] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:54 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:55.112629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ff1c17a2-d8a0-4645-bd7c-527e934112b6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:55.113237 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ff1c17a2-d8a0-4645-bd7c-527e934112b6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:55.120473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff1c17a2-d8a0-4645-bd7c-527e934112b6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:55.120936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff1c17a2-d8a0-4645-bd7c-527e934112b6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:55.121683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff1c17a2-d8a0-4645-bd7c-527e934112b6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:55.122141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff1c17a2-d8a0-4645-bd7c-527e934112b6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:55.184040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ff1c17a2-d8a0-4645-bd7c-527e934112b6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:55.192410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ff1c17a2-d8a0-4645-bd7c-527e934112b6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:55.193919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ff1c17a2-d8a0-4645-bd7c-527e934112b6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:55.195034 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ff1c17a2-d8a0-4645-bd7c-527e934112b6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086314 Jul 27 23:08:55.195580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1165/2155] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:55 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:56.217315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fcaf509f-216f-40c6-93dd-9122aeffdd39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:56.217925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fcaf509f-216f-40c6-93dd-9122aeffdd39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:56.224469 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fcaf509f-216f-40c6-93dd-9122aeffdd39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:56.224945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fcaf509f-216f-40c6-93dd-9122aeffdd39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:56.225704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fcaf509f-216f-40c6-93dd-9122aeffdd39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:56.226138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fcaf509f-216f-40c6-93dd-9122aeffdd39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:56.288048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fcaf509f-216f-40c6-93dd-9122aeffdd39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:56.296444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fcaf509f-216f-40c6-93dd-9122aeffdd39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:56.297975 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fcaf509f-216f-40c6-93dd-9122aeffdd39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:56.299114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fcaf509f-216f-40c6-93dd-9122aeffdd39 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085752 Jul 27 23:08:56.299667 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 991/2156] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:57.321888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fb7ca652-b507-4ebe-9072-f97c26cd8634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:57.322774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fb7ca652-b507-4ebe-9072-f97c26cd8634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:57.333067 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb7ca652-b507-4ebe-9072-f97c26cd8634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:57.333449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb7ca652-b507-4ebe-9072-f97c26cd8634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:57.334231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb7ca652-b507-4ebe-9072-f97c26cd8634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:57.334668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb7ca652-b507-4ebe-9072-f97c26cd8634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:57.396182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fb7ca652-b507-4ebe-9072-f97c26cd8634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:57.404760 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fb7ca652-b507-4ebe-9072-f97c26cd8634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:57.406237 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fb7ca652-b507-4ebe-9072-f97c26cd8634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:57.407392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fb7ca652-b507-4ebe-9072-f97c26cd8634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.089569 Jul 27 23:08:57.408255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1166/2157] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:57 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:58.431140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8612840c-28bf-4bef-bffe-dc166b8bfae8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:58.431748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8612840c-28bf-4bef-bffe-dc166b8bfae8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:58.438227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8612840c-28bf-4bef-bffe-dc166b8bfae8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:58.438673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8612840c-28bf-4bef-bffe-dc166b8bfae8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:58.439429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8612840c-28bf-4bef-bffe-dc166b8bfae8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:58.439864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8612840c-28bf-4bef-bffe-dc166b8bfae8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:58.502137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8612840c-28bf-4bef-bffe-dc166b8bfae8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:58.511070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8612840c-28bf-4bef-bffe-dc166b8bfae8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:58.512591 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8612840c-28bf-4bef-bffe-dc166b8bfae8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:58.513731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8612840c-28bf-4bef-bffe-dc166b8bfae8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087072 Jul 27 23:08:58.514281 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 992/2158] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:08:59.535366 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4870ca73-16c8-463f-9efd-c678c0aa956b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:08:59.535891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4870ca73-16c8-463f-9efd-c678c0aa956b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:08:59.543163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4870ca73-16c8-463f-9efd-c678c0aa956b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:59.543608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4870ca73-16c8-463f-9efd-c678c0aa956b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:59.544362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4870ca73-16c8-463f-9efd-c678c0aa956b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:08:59.544821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4870ca73-16c8-463f-9efd-c678c0aa956b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:08:59.604877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4870ca73-16c8-463f-9efd-c678c0aa956b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:59.613239 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4870ca73-16c8-463f-9efd-c678c0aa956b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:59.614715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4870ca73-16c8-463f-9efd-c678c0aa956b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:08:59.615825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4870ca73-16c8-463f-9efd-c678c0aa956b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084442 Jul 27 23:08:59.616373 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1167/2159] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:08:59 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:00.638244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a1fd998f-7ffe-4f62-a022-e9d1733e0cf1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:00.638843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a1fd998f-7ffe-4f62-a022-e9d1733e0cf1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:00.645387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1fd998f-7ffe-4f62-a022-e9d1733e0cf1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:00.645829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1fd998f-7ffe-4f62-a022-e9d1733e0cf1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:00.646583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1fd998f-7ffe-4f62-a022-e9d1733e0cf1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:00.647011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1fd998f-7ffe-4f62-a022-e9d1733e0cf1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:00.707001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1fd998f-7ffe-4f62-a022-e9d1733e0cf1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:00.716040 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1fd998f-7ffe-4f62-a022-e9d1733e0cf1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:00.717584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1fd998f-7ffe-4f62-a022-e9d1733e0cf1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:00.718748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a1fd998f-7ffe-4f62-a022-e9d1733e0cf1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084388 Jul 27 23:09:00.719302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 993/2160] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:00 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:09:01.741371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-de5e9af4-0334-454b-96f6-d7b62b5caf6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:01.742458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-de5e9af4-0334-454b-96f6-d7b62b5caf6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:01.748954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de5e9af4-0334-454b-96f6-d7b62b5caf6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:01.749539 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de5e9af4-0334-454b-96f6-d7b62b5caf6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:01.750156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de5e9af4-0334-454b-96f6-d7b62b5caf6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:01.750592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-de5e9af4-0334-454b-96f6-d7b62b5caf6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:01.810747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-de5e9af4-0334-454b-96f6-d7b62b5caf6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:01.819012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-de5e9af4-0334-454b-96f6-d7b62b5caf6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:01.820506 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-de5e9af4-0334-454b-96f6-d7b62b5caf6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:01.821657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-de5e9af4-0334-454b-96f6-d7b62b5caf6a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084198 Jul 27 23:09:01.822216 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1168/2161] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:01 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:02.844514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-07426bc9-e6c0-4b53-b392-d0dfaeb4c304 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:02.845150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-07426bc9-e6c0-4b53-b392-d0dfaeb4c304 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:02.852087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07426bc9-e6c0-4b53-b392-d0dfaeb4c304 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:02.852534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07426bc9-e6c0-4b53-b392-d0dfaeb4c304 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:02.853339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07426bc9-e6c0-4b53-b392-d0dfaeb4c304 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:02.853773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07426bc9-e6c0-4b53-b392-d0dfaeb4c304 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:02.916348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-07426bc9-e6c0-4b53-b392-d0dfaeb4c304 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:02.924636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-07426bc9-e6c0-4b53-b392-d0dfaeb4c304 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:02.926126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-07426bc9-e6c0-4b53-b392-d0dfaeb4c304 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:02.927258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-07426bc9-e6c0-4b53-b392-d0dfaeb4c304 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086702 Jul 27 23:09:02.927813 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 994/2162] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:02 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:03.950824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4e266ed9-d18c-4e1b-9d45-7851a4381c3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:03.951402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4e266ed9-d18c-4e1b-9d45-7851a4381c3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:03.957841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4e266ed9-d18c-4e1b-9d45-7851a4381c3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:03.958283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4e266ed9-d18c-4e1b-9d45-7851a4381c3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:03.959025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4e266ed9-d18c-4e1b-9d45-7851a4381c3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:03.959447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4e266ed9-d18c-4e1b-9d45-7851a4381c3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:04.024573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4e266ed9-d18c-4e1b-9d45-7851a4381c3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:04.032926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4e266ed9-d18c-4e1b-9d45-7851a4381c3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:04.034423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4e266ed9-d18c-4e1b-9d45-7851a4381c3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:04.035543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4e266ed9-d18c-4e1b-9d45-7851a4381c3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088584 Jul 27 23:09:04.036099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1169/2163] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:05.058414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0b52850a-4ca9-433d-bb92-77c72222d6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:05.059112 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0b52850a-4ca9-433d-bb92-77c72222d6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:05.065403 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b52850a-4ca9-433d-bb92-77c72222d6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:05.065846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b52850a-4ca9-433d-bb92-77c72222d6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:05.066606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b52850a-4ca9-433d-bb92-77c72222d6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:05.067037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b52850a-4ca9-433d-bb92-77c72222d6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:05.131283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0b52850a-4ca9-433d-bb92-77c72222d6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:05.140282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0b52850a-4ca9-433d-bb92-77c72222d6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:05.141814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0b52850a-4ca9-433d-bb92-77c72222d6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:05.142954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0b52850a-4ca9-433d-bb92-77c72222d6d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088479 Jul 27 23:09:05.143520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 995/2164] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:05 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:06.165564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-60f3f151-8d3d-4754-920c-9047a18392f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:06.166162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-60f3f151-8d3d-4754-920c-9047a18392f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:06.172530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-60f3f151-8d3d-4754-920c-9047a18392f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:06.172999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-60f3f151-8d3d-4754-920c-9047a18392f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:06.173744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-60f3f151-8d3d-4754-920c-9047a18392f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:06.174177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-60f3f151-8d3d-4754-920c-9047a18392f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:06.233809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-60f3f151-8d3d-4754-920c-9047a18392f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:06.242473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-60f3f151-8d3d-4754-920c-9047a18392f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:06.243942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-60f3f151-8d3d-4754-920c-9047a18392f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:06.245088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-60f3f151-8d3d-4754-920c-9047a18392f1 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083876 Jul 27 23:09:06.245632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1170/2165] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:07.267988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c299d96e-ea7a-4ef3-becc-e08f58b30a61 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:07.268624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c299d96e-ea7a-4ef3-becc-e08f58b30a61 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:07.275818 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c299d96e-ea7a-4ef3-becc-e08f58b30a61 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:07.276336 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c299d96e-ea7a-4ef3-becc-e08f58b30a61 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:07.277148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c299d96e-ea7a-4ef3-becc-e08f58b30a61 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:07.277587 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c299d96e-ea7a-4ef3-becc-e08f58b30a61 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:07.340238 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c299d96e-ea7a-4ef3-becc-e08f58b30a61 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:07.348539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c299d96e-ea7a-4ef3-becc-e08f58b30a61 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:07.350059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c299d96e-ea7a-4ef3-becc-e08f58b30a61 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:07.351203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c299d96e-ea7a-4ef3-becc-e08f58b30a61 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087130 Jul 27 23:09:07.351760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 996/2166] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:07 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:08.376660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6549dea4-f01a-451d-ac4e-312898b4bc8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:08.377269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6549dea4-f01a-451d-ac4e-312898b4bc8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:08.383788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6549dea4-f01a-451d-ac4e-312898b4bc8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:08.384233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6549dea4-f01a-451d-ac4e-312898b4bc8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:08.385009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6549dea4-f01a-451d-ac4e-312898b4bc8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:08.385443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6549dea4-f01a-451d-ac4e-312898b4bc8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:08.445454 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6549dea4-f01a-451d-ac4e-312898b4bc8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:08.453851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6549dea4-f01a-451d-ac4e-312898b4bc8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:08.455337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6549dea4-f01a-451d-ac4e-312898b4bc8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:08.456485 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6549dea4-f01a-451d-ac4e-312898b4bc8e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083822 Jul 27 23:09:08.457075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1171/2167] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:08 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:09.480085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-24370a1f-9791-437e-bb90-ed59767ebb55 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:09.480660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-24370a1f-9791-437e-bb90-ed59767ebb55 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:09.487416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24370a1f-9791-437e-bb90-ed59767ebb55 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:09.487863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24370a1f-9791-437e-bb90-ed59767ebb55 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:09.488799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24370a1f-9791-437e-bb90-ed59767ebb55 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:09.489241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24370a1f-9791-437e-bb90-ed59767ebb55 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:09.549925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-24370a1f-9791-437e-bb90-ed59767ebb55 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:09.558960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-24370a1f-9791-437e-bb90-ed59767ebb55 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:09.560455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-24370a1f-9791-437e-bb90-ed59767ebb55 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:09.561621 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-24370a1f-9791-437e-bb90-ed59767ebb55 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086163 Jul 27 23:09:09.562172 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 997/2168] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:09 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:10.584026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dad6aaa4-78af-4fe9-b55c-870356e13548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:10.584624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dad6aaa4-78af-4fe9-b55c-870356e13548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:10.591623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dad6aaa4-78af-4fe9-b55c-870356e13548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:10.592070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dad6aaa4-78af-4fe9-b55c-870356e13548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:10.592866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dad6aaa4-78af-4fe9-b55c-870356e13548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:10.593301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dad6aaa4-78af-4fe9-b55c-870356e13548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:10.653490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dad6aaa4-78af-4fe9-b55c-870356e13548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:10.661670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dad6aaa4-78af-4fe9-b55c-870356e13548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:10.663163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dad6aaa4-78af-4fe9-b55c-870356e13548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:10.664965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dad6aaa4-78af-4fe9-b55c-870356e13548 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084875 Jul 27 23:09:10.665518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1172/2169] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:10 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:11.687204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d491ee50-7932-4455-9030-2547ca104b56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:11.687842 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d491ee50-7932-4455-9030-2547ca104b56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:11.694301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d491ee50-7932-4455-9030-2547ca104b56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:11.694749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d491ee50-7932-4455-9030-2547ca104b56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:11.695503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d491ee50-7932-4455-9030-2547ca104b56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:11.695939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d491ee50-7932-4455-9030-2547ca104b56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:11.830461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d491ee50-7932-4455-9030-2547ca104b56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:11.838756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d491ee50-7932-4455-9030-2547ca104b56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:11.840239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d491ee50-7932-4455-9030-2547ca104b56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:11.841408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d491ee50-7932-4455-9030-2547ca104b56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.158111 Jul 27 23:09:11.841953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 998/2170] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:11 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:12.864751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0c22c4bf-82c4-44c4-8d7f-796ff1d28ebe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:12.865359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0c22c4bf-82c4-44c4-8d7f-796ff1d28ebe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:12.871494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c22c4bf-82c4-44c4-8d7f-796ff1d28ebe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:12.871933 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c22c4bf-82c4-44c4-8d7f-796ff1d28ebe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:12.872704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c22c4bf-82c4-44c4-8d7f-796ff1d28ebe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:12.873132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0c22c4bf-82c4-44c4-8d7f-796ff1d28ebe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:12.932470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0c22c4bf-82c4-44c4-8d7f-796ff1d28ebe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:12.940680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0c22c4bf-82c4-44c4-8d7f-796ff1d28ebe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:12.942163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0c22c4bf-82c4-44c4-8d7f-796ff1d28ebe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:12.943274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0c22c4bf-82c4-44c4-8d7f-796ff1d28ebe tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.082640 Jul 27 23:09:12.943821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1173/2171] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:13.965158 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b086bc40-3bd2-47c4-bcd1-3e7899b934d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:13.965789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b086bc40-3bd2-47c4-bcd1-3e7899b934d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:13.972212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b086bc40-3bd2-47c4-bcd1-3e7899b934d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:13.972687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b086bc40-3bd2-47c4-bcd1-3e7899b934d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:13.973441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b086bc40-3bd2-47c4-bcd1-3e7899b934d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:13.973871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b086bc40-3bd2-47c4-bcd1-3e7899b934d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:14.034251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b086bc40-3bd2-47c4-bcd1-3e7899b934d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:14.043034 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b086bc40-3bd2-47c4-bcd1-3e7899b934d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:14.044530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b086bc40-3bd2-47c4-bcd1-3e7899b934d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:14.045681 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b086bc40-3bd2-47c4-bcd1-3e7899b934d2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084455 Jul 27 23:09:14.046245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 999/2172] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:15.067867 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d04e6678-c93f-4781-9eef-b686fbc3749b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:15.068470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d04e6678-c93f-4781-9eef-b686fbc3749b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:15.075262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d04e6678-c93f-4781-9eef-b686fbc3749b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:15.075730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d04e6678-c93f-4781-9eef-b686fbc3749b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:15.076565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d04e6678-c93f-4781-9eef-b686fbc3749b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:15.077008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d04e6678-c93f-4781-9eef-b686fbc3749b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:15.138106 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d04e6678-c93f-4781-9eef-b686fbc3749b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:15.146464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d04e6678-c93f-4781-9eef-b686fbc3749b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:15.147951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d04e6678-c93f-4781-9eef-b686fbc3749b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:15.149776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d04e6678-c93f-4781-9eef-b686fbc3749b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085873 Jul 27 23:09:15.150323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1174/2173] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:15 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:16.172768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e5ece6ec-311a-44cc-a9d2-b8985b8297ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:16.173378 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e5ece6ec-311a-44cc-a9d2-b8985b8297ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:16.175694 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=28 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:09:16.181371 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5ece6ec-311a-44cc-a9d2-b8985b8297ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:16.181815 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5ece6ec-311a-44cc-a9d2-b8985b8297ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:16.182570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5ece6ec-311a-44cc-a9d2-b8985b8297ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:16.183003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5ece6ec-311a-44cc-a9d2-b8985b8297ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:16.186846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=84 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:09:16.245851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e5ece6ec-311a-44cc-a9d2-b8985b8297ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:16.254169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e5ece6ec-311a-44cc-a9d2-b8985b8297ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:16.255604 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e5ece6ec-311a-44cc-a9d2-b8985b8297ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:16.256764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e5ece6ec-311a-44cc-a9d2-b8985b8297ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087927 Jul 27 23:09:16.257320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1000/2174] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:16 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:17.279727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0e72ddfb-05a4-4fd5-90cb-26e7b24f7f70 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:17.280333 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0e72ddfb-05a4-4fd5-90cb-26e7b24f7f70 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:17.282620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=28 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:09:17.288035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e72ddfb-05a4-4fd5-90cb-26e7b24f7f70 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:17.288483 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e72ddfb-05a4-4fd5-90cb-26e7b24f7f70 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:17.289274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e72ddfb-05a4-4fd5-90cb-26e7b24f7f70 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:17.289704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e72ddfb-05a4-4fd5-90cb-26e7b24f7f70 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:17.292424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=84 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:09:17.350341 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0e72ddfb-05a4-4fd5-90cb-26e7b24f7f70 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:17.358870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0e72ddfb-05a4-4fd5-90cb-26e7b24f7f70 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:17.360355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0e72ddfb-05a4-4fd5-90cb-26e7b24f7f70 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:17.361510 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0e72ddfb-05a4-4fd5-90cb-26e7b24f7f70 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085689 Jul 27 23:09:17.362066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1175/2175] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:17 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:18.384739 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-613a316d-4ccc-4265-b09b-ca1a86d39cc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:18.385347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-613a316d-4ccc-4265-b09b-ca1a86d39cc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:18.391484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-613a316d-4ccc-4265-b09b-ca1a86d39cc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:18.391939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-613a316d-4ccc-4265-b09b-ca1a86d39cc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:18.392726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-613a316d-4ccc-4265-b09b-ca1a86d39cc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:18.393161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-613a316d-4ccc-4265-b09b-ca1a86d39cc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:18.452312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-613a316d-4ccc-4265-b09b-ca1a86d39cc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:18.460602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-613a316d-4ccc-4265-b09b-ca1a86d39cc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:18.462105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-613a316d-4ccc-4265-b09b-ca1a86d39cc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:18.463235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-613a316d-4ccc-4265-b09b-ca1a86d39cc9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.082644 Jul 27 23:09:18.463789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1001/2176] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:18.833502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:09:18.833744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:09:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:09:19.486656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7b3667c7-0d19-4a4a-8705-b36baca76e0f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:19.487200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7b3667c7-0d19-4a4a-8705-b36baca76e0f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:19.494268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b3667c7-0d19-4a4a-8705-b36baca76e0f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:19.494713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b3667c7-0d19-4a4a-8705-b36baca76e0f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:19.495465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b3667c7-0d19-4a4a-8705-b36baca76e0f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:19.495897 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7b3667c7-0d19-4a4a-8705-b36baca76e0f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:19.558196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7b3667c7-0d19-4a4a-8705-b36baca76e0f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:19.566364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7b3667c7-0d19-4a4a-8705-b36baca76e0f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:19.567947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7b3667c7-0d19-4a4a-8705-b36baca76e0f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:19.569164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7b3667c7-0d19-4a4a-8705-b36baca76e0f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086797 Jul 27 23:09:19.569713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1176/2177] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:19 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:20.592728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e71635c4-5e6d-4daa-a454-24e1fecc8a58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:20.593337 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e71635c4-5e6d-4daa-a454-24e1fecc8a58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:20.599786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e71635c4-5e6d-4daa-a454-24e1fecc8a58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:20.600227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e71635c4-5e6d-4daa-a454-24e1fecc8a58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:20.601018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e71635c4-5e6d-4daa-a454-24e1fecc8a58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:20.601452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e71635c4-5e6d-4daa-a454-24e1fecc8a58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:20.664233 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e71635c4-5e6d-4daa-a454-24e1fecc8a58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:20.672784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e71635c4-5e6d-4daa-a454-24e1fecc8a58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:20.674289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e71635c4-5e6d-4daa-a454-24e1fecc8a58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:20.675423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e71635c4-5e6d-4daa-a454-24e1fecc8a58 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086628 Jul 27 23:09:20.675986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1002/2178] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:21.697864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-132bdc74-883c-4304-9975-44207c3e0e47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:21.698462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-132bdc74-883c-4304-9975-44207c3e0e47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:21.704870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-132bdc74-883c-4304-9975-44207c3e0e47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:21.705312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-132bdc74-883c-4304-9975-44207c3e0e47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:21.706061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-132bdc74-883c-4304-9975-44207c3e0e47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:21.706487 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-132bdc74-883c-4304-9975-44207c3e0e47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:21.765695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-132bdc74-883c-4304-9975-44207c3e0e47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:21.773992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-132bdc74-883c-4304-9975-44207c3e0e47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:21.775477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-132bdc74-883c-4304-9975-44207c3e0e47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:21.776610 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-132bdc74-883c-4304-9975-44207c3e0e47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083163 Jul 27 23:09:21.777237 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1177/2179] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:21 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:21.874480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:09:21.874954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:09:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:09:22.150148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:09:22.150369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:09:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:09:22.799110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-695f57b3-166d-4bb5-95f5-f2dd266a076e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:22.799723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-695f57b3-166d-4bb5-95f5-f2dd266a076e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:22.806292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-695f57b3-166d-4bb5-95f5-f2dd266a076e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:22.806741 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-695f57b3-166d-4bb5-95f5-f2dd266a076e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:22.807498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-695f57b3-166d-4bb5-95f5-f2dd266a076e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:22.807931 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-695f57b3-166d-4bb5-95f5-f2dd266a076e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:22.871242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-695f57b3-166d-4bb5-95f5-f2dd266a076e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:22.879620 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-695f57b3-166d-4bb5-95f5-f2dd266a076e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:22.881138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-695f57b3-166d-4bb5-95f5-f2dd266a076e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:22.882259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-695f57b3-166d-4bb5-95f5-f2dd266a076e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087092 Jul 27 23:09:22.883321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1003/2180] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:22 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:23.905383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7a83f261-b543-44e5-9b1a-9444f3f173de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:23.906097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7a83f261-b543-44e5-9b1a-9444f3f173de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:23.913218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a83f261-b543-44e5-9b1a-9444f3f173de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:23.913985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a83f261-b543-44e5-9b1a-9444f3f173de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:23.915141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a83f261-b543-44e5-9b1a-9444f3f173de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:23.915592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a83f261-b543-44e5-9b1a-9444f3f173de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:24.029742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7a83f261-b543-44e5-9b1a-9444f3f173de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:24.038154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7a83f261-b543-44e5-9b1a-9444f3f173de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:24.039653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7a83f261-b543-44e5-9b1a-9444f3f173de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:24.040818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7a83f261-b543-44e5-9b1a-9444f3f173de tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.139440 Jul 27 23:09:24.041375 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1178/2181] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:23 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:25.066518 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2997fa45-3f02-4fb2-8a17-980b31e9fb05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:25.067128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2997fa45-3f02-4fb2-8a17-980b31e9fb05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:25.073680 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2997fa45-3f02-4fb2-8a17-980b31e9fb05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:25.074129 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2997fa45-3f02-4fb2-8a17-980b31e9fb05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:25.074896 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2997fa45-3f02-4fb2-8a17-980b31e9fb05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:25.075331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2997fa45-3f02-4fb2-8a17-980b31e9fb05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:25.139335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2997fa45-3f02-4fb2-8a17-980b31e9fb05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:25.147785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2997fa45-3f02-4fb2-8a17-980b31e9fb05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:25.149357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2997fa45-3f02-4fb2-8a17-980b31e9fb05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:25.150669 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2997fa45-3f02-4fb2-8a17-980b31e9fb05 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087942 Jul 27 23:09:25.151482 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1004/2182] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:25 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:26.173385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7e28c7d6-d7e1-4c47-a973-1f321b4c6ab9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:26.173993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7e28c7d6-d7e1-4c47-a973-1f321b4c6ab9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:26.180437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e28c7d6-d7e1-4c47-a973-1f321b4c6ab9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:26.180914 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e28c7d6-d7e1-4c47-a973-1f321b4c6ab9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:26.181664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e28c7d6-d7e1-4c47-a973-1f321b4c6ab9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:26.182096 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e28c7d6-d7e1-4c47-a973-1f321b4c6ab9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:26.244111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7e28c7d6-d7e1-4c47-a973-1f321b4c6ab9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:26.253263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7e28c7d6-d7e1-4c47-a973-1f321b4c6ab9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:26.254122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7e28c7d6-d7e1-4c47-a973-1f321b4c6ab9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:26.255260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7e28c7d6-d7e1-4c47-a973-1f321b4c6ab9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085782 Jul 27 23:09:26.255816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1179/2183] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:26 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:27.278253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-813fe794-0763-4ae1-b8f1-8f5ebe1172c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:27.278857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-813fe794-0763-4ae1-b8f1-8f5ebe1172c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:27.285343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-813fe794-0763-4ae1-b8f1-8f5ebe1172c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:27.285788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-813fe794-0763-4ae1-b8f1-8f5ebe1172c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:27.286544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-813fe794-0763-4ae1-b8f1-8f5ebe1172c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:27.286972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-813fe794-0763-4ae1-b8f1-8f5ebe1172c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:27.349625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-813fe794-0763-4ae1-b8f1-8f5ebe1172c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:27.358061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-813fe794-0763-4ae1-b8f1-8f5ebe1172c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:27.359576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-813fe794-0763-4ae1-b8f1-8f5ebe1172c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:27.360736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-813fe794-0763-4ae1-b8f1-8f5ebe1172c4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086355 Jul 27 23:09:27.361284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1005/2184] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:27 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:28.383363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-61b1d20a-44dc-44bb-a049-8c1265fe21b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:28.383964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-61b1d20a-44dc-44bb-a049-8c1265fe21b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:28.390452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61b1d20a-44dc-44bb-a049-8c1265fe21b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:28.390890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61b1d20a-44dc-44bb-a049-8c1265fe21b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:28.391634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61b1d20a-44dc-44bb-a049-8c1265fe21b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:28.392061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-61b1d20a-44dc-44bb-a049-8c1265fe21b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:28.452109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-61b1d20a-44dc-44bb-a049-8c1265fe21b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:28.460307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-61b1d20a-44dc-44bb-a049-8c1265fe21b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:28.461834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-61b1d20a-44dc-44bb-a049-8c1265fe21b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:28.462960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-61b1d20a-44dc-44bb-a049-8c1265fe21b7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083956 Jul 27 23:09:28.463501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1180/2185] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:28 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:29.485846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-85c83923-4c23-44f6-894c-9900df0b2781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:29.486391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-85c83923-4c23-44f6-894c-9900df0b2781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:29.493109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-85c83923-4c23-44f6-894c-9900df0b2781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:29.493553 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-85c83923-4c23-44f6-894c-9900df0b2781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:29.494301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-85c83923-4c23-44f6-894c-9900df0b2781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:29.494727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-85c83923-4c23-44f6-894c-9900df0b2781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:29.557277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-85c83923-4c23-44f6-894c-9900df0b2781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:29.565632 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-85c83923-4c23-44f6-894c-9900df0b2781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:29.567129 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-85c83923-4c23-44f6-894c-9900df0b2781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:29.568256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-85c83923-4c23-44f6-894c-9900df0b2781 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086710 Jul 27 23:09:29.568857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1006/2186] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:29 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:30.590782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-90d92d70-20aa-47a1-8be7-688b391afd44 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:30.591390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-90d92d70-20aa-47a1-8be7-688b391afd44 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:30.597947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90d92d70-20aa-47a1-8be7-688b391afd44 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:30.598390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90d92d70-20aa-47a1-8be7-688b391afd44 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:30.599142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90d92d70-20aa-47a1-8be7-688b391afd44 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:30.599575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90d92d70-20aa-47a1-8be7-688b391afd44 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:30.660028 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-90d92d70-20aa-47a1-8be7-688b391afd44 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:30.668918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-90d92d70-20aa-47a1-8be7-688b391afd44 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:30.670405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-90d92d70-20aa-47a1-8be7-688b391afd44 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:30.671520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-90d92d70-20aa-47a1-8be7-688b391afd44 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084635 Jul 27 23:09:30.672068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1181/2187] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:31.693761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-77075723-a0db-4b47-b18f-ecf8ddb84933 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:31.694369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-77075723-a0db-4b47-b18f-ecf8ddb84933 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:31.701487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77075723-a0db-4b47-b18f-ecf8ddb84933 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:31.701933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77075723-a0db-4b47-b18f-ecf8ddb84933 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:31.702687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77075723-a0db-4b47-b18f-ecf8ddb84933 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:31.703119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77075723-a0db-4b47-b18f-ecf8ddb84933 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:31.762611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-77075723-a0db-4b47-b18f-ecf8ddb84933 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:31.770816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-77075723-a0db-4b47-b18f-ecf8ddb84933 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:31.772313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-77075723-a0db-4b47-b18f-ecf8ddb84933 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:31.773480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-77075723-a0db-4b47-b18f-ecf8ddb84933 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083651 Jul 27 23:09:31.774037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1007/2188] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:31 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:32.795558 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c4ea6b87-6850-426d-a912-c7009ac848c7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:32.796192 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c4ea6b87-6850-426d-a912-c7009ac848c7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:32.802628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c4ea6b87-6850-426d-a912-c7009ac848c7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:32.803072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c4ea6b87-6850-426d-a912-c7009ac848c7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:32.803824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c4ea6b87-6850-426d-a912-c7009ac848c7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:32.804849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c4ea6b87-6850-426d-a912-c7009ac848c7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:32.863901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c4ea6b87-6850-426d-a912-c7009ac848c7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:32.872908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c4ea6b87-6850-426d-a912-c7009ac848c7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:32.874405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c4ea6b87-6850-426d-a912-c7009ac848c7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:32.875526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c4ea6b87-6850-426d-a912-c7009ac848c7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083922 Jul 27 23:09:32.876075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1182/2189] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:32 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:33.897145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-45cac5b2-2da3-4ff5-b934-5ba5775ac46a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:33.898268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-45cac5b2-2da3-4ff5-b934-5ba5775ac46a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:33.905359 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45cac5b2-2da3-4ff5-b934-5ba5775ac46a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:33.906449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45cac5b2-2da3-4ff5-b934-5ba5775ac46a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:33.906584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45cac5b2-2da3-4ff5-b934-5ba5775ac46a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:33.906954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-45cac5b2-2da3-4ff5-b934-5ba5775ac46a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:33.969315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-45cac5b2-2da3-4ff5-b934-5ba5775ac46a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:33.978150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-45cac5b2-2da3-4ff5-b934-5ba5775ac46a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:33.979644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-45cac5b2-2da3-4ff5-b934-5ba5775ac46a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:33.980803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-45cac5b2-2da3-4ff5-b934-5ba5775ac46a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087538 Jul 27 23:09:33.981346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1008/2190] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:35.003403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7351b8fa-bca3-42a5-9367-fafa3f739813 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:35.004023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7351b8fa-bca3-42a5-9367-fafa3f739813 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:35.010473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7351b8fa-bca3-42a5-9367-fafa3f739813 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:35.010919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7351b8fa-bca3-42a5-9367-fafa3f739813 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:35.011669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7351b8fa-bca3-42a5-9367-fafa3f739813 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:35.012101 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7351b8fa-bca3-42a5-9367-fafa3f739813 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:35.073484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7351b8fa-bca3-42a5-9367-fafa3f739813 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:35.081680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7351b8fa-bca3-42a5-9367-fafa3f739813 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:35.083182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7351b8fa-bca3-42a5-9367-fafa3f739813 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:35.084313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7351b8fa-bca3-42a5-9367-fafa3f739813 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084893 Jul 27 23:09:35.084895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1183/2191] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:34 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:36.107509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8184c980-ddde-4c87-aa41-f1499796c052 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:36.108366 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8184c980-ddde-4c87-aa41-f1499796c052 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:36.114863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8184c980-ddde-4c87-aa41-f1499796c052 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:36.115304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8184c980-ddde-4c87-aa41-f1499796c052 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:36.116051 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8184c980-ddde-4c87-aa41-f1499796c052 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:36.117080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8184c980-ddde-4c87-aa41-f1499796c052 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:36.177199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8184c980-ddde-4c87-aa41-f1499796c052 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:36.186503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8184c980-ddde-4c87-aa41-f1499796c052 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:36.187997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8184c980-ddde-4c87-aa41-f1499796c052 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:36.189154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8184c980-ddde-4c87-aa41-f1499796c052 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085604 Jul 27 23:09:36.189708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1009/2192] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:37.212265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-eb47fd85-e6a9-4197-9a1e-1fe8f857c5da tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:37.212888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-eb47fd85-e6a9-4197-9a1e-1fe8f857c5da tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:37.219243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb47fd85-e6a9-4197-9a1e-1fe8f857c5da tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:37.219681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb47fd85-e6a9-4197-9a1e-1fe8f857c5da tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:37.220418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb47fd85-e6a9-4197-9a1e-1fe8f857c5da tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:37.220873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb47fd85-e6a9-4197-9a1e-1fe8f857c5da tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:37.280120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eb47fd85-e6a9-4197-9a1e-1fe8f857c5da tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:37.288262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eb47fd85-e6a9-4197-9a1e-1fe8f857c5da tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:37.290259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eb47fd85-e6a9-4197-9a1e-1fe8f857c5da tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:37.291369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-eb47fd85-e6a9-4197-9a1e-1fe8f857c5da tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.082919 Jul 27 23:09:37.291909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1184/2193] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:38.314353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-88c640dc-59d6-4c2b-832e-2ce2dc47f834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:38.314953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-88c640dc-59d6-4c2b-832e-2ce2dc47f834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:38.321571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88c640dc-59d6-4c2b-832e-2ce2dc47f834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:38.322014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88c640dc-59d6-4c2b-832e-2ce2dc47f834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:38.322764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88c640dc-59d6-4c2b-832e-2ce2dc47f834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:38.323191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88c640dc-59d6-4c2b-832e-2ce2dc47f834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:38.385610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-88c640dc-59d6-4c2b-832e-2ce2dc47f834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:38.394026 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-88c640dc-59d6-4c2b-832e-2ce2dc47f834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:38.395513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-88c640dc-59d6-4c2b-832e-2ce2dc47f834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:38.396676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-88c640dc-59d6-4c2b-832e-2ce2dc47f834 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086278 Jul 27 23:09:38.397223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1010/2194] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:38 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:39.419592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f44c02d2-1578-42cd-87e7-25bac0ebf254 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:39.420148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f44c02d2-1578-42cd-87e7-25bac0ebf254 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:39.426561 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f44c02d2-1578-42cd-87e7-25bac0ebf254 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:39.427003 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f44c02d2-1578-42cd-87e7-25bac0ebf254 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:39.427747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f44c02d2-1578-42cd-87e7-25bac0ebf254 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:39.428175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f44c02d2-1578-42cd-87e7-25bac0ebf254 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:39.487864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f44c02d2-1578-42cd-87e7-25bac0ebf254 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:39.498994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f44c02d2-1578-42cd-87e7-25bac0ebf254 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:39.500582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f44c02d2-1578-42cd-87e7-25bac0ebf254 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:39.501822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f44c02d2-1578-42cd-87e7-25bac0ebf254 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086119 Jul 27 23:09:39.502386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1185/2195] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:40.528358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a9746742-af98-4f6b-8c44-d3f703a891f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:40.529192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a9746742-af98-4f6b-8c44-d3f703a891f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:40.535899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9746742-af98-4f6b-8c44-d3f703a891f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:40.536342 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9746742-af98-4f6b-8c44-d3f703a891f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:40.537125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9746742-af98-4f6b-8c44-d3f703a891f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:40.537554 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9746742-af98-4f6b-8c44-d3f703a891f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:40.601165 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a9746742-af98-4f6b-8c44-d3f703a891f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:40.609106 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a9746742-af98-4f6b-8c44-d3f703a891f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:40.610583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a9746742-af98-4f6b-8c44-d3f703a891f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:40.611791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a9746742-af98-4f6b-8c44-d3f703a891f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087396 Jul 27 23:09:40.612512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1011/2196] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:41.635040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-557fb144-d50b-4580-9869-1e3ce0e93b7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:41.635648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-557fb144-d50b-4580-9869-1e3ce0e93b7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:41.642229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-557fb144-d50b-4580-9869-1e3ce0e93b7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:41.642673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-557fb144-d50b-4580-9869-1e3ce0e93b7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:41.643431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-557fb144-d50b-4580-9869-1e3ce0e93b7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:41.643861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-557fb144-d50b-4580-9869-1e3ce0e93b7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:41.703963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-557fb144-d50b-4580-9869-1e3ce0e93b7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:41.712185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-557fb144-d50b-4580-9869-1e3ce0e93b7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:41.713712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-557fb144-d50b-4580-9869-1e3ce0e93b7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:41.714838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-557fb144-d50b-4580-9869-1e3ce0e93b7a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083781 Jul 27 23:09:41.715400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1186/2197] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:42.737905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a6e0cc6f-6205-42e8-a5ef-97e7840c712b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:42.738492 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a6e0cc6f-6205-42e8-a5ef-97e7840c712b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:42.745509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a6e0cc6f-6205-42e8-a5ef-97e7840c712b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:42.745951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a6e0cc6f-6205-42e8-a5ef-97e7840c712b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:42.746711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a6e0cc6f-6205-42e8-a5ef-97e7840c712b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:42.747143 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a6e0cc6f-6205-42e8-a5ef-97e7840c712b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:42.809605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a6e0cc6f-6205-42e8-a5ef-97e7840c712b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:42.817866 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a6e0cc6f-6205-42e8-a5ef-97e7840c712b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:42.819371 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a6e0cc6f-6205-42e8-a5ef-97e7840c712b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:42.821181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a6e0cc6f-6205-42e8-a5ef-97e7840c712b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086523 Jul 27 23:09:42.821729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1012/2198] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:43.843655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-65ea1e0b-414d-4550-b5e4-88cde573124d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:43.844291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-65ea1e0b-414d-4550-b5e4-88cde573124d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:43.850279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65ea1e0b-414d-4550-b5e4-88cde573124d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:43.850724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65ea1e0b-414d-4550-b5e4-88cde573124d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:43.851474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65ea1e0b-414d-4550-b5e4-88cde573124d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:43.852442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65ea1e0b-414d-4550-b5e4-88cde573124d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:43.911066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-65ea1e0b-414d-4550-b5e4-88cde573124d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:43.919818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-65ea1e0b-414d-4550-b5e4-88cde573124d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:43.921453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-65ea1e0b-414d-4550-b5e4-88cde573124d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:43.922574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-65ea1e0b-414d-4550-b5e4-88cde573124d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.082957 Jul 27 23:09:43.923125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1187/2199] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:44.946319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-61c11268-9fee-40a1-8833-e7d241f34be0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:44.946917 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-61c11268-9fee-40a1-8833-e7d241f34be0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:44.953475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-61c11268-9fee-40a1-8833-e7d241f34be0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:44.953919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-61c11268-9fee-40a1-8833-e7d241f34be0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:44.954684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-61c11268-9fee-40a1-8833-e7d241f34be0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:44.955120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-61c11268-9fee-40a1-8833-e7d241f34be0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:45.016571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-61c11268-9fee-40a1-8833-e7d241f34be0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:45.024999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-61c11268-9fee-40a1-8833-e7d241f34be0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:45.026535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-61c11268-9fee-40a1-8833-e7d241f34be0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:45.027684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-61c11268-9fee-40a1-8833-e7d241f34be0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085927 Jul 27 23:09:45.028235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1013/2200] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:44 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:46.049961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-582237dd-d70b-41d5-81d4-9101d84dd06b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:46.050563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-582237dd-d70b-41d5-81d4-9101d84dd06b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:46.057991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-582237dd-d70b-41d5-81d4-9101d84dd06b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:46.058435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-582237dd-d70b-41d5-81d4-9101d84dd06b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:46.059183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-582237dd-d70b-41d5-81d4-9101d84dd06b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:46.059613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-582237dd-d70b-41d5-81d4-9101d84dd06b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:46.119256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-582237dd-d70b-41d5-81d4-9101d84dd06b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:46.127425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-582237dd-d70b-41d5-81d4-9101d84dd06b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:46.128932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-582237dd-d70b-41d5-81d4-9101d84dd06b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:46.130201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-582237dd-d70b-41d5-81d4-9101d84dd06b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084114 Jul 27 23:09:46.130743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1188/2201] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:47.154060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0b627893-3fbd-4f57-b2d7-035202d1df93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:47.155096 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0b627893-3fbd-4f57-b2d7-035202d1df93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:47.156989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=28 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:09:47.162147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b627893-3fbd-4f57-b2d7-035202d1df93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:47.162584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b627893-3fbd-4f57-b2d7-035202d1df93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:47.163334 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b627893-3fbd-4f57-b2d7-035202d1df93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:47.163763 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b627893-3fbd-4f57-b2d7-035202d1df93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:47.167049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=84 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:09:47.227801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0b627893-3fbd-4f57-b2d7-035202d1df93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:47.236333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0b627893-3fbd-4f57-b2d7-035202d1df93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:47.237849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0b627893-3fbd-4f57-b2d7-035202d1df93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:47.238974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0b627893-3fbd-4f57-b2d7-035202d1df93 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088852 Jul 27 23:09:47.239517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1014/2202] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:48.261708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0aefc673-fdd0-4d7f-9ab5-f84a44ffa59d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:48.262319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0aefc673-fdd0-4d7f-9ab5-f84a44ffa59d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:48.264659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=28 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:09:48.269915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0aefc673-fdd0-4d7f-9ab5-f84a44ffa59d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:48.270363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0aefc673-fdd0-4d7f-9ab5-f84a44ffa59d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:48.271166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0aefc673-fdd0-4d7f-9ab5-f84a44ffa59d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:48.271554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0aefc673-fdd0-4d7f-9ab5-f84a44ffa59d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:48.275576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=84 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:09:48.331318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0aefc673-fdd0-4d7f-9ab5-f84a44ffa59d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:48.339708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0aefc673-fdd0-4d7f-9ab5-f84a44ffa59d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:48.341257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0aefc673-fdd0-4d7f-9ab5-f84a44ffa59d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:48.342386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0aefc673-fdd0-4d7f-9ab5-f84a44ffa59d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085111 Jul 27 23:09:48.342939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1189/2203] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:48 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:49.365707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1847d900-6ed0-4f29-917f-3cb5c64ab44f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:49.366344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1847d900-6ed0-4f29-917f-3cb5c64ab44f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:49.372965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1847d900-6ed0-4f29-917f-3cb5c64ab44f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:49.373414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1847d900-6ed0-4f29-917f-3cb5c64ab44f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:49.374177 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1847d900-6ed0-4f29-917f-3cb5c64ab44f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:49.374608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1847d900-6ed0-4f29-917f-3cb5c64ab44f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:49.434204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1847d900-6ed0-4f29-917f-3cb5c64ab44f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:49.442406 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1847d900-6ed0-4f29-917f-3cb5c64ab44f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:49.443906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1847d900-6ed0-4f29-917f-3cb5c64ab44f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:49.445072 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1847d900-6ed0-4f29-917f-3cb5c64ab44f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083504 Jul 27 23:09:49.445631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1015/2204] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:49 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:50.468540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0e1b6ffb-cccd-4e80-958e-de120c8a60d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:50.469173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0e1b6ffb-cccd-4e80-958e-de120c8a60d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:50.475584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e1b6ffb-cccd-4e80-958e-de120c8a60d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:50.476030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e1b6ffb-cccd-4e80-958e-de120c8a60d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:50.476800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e1b6ffb-cccd-4e80-958e-de120c8a60d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:50.477235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e1b6ffb-cccd-4e80-958e-de120c8a60d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:50.539181 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0e1b6ffb-cccd-4e80-958e-de120c8a60d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:50.547591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0e1b6ffb-cccd-4e80-958e-de120c8a60d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:50.548967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0e1b6ffb-cccd-4e80-958e-de120c8a60d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:50.550095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0e1b6ffb-cccd-4e80-958e-de120c8a60d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085428 Jul 27 23:09:50.550647 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1190/2205] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:50 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:51.575289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-97dae4e7-cf7f-4bc7-80c7-69bfebc2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:51.575972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-97dae4e7-cf7f-4bc7-80c7-69bfebc2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:51.582454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97dae4e7-cf7f-4bc7-80c7-69bfebc2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:51.582893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97dae4e7-cf7f-4bc7-80c7-69bfebc2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:51.583642 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97dae4e7-cf7f-4bc7-80c7-69bfebc2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:51.584070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97dae4e7-cf7f-4bc7-80c7-69bfebc2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:51.646572 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-97dae4e7-cf7f-4bc7-80c7-69bfebc2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:51.655412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-97dae4e7-cf7f-4bc7-80c7-69bfebc2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:51.656929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-97dae4e7-cf7f-4bc7-80c7-69bfebc2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:51.658056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-97dae4e7-cf7f-4bc7-80c7-69bfebc2c325 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086762 Jul 27 23:09:51.658593 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1016/2206] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:51 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:52.680296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bb944e35-3f21-4f1d-882c-607599efa307 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:52.680944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bb944e35-3f21-4f1d-882c-607599efa307 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:52.687502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb944e35-3f21-4f1d-882c-607599efa307 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:52.687948 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb944e35-3f21-4f1d-882c-607599efa307 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:52.688729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb944e35-3f21-4f1d-882c-607599efa307 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:52.689165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb944e35-3f21-4f1d-882c-607599efa307 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:52.900011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bb944e35-3f21-4f1d-882c-607599efa307 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:52.908225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bb944e35-3f21-4f1d-882c-607599efa307 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:52.909743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bb944e35-3f21-4f1d-882c-607599efa307 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:52.910864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bb944e35-3f21-4f1d-882c-607599efa307 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.234570 Jul 27 23:09:52.911404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1191/2207] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:52 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:53.933538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d5237694-0ce7-4673-b43c-abbdfc531dfd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:53.934143 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d5237694-0ce7-4673-b43c-abbdfc531dfd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:53.940747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d5237694-0ce7-4673-b43c-abbdfc531dfd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:53.941193 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d5237694-0ce7-4673-b43c-abbdfc531dfd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:53.941952 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d5237694-0ce7-4673-b43c-abbdfc531dfd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:53.942392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d5237694-0ce7-4673-b43c-abbdfc531dfd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:54.002141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d5237694-0ce7-4673-b43c-abbdfc531dfd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:54.011094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d5237694-0ce7-4673-b43c-abbdfc531dfd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:54.012626 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d5237694-0ce7-4673-b43c-abbdfc531dfd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:54.013767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d5237694-0ce7-4673-b43c-abbdfc531dfd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084686 Jul 27 23:09:54.014310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1017/2208] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:53 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:55.035494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-253095be-c728-48dd-9e23-960b091d651e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:55.036054 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-253095be-c728-48dd-9e23-960b091d651e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:55.042696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-253095be-c728-48dd-9e23-960b091d651e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:55.043139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-253095be-c728-48dd-9e23-960b091d651e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:55.043886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-253095be-c728-48dd-9e23-960b091d651e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:55.044353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-253095be-c728-48dd-9e23-960b091d651e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:55.104689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-253095be-c728-48dd-9e23-960b091d651e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:55.113599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-253095be-c728-48dd-9e23-960b091d651e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:55.115110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-253095be-c728-48dd-9e23-960b091d651e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:55.116227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-253095be-c728-48dd-9e23-960b091d651e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084639 Jul 27 23:09:55.116792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1192/2209] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:55 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:56.139069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cff54526-d0d1-41fa-901a-c03a41c4fdc0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:56.139678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cff54526-d0d1-41fa-901a-c03a41c4fdc0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:56.146585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cff54526-d0d1-41fa-901a-c03a41c4fdc0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:56.147025 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cff54526-d0d1-41fa-901a-c03a41c4fdc0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:56.147785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cff54526-d0d1-41fa-901a-c03a41c4fdc0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:56.148219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cff54526-d0d1-41fa-901a-c03a41c4fdc0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:56.213382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cff54526-d0d1-41fa-901a-c03a41c4fdc0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:56.221898 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cff54526-d0d1-41fa-901a-c03a41c4fdc0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:56.223400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cff54526-d0d1-41fa-901a-c03a41c4fdc0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:56.224536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cff54526-d0d1-41fa-901a-c03a41c4fdc0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.089639 Jul 27 23:09:56.225113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1018/2210] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:57.247844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-67e7ad59-a42a-4c19-8175-2fe4f0dbac7b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:57.248454 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-67e7ad59-a42a-4c19-8175-2fe4f0dbac7b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:57.254894 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-67e7ad59-a42a-4c19-8175-2fe4f0dbac7b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:57.255339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-67e7ad59-a42a-4c19-8175-2fe4f0dbac7b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:57.256089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-67e7ad59-a42a-4c19-8175-2fe4f0dbac7b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:57.256522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-67e7ad59-a42a-4c19-8175-2fe4f0dbac7b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:57.316966 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-67e7ad59-a42a-4c19-8175-2fe4f0dbac7b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:57.327043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-67e7ad59-a42a-4c19-8175-2fe4f0dbac7b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:57.328530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-67e7ad59-a42a-4c19-8175-2fe4f0dbac7b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:57.329685 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-67e7ad59-a42a-4c19-8175-2fe4f0dbac7b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085796 Jul 27 23:09:57.330234 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1193/2211] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:57 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:58.352268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9eaa27ab-e373-4f09-ac54-964b60e29e71 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:58.353461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9eaa27ab-e373-4f09-ac54-964b60e29e71 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:58.360167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9eaa27ab-e373-4f09-ac54-964b60e29e71 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:58.360629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9eaa27ab-e373-4f09-ac54-964b60e29e71 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:58.361384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9eaa27ab-e373-4f09-ac54-964b60e29e71 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:58.361816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9eaa27ab-e373-4f09-ac54-964b60e29e71 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:58.421619 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9eaa27ab-e373-4f09-ac54-964b60e29e71 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:58.429861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9eaa27ab-e373-4f09-ac54-964b60e29e71 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:58.431353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9eaa27ab-e373-4f09-ac54-964b60e29e71 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:58.432486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9eaa27ab-e373-4f09-ac54-964b60e29e71 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084130 Jul 27 23:09:58.433056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1019/2212] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:09:59.454806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-12e8a81b-e8d3-43b2-891b-ce1e110c3292 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:09:59.455348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-12e8a81b-e8d3-43b2-891b-ce1e110c3292 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:09:59.461836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-12e8a81b-e8d3-43b2-891b-ce1e110c3292 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:59.462284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-12e8a81b-e8d3-43b2-891b-ce1e110c3292 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:59.463044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-12e8a81b-e8d3-43b2-891b-ce1e110c3292 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:09:59.463477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-12e8a81b-e8d3-43b2-891b-ce1e110c3292 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:09:59.522900 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-12e8a81b-e8d3-43b2-891b-ce1e110c3292 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:59.531318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-12e8a81b-e8d3-43b2-891b-ce1e110c3292 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:59.532845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-12e8a81b-e8d3-43b2-891b-ce1e110c3292 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:09:59.533977 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-12e8a81b-e8d3-43b2-891b-ce1e110c3292 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083197 Jul 27 23:09:59.534531 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1194/2213] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:09:59 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:00.556668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5e792a7f-5886-497b-8506-eee69bfdcc32 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:00.557274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5e792a7f-5886-497b-8506-eee69bfdcc32 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:00.563814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e792a7f-5886-497b-8506-eee69bfdcc32 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:00.564254 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e792a7f-5886-497b-8506-eee69bfdcc32 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:00.565035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e792a7f-5886-497b-8506-eee69bfdcc32 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:00.565464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e792a7f-5886-497b-8506-eee69bfdcc32 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:00.627274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5e792a7f-5886-497b-8506-eee69bfdcc32 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:00.635491 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5e792a7f-5886-497b-8506-eee69bfdcc32 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:00.637007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5e792a7f-5886-497b-8506-eee69bfdcc32 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:00.638136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5e792a7f-5886-497b-8506-eee69bfdcc32 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086044 Jul 27 23:10:00.638683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1020/2214] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:00 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:01.660452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2c5bb280-3729-4032-ba4c-4716b7aee72f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:01.661083 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2c5bb280-3729-4032-ba4c-4716b7aee72f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:01.667777 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2c5bb280-3729-4032-ba4c-4716b7aee72f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:01.668216 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2c5bb280-3729-4032-ba4c-4716b7aee72f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:01.668993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2c5bb280-3729-4032-ba4c-4716b7aee72f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:01.669423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2c5bb280-3729-4032-ba4c-4716b7aee72f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:01.729367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2c5bb280-3729-4032-ba4c-4716b7aee72f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:01.737821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2c5bb280-3729-4032-ba4c-4716b7aee72f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:01.739317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2c5bb280-3729-4032-ba4c-4716b7aee72f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:01.740443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2c5bb280-3729-4032-ba4c-4716b7aee72f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083822 Jul 27 23:10:01.741019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1195/2215] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:01 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:02.763731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-df053f77-095d-4ae6-a980-1f8c9f7f01ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:02.764320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-df053f77-095d-4ae6-a980-1f8c9f7f01ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:02.770947 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df053f77-095d-4ae6-a980-1f8c9f7f01ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:02.771393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df053f77-095d-4ae6-a980-1f8c9f7f01ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:02.772153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df053f77-095d-4ae6-a980-1f8c9f7f01ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:02.772616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df053f77-095d-4ae6-a980-1f8c9f7f01ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:02.832046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-df053f77-095d-4ae6-a980-1f8c9f7f01ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:02.841019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-df053f77-095d-4ae6-a980-1f8c9f7f01ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:02.842527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-df053f77-095d-4ae6-a980-1f8c9f7f01ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:02.843695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-df053f77-095d-4ae6-a980-1f8c9f7f01ad tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083884 Jul 27 23:10:02.844241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1021/2216] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:02 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:03.866526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-244ac40f-d39b-42bc-bb66-496aa27a7d16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:03.867138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-244ac40f-d39b-42bc-bb66-496aa27a7d16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:03.873748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-244ac40f-d39b-42bc-bb66-496aa27a7d16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:03.874201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-244ac40f-d39b-42bc-bb66-496aa27a7d16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:03.874963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-244ac40f-d39b-42bc-bb66-496aa27a7d16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:03.875400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-244ac40f-d39b-42bc-bb66-496aa27a7d16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:03.936300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-244ac40f-d39b-42bc-bb66-496aa27a7d16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:03.944705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-244ac40f-d39b-42bc-bb66-496aa27a7d16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:03.946232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-244ac40f-d39b-42bc-bb66-496aa27a7d16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:03.947360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-244ac40f-d39b-42bc-bb66-496aa27a7d16 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084709 Jul 27 23:10:03.947906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1196/2217] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:04.970251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-19e09132-680c-405a-bb37-dff889773693 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:04.970864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-19e09132-680c-405a-bb37-dff889773693 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:04.977431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19e09132-680c-405a-bb37-dff889773693 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:04.977881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19e09132-680c-405a-bb37-dff889773693 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:04.978650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19e09132-680c-405a-bb37-dff889773693 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:04.979085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19e09132-680c-405a-bb37-dff889773693 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:05.042684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-19e09132-680c-405a-bb37-dff889773693 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:05.051265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-19e09132-680c-405a-bb37-dff889773693 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:05.052788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-19e09132-680c-405a-bb37-dff889773693 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:05.053917 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-19e09132-680c-405a-bb37-dff889773693 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087644 Jul 27 23:10:05.054460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1022/2218] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:04 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:06.076128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-891ea9a0-e927-4667-9a7b-52d52f429b53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:06.076765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-891ea9a0-e927-4667-9a7b-52d52f429b53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:06.083186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-891ea9a0-e927-4667-9a7b-52d52f429b53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:06.083626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-891ea9a0-e927-4667-9a7b-52d52f429b53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:06.084375 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-891ea9a0-e927-4667-9a7b-52d52f429b53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:06.084836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-891ea9a0-e927-4667-9a7b-52d52f429b53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:06.144579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-891ea9a0-e927-4667-9a7b-52d52f429b53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:06.153535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-891ea9a0-e927-4667-9a7b-52d52f429b53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:06.155009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-891ea9a0-e927-4667-9a7b-52d52f429b53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:06.156125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-891ea9a0-e927-4667-9a7b-52d52f429b53 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083910 Jul 27 23:10:06.156691 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1197/2219] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:07.179360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-09e6da37-eb30-459b-8777-89958a3edbfc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:07.179970 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-09e6da37-eb30-459b-8777-89958a3edbfc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:07.186445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-09e6da37-eb30-459b-8777-89958a3edbfc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:07.186894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-09e6da37-eb30-459b-8777-89958a3edbfc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:07.187654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-09e6da37-eb30-459b-8777-89958a3edbfc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:07.188086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-09e6da37-eb30-459b-8777-89958a3edbfc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:07.247739 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-09e6da37-eb30-459b-8777-89958a3edbfc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:07.256015 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-09e6da37-eb30-459b-8777-89958a3edbfc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:07.257538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-09e6da37-eb30-459b-8777-89958a3edbfc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:07.259212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-09e6da37-eb30-459b-8777-89958a3edbfc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083261 Jul 27 23:10:07.259797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1023/2220] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:07 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:08.281557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8f17c081-f429-4ca4-8ebc-7115fc699515 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:08.282202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8f17c081-f429-4ca4-8ebc-7115fc699515 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:08.288677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f17c081-f429-4ca4-8ebc-7115fc699515 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:08.289129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f17c081-f429-4ca4-8ebc-7115fc699515 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:08.290561 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f17c081-f429-4ca4-8ebc-7115fc699515 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:08.290997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f17c081-f429-4ca4-8ebc-7115fc699515 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:08.349807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8f17c081-f429-4ca4-8ebc-7115fc699515 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:08.359159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8f17c081-f429-4ca4-8ebc-7115fc699515 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:08.360696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8f17c081-f429-4ca4-8ebc-7115fc699515 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:08.361832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8f17c081-f429-4ca4-8ebc-7115fc699515 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084179 Jul 27 23:10:08.362379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1198/2221] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:08 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:09.385104 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-af78aa2e-9f91-457c-8945-2b54920ca974 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:09.385714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-af78aa2e-9f91-457c-8945-2b54920ca974 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:09.392222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af78aa2e-9f91-457c-8945-2b54920ca974 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:09.392767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af78aa2e-9f91-457c-8945-2b54920ca974 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:09.393528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af78aa2e-9f91-457c-8945-2b54920ca974 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:09.393964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af78aa2e-9f91-457c-8945-2b54920ca974 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:09.458265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-af78aa2e-9f91-457c-8945-2b54920ca974 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:09.466571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-af78aa2e-9f91-457c-8945-2b54920ca974 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:09.468069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-af78aa2e-9f91-457c-8945-2b54920ca974 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:09.469237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-af78aa2e-9f91-457c-8945-2b54920ca974 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088059 Jul 27 23:10:09.469793 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1024/2222] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:09 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:10.492428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7f25267a-84af-4d63-afe5-512208f0c1d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:10.493074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7f25267a-84af-4d63-afe5-512208f0c1d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:10.499502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7f25267a-84af-4d63-afe5-512208f0c1d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:10.499946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7f25267a-84af-4d63-afe5-512208f0c1d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:10.500733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7f25267a-84af-4d63-afe5-512208f0c1d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:10.501169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7f25267a-84af-4d63-afe5-512208f0c1d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:10.561039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7f25267a-84af-4d63-afe5-512208f0c1d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:10.569373 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7f25267a-84af-4d63-afe5-512208f0c1d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:10.570901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7f25267a-84af-4d63-afe5-512208f0c1d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:10.572029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7f25267a-84af-4d63-afe5-512208f0c1d3 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083544 Jul 27 23:10:10.572607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1199/2223] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:10 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:11.594636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9b197bd5-6873-45e7-abbf-44d214118d8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:11.595249 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9b197bd5-6873-45e7-abbf-44d214118d8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:11.601688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b197bd5-6873-45e7-abbf-44d214118d8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:11.602645 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b197bd5-6873-45e7-abbf-44d214118d8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:11.603388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b197bd5-6873-45e7-abbf-44d214118d8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:11.603819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b197bd5-6873-45e7-abbf-44d214118d8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:11.665677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9b197bd5-6873-45e7-abbf-44d214118d8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:11.674032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9b197bd5-6873-45e7-abbf-44d214118d8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:11.675510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9b197bd5-6873-45e7-abbf-44d214118d8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:11.676665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9b197bd5-6873-45e7-abbf-44d214118d8a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085918 Jul 27 23:10:11.677211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1025/2224] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:11 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:12.700053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b5aadec4-ab3c-4a9e-be63-36a5b6c880a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:12.700733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b5aadec4-ab3c-4a9e-be63-36a5b6c880a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:12.706901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5aadec4-ab3c-4a9e-be63-36a5b6c880a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:12.707349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5aadec4-ab3c-4a9e-be63-36a5b6c880a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:12.708107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5aadec4-ab3c-4a9e-be63-36a5b6c880a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:12.708540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5aadec4-ab3c-4a9e-be63-36a5b6c880a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:12.768756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b5aadec4-ab3c-4a9e-be63-36a5b6c880a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:12.777109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b5aadec4-ab3c-4a9e-be63-36a5b6c880a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:12.778517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b5aadec4-ab3c-4a9e-be63-36a5b6c880a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:12.779636 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b5aadec4-ab3c-4a9e-be63-36a5b6c880a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084037 Jul 27 23:10:12.780183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1200/2225] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:10:13.010057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-653f4320-2ebf-49eb-99cb-742f56930fa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:13.011508 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-653f4320-2ebf-49eb-99cb-742f56930fa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:13.024255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-653f4320-2ebf-49eb-99cb-742f56930fa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:13.025035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-653f4320-2ebf-49eb-99cb-742f56930fa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:13.025883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-653f4320-2ebf-49eb-99cb-742f56930fa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:13.026277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-653f4320-2ebf-49eb-99cb-742f56930fa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:13.054742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-653f4320-2ebf-49eb-99cb-742f56930fa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Going to try to terminate instance {{(pid=129294) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 23:10:13.062290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ebbccff1-901c-4b0b-bd13-8dd333f1af67 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:13.063001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ebbccff1-901c-4b0b-bd13-8dd333f1af67 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:13.069672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebbccff1-901c-4b0b-bd13-8dd333f1af67 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:13.070322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebbccff1-901c-4b0b-bd13-8dd333f1af67 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:13.071276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebbccff1-901c-4b0b-bd13-8dd333f1af67 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:13.071707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebbccff1-901c-4b0b-bd13-8dd333f1af67 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:13.099472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ebbccff1-901c-4b0b-bd13-8dd333f1af67 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Going to try to terminate instance {{(pid=129295) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 23:10:13.122192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR oslo.messaging._drivers.impl_rabbit [None req-653f4320-2ebf-49eb-99cb-742f56930fa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [f8399fcd-75f1-4b46-b6cc-1a417ab8f422] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 23:10:13.178880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ebbccff1-901c-4b0b-bd13-8dd333f1af67 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 204 len: 0 microversion: 2.1 time: 0.120494 Jul 27 23:10:13.179956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1201/2226] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:10:13 2022] DELETE /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 23:10:13.185671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fbc42048-256d-499c-aa16-abca6262f934 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:13.186242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fbc42048-256d-499c-aa16-abca6262f934 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:13.191887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fbc42048-256d-499c-aa16-abca6262f934 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:13.192326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fbc42048-256d-499c-aa16-abca6262f934 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:13.193115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fbc42048-256d-499c-aa16-abca6262f934 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:13.193541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fbc42048-256d-499c-aa16-abca6262f934 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:13.217840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fbc42048-256d-499c-aa16-abca6262f934 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Going to try to terminate instance {{(pid=129295) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 23:10:13.263748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:13.293991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fbc42048-256d-499c-aa16-abca6262f934 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 204 len: 0 microversion: 2.1 time: 0.112616 Jul 27 23:10:13.294500 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1202/2227] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:10:13 2022] DELETE /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 23:10:13.300319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e2c55f2d-8399-480f-81a6-c4f6ca3daa42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:13.301288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e2c55f2d-8399-480f-81a6-c4f6ca3daa42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:13.308303 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2c55f2d-8399-480f-81a6-c4f6ca3daa42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:13.308808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2c55f2d-8399-480f-81a6-c4f6ca3daa42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:13.309575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2c55f2d-8399-480f-81a6-c4f6ca3daa42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:13.310040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2c55f2d-8399-480f-81a6-c4f6ca3daa42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:13.440890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e2c55f2d-8399-480f-81a6-c4f6ca3daa42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:13.449370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e2c55f2d-8399-480f-81a6-c4f6ca3daa42 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.153790 Jul 27 23:10:13.449926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1203/2228] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:13 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:13.454267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ae025675-4737-4dc6-bfa0-b8341d638be4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:13.454864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ae025675-4737-4dc6-bfa0-b8341d638be4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:13.460284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae025675-4737-4dc6-bfa0-b8341d638be4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:13.460760 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae025675-4737-4dc6-bfa0-b8341d638be4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:13.461502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae025675-4737-4dc6-bfa0-b8341d638be4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:13.461926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ae025675-4737-4dc6-bfa0-b8341d638be4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:13.586807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ae025675-4737-4dc6-bfa0-b8341d638be4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:13.594592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ae025675-4737-4dc6-bfa0-b8341d638be4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.143754 Jul 27 23:10:13.595146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1204/2229] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:13 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:13.801994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d84fd0bf-a758-4afa-9a9f-03603147393f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:13.802652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d84fd0bf-a758-4afa-9a9f-03603147393f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:13.809752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d84fd0bf-a758-4afa-9a9f-03603147393f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:13.810201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d84fd0bf-a758-4afa-9a9f-03603147393f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:13.810956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d84fd0bf-a758-4afa-9a9f-03603147393f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:13.811388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d84fd0bf-a758-4afa-9a9f-03603147393f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:13.874471 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d84fd0bf-a758-4afa-9a9f-03603147393f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:13.882736 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d84fd0bf-a758-4afa-9a9f-03603147393f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:13.884260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d84fd0bf-a758-4afa-9a9f-03603147393f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:13.885409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d84fd0bf-a758-4afa-9a9f-03603147393f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087374 Jul 27 23:10:13.885953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1205/2230] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:10:14.129360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [None req-653f4320-2ebf-49eb-99cb-742f56930fa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [f8399fcd-75f1-4b46-b6cc-1a417ab8f422] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 41518. Jul 27 23:10:14.148792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-653f4320-2ebf-49eb-99cb-742f56930fa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "DELETE /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 204 len: 0 microversion: 2.1 time: 1.142792 Jul 27 23:10:14.150048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1026/2231] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:10:13 2022] DELETE /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 0 bytes in 1145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 23:10:14.159452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-afe9f69d-20c7-4869-a3d2-52a22957ff88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:14.160065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-afe9f69d-20c7-4869-a3d2-52a22957ff88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:14.166790 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afe9f69d-20c7-4869-a3d2-52a22957ff88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:14.167238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afe9f69d-20c7-4869-a3d2-52a22957ff88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:14.167999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afe9f69d-20c7-4869-a3d2-52a22957ff88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:14.168436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afe9f69d-20c7-4869-a3d2-52a22957ff88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:14.292838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-afe9f69d-20c7-4869-a3d2-52a22957ff88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:14.300638 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-afe9f69d-20c7-4869-a3d2-52a22957ff88 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.145188 Jul 27 23:10:14.301197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1206/2232] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:14 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:14.471165 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1183b41b-9cd3-4844-bd52-a8870e5a0287 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:14.471777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1183b41b-9cd3-4844-bd52-a8870e5a0287 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:14.477755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1183b41b-9cd3-4844-bd52-a8870e5a0287 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:14.478197 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1183b41b-9cd3-4844-bd52-a8870e5a0287 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:14.479510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1183b41b-9cd3-4844-bd52-a8870e5a0287 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:14.479939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1183b41b-9cd3-4844-bd52-a8870e5a0287 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:14.606736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1183b41b-9cd3-4844-bd52-a8870e5a0287 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:14.614976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9e4b27a4-f249-4490-b93f-b26ccc2d3bce tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:14.615152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1183b41b-9cd3-4844-bd52-a8870e5a0287 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.148256 Jul 27 23:10:14.615541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1027/2233] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:14 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:14.615737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9e4b27a4-f249-4490-b93f-b26ccc2d3bce tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:14.622129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9e4b27a4-f249-4490-b93f-b26ccc2d3bce tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:14.622576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9e4b27a4-f249-4490-b93f-b26ccc2d3bce tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:14.623330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9e4b27a4-f249-4490-b93f-b26ccc2d3bce tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:14.623768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9e4b27a4-f249-4490-b93f-b26ccc2d3bce tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:14.749699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9e4b27a4-f249-4490-b93f-b26ccc2d3bce tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:14.757508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9e4b27a4-f249-4490-b93f-b26ccc2d3bce tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.146288 Jul 27 23:10:14.758066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1207/2234] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:14 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:14.907166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f1d0c0cb-9354-44cc-b12a-1b2fb6bbe802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:14.907767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f1d0c0cb-9354-44cc-b12a-1b2fb6bbe802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:14.913954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1d0c0cb-9354-44cc-b12a-1b2fb6bbe802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:14.914393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1d0c0cb-9354-44cc-b12a-1b2fb6bbe802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:14.915145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1d0c0cb-9354-44cc-b12a-1b2fb6bbe802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:14.915575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1d0c0cb-9354-44cc-b12a-1b2fb6bbe802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:14.976177 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f1d0c0cb-9354-44cc-b12a-1b2fb6bbe802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:14.984689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f1d0c0cb-9354-44cc-b12a-1b2fb6bbe802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:14.986179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f1d0c0cb-9354-44cc-b12a-1b2fb6bbe802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:14.987302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f1d0c0cb-9354-44cc-b12a-1b2fb6bbe802 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084005 Jul 27 23:10:14.987852 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1028/2235] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:14 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:15.322438 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ff228681-3d80-48fe-aecc-39471a678027 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:15.323064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ff228681-3d80-48fe-aecc-39471a678027 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:15.329504 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff228681-3d80-48fe-aecc-39471a678027 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:15.329954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff228681-3d80-48fe-aecc-39471a678027 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:15.330719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff228681-3d80-48fe-aecc-39471a678027 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:15.331200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff228681-3d80-48fe-aecc-39471a678027 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:15.458605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ff228681-3d80-48fe-aecc-39471a678027 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:15.467064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ff228681-3d80-48fe-aecc-39471a678027 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148945 Jul 27 23:10:15.467617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1208/2236] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:15 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:15.637061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c6caf38e-a85c-438d-baa0-a0d986570f5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:15.637668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c6caf38e-a85c-438d-baa0-a0d986570f5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:15.643991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c6caf38e-a85c-438d-baa0-a0d986570f5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:15.644438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c6caf38e-a85c-438d-baa0-a0d986570f5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:15.645232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c6caf38e-a85c-438d-baa0-a0d986570f5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:15.645670 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c6caf38e-a85c-438d-baa0-a0d986570f5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:15.648280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:15.775359 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c6caf38e-a85c-438d-baa0-a0d986570f5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:15.777930 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dd38b5d5-7335-4421-8bbd-39d614c82731 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:15.778541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dd38b5d5-7335-4421-8bbd-39d614c82731 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:15.783265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c6caf38e-a85c-438d-baa0-a0d986570f5d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.150736 Jul 27 23:10:15.783824 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1029/2237] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:15.784358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd38b5d5-7335-4421-8bbd-39d614c82731 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:15.784842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd38b5d5-7335-4421-8bbd-39d614c82731 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:15.785596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd38b5d5-7335-4421-8bbd-39d614c82731 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:15.786024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd38b5d5-7335-4421-8bbd-39d614c82731 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:15.909567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dd38b5d5-7335-4421-8bbd-39d614c82731 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:15.917375 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dd38b5d5-7335-4421-8bbd-39d614c82731 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.143242 Jul 27 23:10:15.917941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1209/2238] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:15 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:16.010161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6443696b-6650-4135-be1f-ee662ca9d646 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:16.010701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6443696b-6650-4135-be1f-ee662ca9d646 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:16.016720 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6443696b-6650-4135-be1f-ee662ca9d646 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:16.017169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6443696b-6650-4135-be1f-ee662ca9d646 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:16.017926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6443696b-6650-4135-be1f-ee662ca9d646 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:16.018358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6443696b-6650-4135-be1f-ee662ca9d646 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:16.080396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6443696b-6650-4135-be1f-ee662ca9d646 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:16.088730 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6443696b-6650-4135-be1f-ee662ca9d646 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:16.090265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6443696b-6650-4135-be1f-ee662ca9d646 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:16.091392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6443696b-6650-4135-be1f-ee662ca9d646 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085188 Jul 27 23:10:16.091941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1030/2239] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:16 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:16.488573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a02a9454-3ecf-4fe3-b3bf-0cce939160fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:16.489188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a02a9454-3ecf-4fe3-b3bf-0cce939160fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:16.495628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a02a9454-3ecf-4fe3-b3bf-0cce939160fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:16.496077 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a02a9454-3ecf-4fe3-b3bf-0cce939160fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:16.496862 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a02a9454-3ecf-4fe3-b3bf-0cce939160fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:16.497295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a02a9454-3ecf-4fe3-b3bf-0cce939160fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:16.621305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a02a9454-3ecf-4fe3-b3bf-0cce939160fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:16.629096 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a02a9454-3ecf-4fe3-b3bf-0cce939160fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.144369 Jul 27 23:10:16.629658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1210/2240] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:16 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:16.804150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-14146869-e72e-41db-8fa3-178f78c628be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:16.804784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-14146869-e72e-41db-8fa3-178f78c628be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:16.811316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14146869-e72e-41db-8fa3-178f78c628be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:16.811755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14146869-e72e-41db-8fa3-178f78c628be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:16.812510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14146869-e72e-41db-8fa3-178f78c628be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:16.813124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14146869-e72e-41db-8fa3-178f78c628be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:16.938433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-05edffce-0ccd-4037-91b5-07b28cc87397 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:16.939132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-05edffce-0ccd-4037-91b5-07b28cc87397 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:16.945006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05edffce-0ccd-4037-91b5-07b28cc87397 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:16.945448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05edffce-0ccd-4037-91b5-07b28cc87397 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:16.946195 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05edffce-0ccd-4037-91b5-07b28cc87397 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:16.946623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05edffce-0ccd-4037-91b5-07b28cc87397 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:16.953441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-14146869-e72e-41db-8fa3-178f78c628be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:16.961310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-14146869-e72e-41db-8fa3-178f78c628be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.160990 Jul 27 23:10:16.962063 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1031/2241] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:16 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:17.076729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-05edffce-0ccd-4037-91b5-07b28cc87397 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:17.084498 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-05edffce-0ccd-4037-91b5-07b28cc87397 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.149880 Jul 27 23:10:17.085076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1211/2242] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:16 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:17.114043 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b1b1b0f3-479a-4490-9139-a1d1d83044f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:17.114644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b1b1b0f3-479a-4490-9139-a1d1d83044f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:17.121108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1b1b0f3-479a-4490-9139-a1d1d83044f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:17.121549 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1b1b0f3-479a-4490-9139-a1d1d83044f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:17.122292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1b1b0f3-479a-4490-9139-a1d1d83044f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:17.122717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1b1b0f3-479a-4490-9139-a1d1d83044f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:17.184245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b1b1b0f3-479a-4490-9139-a1d1d83044f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:17.192456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b1b1b0f3-479a-4490-9139-a1d1d83044f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:17.193965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b1b1b0f3-479a-4490-9139-a1d1d83044f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:17.195081 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b1b1b0f3-479a-4490-9139-a1d1d83044f9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084910 Jul 27 23:10:17.195630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1032/2243] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:17 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:17.649856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-49507657-7458-4f6d-8861-113c0c4a49b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:17.650461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-49507657-7458-4f6d-8861-113c0c4a49b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:17.658375 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49507657-7458-4f6d-8861-113c0c4a49b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:17.658823 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49507657-7458-4f6d-8861-113c0c4a49b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:17.659622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49507657-7458-4f6d-8861-113c0c4a49b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:17.660052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49507657-7458-4f6d-8861-113c0c4a49b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:17.786462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-49507657-7458-4f6d-8861-113c0c4a49b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:17.794692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-49507657-7458-4f6d-8861-113c0c4a49b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148727 Jul 27 23:10:17.795245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1212/2244] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:17 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:17.984177 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-259806a8-b6c1-4ea0-a7d4-fd7a6c3bedd4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:17.984811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-259806a8-b6c1-4ea0-a7d4-fd7a6c3bedd4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:17.987089 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:17.993083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-259806a8-b6c1-4ea0-a7d4-fd7a6c3bedd4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:17.993471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-259806a8-b6c1-4ea0-a7d4-fd7a6c3bedd4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:17.994232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-259806a8-b6c1-4ea0-a7d4-fd7a6c3bedd4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:17.994662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-259806a8-b6c1-4ea0-a7d4-fd7a6c3bedd4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:18.106531 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7e33d9fe-7838-408d-bb34-754b5b7b715d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:18.107246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7e33d9fe-7838-408d-bb34-754b5b7b715d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:18.113515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e33d9fe-7838-408d-bb34-754b5b7b715d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:18.113956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e33d9fe-7838-408d-bb34-754b5b7b715d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:18.114704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e33d9fe-7838-408d-bb34-754b5b7b715d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:18.115128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7e33d9fe-7838-408d-bb34-754b5b7b715d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:18.133082 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-259806a8-b6c1-4ea0-a7d4-fd7a6c3bedd4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:18.141152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-259806a8-b6c1-4ea0-a7d4-fd7a6c3bedd4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.161059 Jul 27 23:10:18.141742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1033/2245] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:17 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:18.218896 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2c92a41b-a881-4dc4-a84b-dcfe62a953dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:18.219503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2c92a41b-a881-4dc4-a84b-dcfe62a953dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:18.225423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2c92a41b-a881-4dc4-a84b-dcfe62a953dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:18.225865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2c92a41b-a881-4dc4-a84b-dcfe62a953dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:18.226626 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2c92a41b-a881-4dc4-a84b-dcfe62a953dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:18.227065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2c92a41b-a881-4dc4-a84b-dcfe62a953dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:18.242031 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7e33d9fe-7838-408d-bb34-754b5b7b715d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:18.250023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7e33d9fe-7838-408d-bb34-754b5b7b715d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.148071 Jul 27 23:10:18.250520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1213/2246] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:18 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:18.292120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2c92a41b-a881-4dc4-a84b-dcfe62a953dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:18.300507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2c92a41b-a881-4dc4-a84b-dcfe62a953dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:18.302029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2c92a41b-a881-4dc4-a84b-dcfe62a953dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:18.303192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2c92a41b-a881-4dc4-a84b-dcfe62a953dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088205 Jul 27 23:10:18.303740 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1034/2247] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:10:18.816076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1ea1b910-d51e-4196-9551-43558813eae1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:18.816724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1ea1b910-d51e-4196-9551-43558813eae1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:18.819124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:18.825378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ea1b910-d51e-4196-9551-43558813eae1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:18.825829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ea1b910-d51e-4196-9551-43558813eae1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:18.826577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ea1b910-d51e-4196-9551-43558813eae1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:18.827008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ea1b910-d51e-4196-9551-43558813eae1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:18.950944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1ea1b910-d51e-4196-9551-43558813eae1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:18.958705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1ea1b910-d51e-4196-9551-43558813eae1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146533 Jul 27 23:10:18.959268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1214/2248] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:18 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:19.163346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2fc8738d-42a9-42c3-9982-01d5fb986aad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:19.163959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2fc8738d-42a9-42c3-9982-01d5fb986aad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:19.170655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2fc8738d-42a9-42c3-9982-01d5fb986aad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:19.171100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2fc8738d-42a9-42c3-9982-01d5fb986aad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:19.171858 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2fc8738d-42a9-42c3-9982-01d5fb986aad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:19.172288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2fc8738d-42a9-42c3-9982-01d5fb986aad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:19.272572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3ea5a105-aad5-4546-9fc6-9a23a2bf4948 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:19.273177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3ea5a105-aad5-4546-9fc6-9a23a2bf4948 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:19.279888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3ea5a105-aad5-4546-9fc6-9a23a2bf4948 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:19.280328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3ea5a105-aad5-4546-9fc6-9a23a2bf4948 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:19.281111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3ea5a105-aad5-4546-9fc6-9a23a2bf4948 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:19.281540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3ea5a105-aad5-4546-9fc6-9a23a2bf4948 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:19.298296 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2fc8738d-42a9-42c3-9982-01d5fb986aad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:19.306184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2fc8738d-42a9-42c3-9982-01d5fb986aad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.146794 Jul 27 23:10:19.307298 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1035/2249] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:19 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:19.326057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-21f4e1d0-3061-4837-a878-33070b85a662 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:19.326664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-21f4e1d0-3061-4837-a878-33070b85a662 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:19.332841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21f4e1d0-3061-4837-a878-33070b85a662 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:19.333281 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21f4e1d0-3061-4837-a878-33070b85a662 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:19.334037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21f4e1d0-3061-4837-a878-33070b85a662 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:19.334468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-21f4e1d0-3061-4837-a878-33070b85a662 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:19.403124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-21f4e1d0-3061-4837-a878-33070b85a662 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:19.411588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-21f4e1d0-3061-4837-a878-33070b85a662 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:19.413049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-21f4e1d0-3061-4837-a878-33070b85a662 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:19.414180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-21f4e1d0-3061-4837-a878-33070b85a662 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.092607 Jul 27 23:10:19.414722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1036/2250] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:19 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:10:19.432871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3ea5a105-aad5-4546-9fc6-9a23a2bf4948 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:19.440695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3ea5a105-aad5-4546-9fc6-9a23a2bf4948 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.172100 Jul 27 23:10:19.441246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1215/2251] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:19 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:19.979223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2a5fb9f9-38c3-481c-b823-3f8529399e03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:19.979861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2a5fb9f9-38c3-481c-b823-3f8529399e03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:19.986206 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a5fb9f9-38c3-481c-b823-3f8529399e03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:19.986654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a5fb9f9-38c3-481c-b823-3f8529399e03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:19.987413 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a5fb9f9-38c3-481c-b823-3f8529399e03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:19.987846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a5fb9f9-38c3-481c-b823-3f8529399e03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:20.113944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2a5fb9f9-38c3-481c-b823-3f8529399e03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:20.122277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2a5fb9f9-38c3-481c-b823-3f8529399e03 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146923 Jul 27 23:10:20.122833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1037/2252] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:19 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:20.327765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3298777d-8116-4fe3-b559-8b20b170453d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:20.328367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3298777d-8116-4fe3-b559-8b20b170453d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:20.334873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3298777d-8116-4fe3-b559-8b20b170453d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:20.335314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3298777d-8116-4fe3-b559-8b20b170453d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:20.336079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3298777d-8116-4fe3-b559-8b20b170453d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:20.336492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3298777d-8116-4fe3-b559-8b20b170453d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:20.437692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-99789c2f-7540-48d7-921c-af22e06f1aff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:20.438287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-99789c2f-7540-48d7-921c-af22e06f1aff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:20.445055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-99789c2f-7540-48d7-921c-af22e06f1aff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:20.445502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-99789c2f-7540-48d7-921c-af22e06f1aff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:20.446280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-99789c2f-7540-48d7-921c-af22e06f1aff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:20.446714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-99789c2f-7540-48d7-921c-af22e06f1aff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:20.623263 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-99789c2f-7540-48d7-921c-af22e06f1aff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:20.631773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-99789c2f-7540-48d7-921c-af22e06f1aff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:20.633296 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-99789c2f-7540-48d7-921c-af22e06f1aff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:20.634432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-99789c2f-7540-48d7-921c-af22e06f1aff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.200761 Jul 27 23:10:20.634980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1038/2253] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:10:20.639392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4168d141-02a7-4720-9816-a62eb6df39b1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:20.639995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4168d141-02a7-4720-9816-a62eb6df39b1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:20.645761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4168d141-02a7-4720-9816-a62eb6df39b1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:20.646198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4168d141-02a7-4720-9816-a62eb6df39b1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:20.646942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4168d141-02a7-4720-9816-a62eb6df39b1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:20.647368 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4168d141-02a7-4720-9816-a62eb6df39b1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:20.679584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3298777d-8116-4fe3-b559-8b20b170453d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:20.688158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3298777d-8116-4fe3-b559-8b20b170453d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.364182 Jul 27 23:10:20.688754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1216/2254] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:20 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:20.772673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4168d141-02a7-4720-9816-a62eb6df39b1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:20.781212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4168d141-02a7-4720-9816-a62eb6df39b1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.145316 Jul 27 23:10:20.781768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1039/2255] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:20 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:21.143706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-04f7f1c0-62ec-4718-bf2c-c02f646f4d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:21.144317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-04f7f1c0-62ec-4718-bf2c-c02f646f4d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:21.151149 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-04f7f1c0-62ec-4718-bf2c-c02f646f4d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:21.151599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-04f7f1c0-62ec-4718-bf2c-c02f646f4d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:21.152358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-04f7f1c0-62ec-4718-bf2c-c02f646f4d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:21.152815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-04f7f1c0-62ec-4718-bf2c-c02f646f4d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:21.283499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-04f7f1c0-62ec-4718-bf2c-c02f646f4d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:21.291311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-04f7f1c0-62ec-4718-bf2c-c02f646f4d59 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.151418 Jul 27 23:10:21.291868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1217/2256] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:21 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:21.659437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2e323b3a-7d3f-4fa3-9de4-296b8d953481 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:21.660231 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2e323b3a-7d3f-4fa3-9de4-296b8d953481 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:21.668147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2e323b3a-7d3f-4fa3-9de4-296b8d953481 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:21.668610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2e323b3a-7d3f-4fa3-9de4-296b8d953481 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:21.669420 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2e323b3a-7d3f-4fa3-9de4-296b8d953481 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:21.670190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2e323b3a-7d3f-4fa3-9de4-296b8d953481 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:21.709713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-68f5af36-ce34-4da2-8466-4b1d6c045c7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:21.710327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-68f5af36-ce34-4da2-8466-4b1d6c045c7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:21.717382 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68f5af36-ce34-4da2-8466-4b1d6c045c7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:21.717831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68f5af36-ce34-4da2-8466-4b1d6c045c7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:21.718603 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68f5af36-ce34-4da2-8466-4b1d6c045c7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:21.719042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68f5af36-ce34-4da2-8466-4b1d6c045c7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:21.733985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2e323b3a-7d3f-4fa3-9de4-296b8d953481 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:21.742453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2e323b3a-7d3f-4fa3-9de4-296b8d953481 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:21.743992 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2e323b3a-7d3f-4fa3-9de4-296b8d953481 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:21.745159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2e323b3a-7d3f-4fa3-9de4-296b8d953481 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.091245 Jul 27 23:10:21.750055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1040/2257] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:21 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:21.802346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-29fd26fa-5669-4401-be4e-e6a3d0249c51 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:21.802955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-29fd26fa-5669-4401-be4e-e6a3d0249c51 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:21.809094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-29fd26fa-5669-4401-be4e-e6a3d0249c51 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:21.809653 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-29fd26fa-5669-4401-be4e-e6a3d0249c51 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:21.810414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-29fd26fa-5669-4401-be4e-e6a3d0249c51 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:21.810840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-29fd26fa-5669-4401-be4e-e6a3d0249c51 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:21.846906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-68f5af36-ce34-4da2-8466-4b1d6c045c7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:21.855512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-68f5af36-ce34-4da2-8466-4b1d6c045c7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.149544 Jul 27 23:10:21.856087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1218/2258] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:21 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:21.941548 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-29fd26fa-5669-4401-be4e-e6a3d0249c51 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:21.949851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-29fd26fa-5669-4401-be4e-e6a3d0249c51 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.151248 Jul 27 23:10:21.950411 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1041/2259] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:21 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:22.312071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3139fd88-f812-46a2-b36b-bbd3be0fa1a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:22.312730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3139fd88-f812-46a2-b36b-bbd3be0fa1a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:22.318747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3139fd88-f812-46a2-b36b-bbd3be0fa1a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:22.319207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3139fd88-f812-46a2-b36b-bbd3be0fa1a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:22.319962 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3139fd88-f812-46a2-b36b-bbd3be0fa1a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:22.320402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3139fd88-f812-46a2-b36b-bbd3be0fa1a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:22.324920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:22.447312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3139fd88-f812-46a2-b36b-bbd3be0fa1a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:22.455734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3139fd88-f812-46a2-b36b-bbd3be0fa1a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147581 Jul 27 23:10:22.456288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1219/2260] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:22 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:22.767230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a883c971-e4c3-4c8f-9227-96caf403ed2a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:22.767871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a883c971-e4c3-4c8f-9227-96caf403ed2a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:22.774385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a883c971-e4c3-4c8f-9227-96caf403ed2a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:22.774825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a883c971-e4c3-4c8f-9227-96caf403ed2a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:22.775567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a883c971-e4c3-4c8f-9227-96caf403ed2a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:22.775995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a883c971-e4c3-4c8f-9227-96caf403ed2a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:22.839286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a883c971-e4c3-4c8f-9227-96caf403ed2a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:22.847820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a883c971-e4c3-4c8f-9227-96caf403ed2a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:22.849346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a883c971-e4c3-4c8f-9227-96caf403ed2a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:22.850467 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a883c971-e4c3-4c8f-9227-96caf403ed2a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087138 Jul 27 23:10:22.851013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1042/2261] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:22 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:22.877199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ebbdee2b-858a-4e15-a750-bfe3cfc38918 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:22.877836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ebbdee2b-858a-4e15-a750-bfe3cfc38918 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:22.884276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebbdee2b-858a-4e15-a750-bfe3cfc38918 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:22.884768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebbdee2b-858a-4e15-a750-bfe3cfc38918 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:22.885521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebbdee2b-858a-4e15-a750-bfe3cfc38918 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:22.885951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebbdee2b-858a-4e15-a750-bfe3cfc38918 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:22.971038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b9212ff5-c183-48b4-a6fe-7fc382763a6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:22.971641 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b9212ff5-c183-48b4-a6fe-7fc382763a6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:22.977622 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b9212ff5-c183-48b4-a6fe-7fc382763a6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:22.978068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b9212ff5-c183-48b4-a6fe-7fc382763a6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:22.979317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b9212ff5-c183-48b4-a6fe-7fc382763a6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:22.979742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b9212ff5-c183-48b4-a6fe-7fc382763a6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:23.013300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ebbdee2b-858a-4e15-a750-bfe3cfc38918 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:23.021156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ebbdee2b-858a-4e15-a750-bfe3cfc38918 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.147850 Jul 27 23:10:23.021730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1220/2262] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:22 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:23.107414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b9212ff5-c183-48b4-a6fe-7fc382763a6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:23.115594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b9212ff5-c183-48b4-a6fe-7fc382763a6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.148320 Jul 27 23:10:23.116155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1043/2263] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:22 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:23.476733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-506611af-37c1-4b7d-b86d-bc54dbd92d0f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:23.477254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-506611af-37c1-4b7d-b86d-bc54dbd92d0f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:23.484245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-506611af-37c1-4b7d-b86d-bc54dbd92d0f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:23.484719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-506611af-37c1-4b7d-b86d-bc54dbd92d0f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:23.485477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-506611af-37c1-4b7d-b86d-bc54dbd92d0f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:23.485903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-506611af-37c1-4b7d-b86d-bc54dbd92d0f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:23.615541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-506611af-37c1-4b7d-b86d-bc54dbd92d0f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:23.624026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-506611af-37c1-4b7d-b86d-bc54dbd92d0f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.151289 Jul 27 23:10:23.624597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1221/2264] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:23 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:23.874195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-310ae1fc-045c-424b-beaf-4847562578c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:23.874803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-310ae1fc-045c-424b-beaf-4847562578c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:23.881202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-310ae1fc-045c-424b-beaf-4847562578c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:23.881650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-310ae1fc-045c-424b-beaf-4847562578c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:23.882408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-310ae1fc-045c-424b-beaf-4847562578c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:23.882838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-310ae1fc-045c-424b-beaf-4847562578c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:23.944256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-310ae1fc-045c-424b-beaf-4847562578c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:23.952677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-310ae1fc-045c-424b-beaf-4847562578c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:23.954173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-310ae1fc-045c-424b-beaf-4847562578c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:23.955312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-310ae1fc-045c-424b-beaf-4847562578c6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085287 Jul 27 23:10:23.955866 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1044/2265] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:23 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:24.041918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a747c493-6fc9-472e-9ff4-71635a3d9937 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:24.042529 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a747c493-6fc9-472e-9ff4-71635a3d9937 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:24.049060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a747c493-6fc9-472e-9ff4-71635a3d9937 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:24.049500 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a747c493-6fc9-472e-9ff4-71635a3d9937 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:24.050252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a747c493-6fc9-472e-9ff4-71635a3d9937 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:24.050682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a747c493-6fc9-472e-9ff4-71635a3d9937 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:24.136443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6462b553-dce2-4767-aa6f-7cdfd6344221 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:24.137175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6462b553-dce2-4767-aa6f-7cdfd6344221 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:24.143256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6462b553-dce2-4767-aa6f-7cdfd6344221 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:24.143782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6462b553-dce2-4767-aa6f-7cdfd6344221 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:24.144753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6462b553-dce2-4767-aa6f-7cdfd6344221 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:24.145259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6462b553-dce2-4767-aa6f-7cdfd6344221 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:24.177193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a747c493-6fc9-472e-9ff4-71635a3d9937 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:24.185169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a747c493-6fc9-472e-9ff4-71635a3d9937 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.147691 Jul 27 23:10:24.185735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1222/2266] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:24 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:24.279756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6462b553-dce2-4767-aa6f-7cdfd6344221 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:24.281982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:24.289051 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6462b553-dce2-4767-aa6f-7cdfd6344221 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.156414 Jul 27 23:10:24.289615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1045/2267] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:24 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:24.645375 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1fe253c5-957f-4f67-8a53-4b7a3a76b6c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:24.646014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1fe253c5-957f-4f67-8a53-4b7a3a76b6c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:24.652028 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1fe253c5-957f-4f67-8a53-4b7a3a76b6c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:24.652470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1fe253c5-957f-4f67-8a53-4b7a3a76b6c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:24.653246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1fe253c5-957f-4f67-8a53-4b7a3a76b6c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:24.653676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1fe253c5-957f-4f67-8a53-4b7a3a76b6c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:24.784930 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1fe253c5-957f-4f67-8a53-4b7a3a76b6c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:24.793076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1fe253c5-957f-4f67-8a53-4b7a3a76b6c2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.151460 Jul 27 23:10:24.793675 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1223/2268] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:24 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:24.979387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3a23acb3-30c7-4b37-a113-b6f333a0c63d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:24.979944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3a23acb3-30c7-4b37-a113-b6f333a0c63d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:24.987316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3a23acb3-30c7-4b37-a113-b6f333a0c63d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:24.987761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3a23acb3-30c7-4b37-a113-b6f333a0c63d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:24.988523 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3a23acb3-30c7-4b37-a113-b6f333a0c63d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:24.988974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3a23acb3-30c7-4b37-a113-b6f333a0c63d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:25.056391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3a23acb3-30c7-4b37-a113-b6f333a0c63d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:25.065536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3a23acb3-30c7-4b37-a113-b6f333a0c63d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:25.067044 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3a23acb3-30c7-4b37-a113-b6f333a0c63d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:25.068195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3a23acb3-30c7-4b37-a113-b6f333a0c63d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.093557 Jul 27 23:10:25.068854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1046/2269] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:24 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:25.206773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fb69cb78-d8aa-40c4-a9b8-964be3e27c1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:25.207388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fb69cb78-d8aa-40c4-a9b8-964be3e27c1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:25.213849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb69cb78-d8aa-40c4-a9b8-964be3e27c1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:25.214336 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb69cb78-d8aa-40c4-a9b8-964be3e27c1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:25.215324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb69cb78-d8aa-40c4-a9b8-964be3e27c1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:25.216079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb69cb78-d8aa-40c4-a9b8-964be3e27c1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:25.311658 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fb5b9833-70a6-41a8-b839-677082c217c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:25.312308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fb5b9833-70a6-41a8-b839-677082c217c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:25.318294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb5b9833-70a6-41a8-b839-677082c217c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:25.318743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb5b9833-70a6-41a8-b839-677082c217c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:25.319510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb5b9833-70a6-41a8-b839-677082c217c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:25.319944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb5b9833-70a6-41a8-b839-677082c217c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:25.357121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fb69cb78-d8aa-40c4-a9b8-964be3e27c1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:25.367109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fb69cb78-d8aa-40c4-a9b8-964be3e27c1d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.162565 Jul 27 23:10:25.367109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1224/2270] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:25 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:25.461908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fb5b9833-70a6-41a8-b839-677082c217c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:25.470416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fb5b9833-70a6-41a8-b839-677082c217c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.162612 Jul 27 23:10:25.470986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1047/2271] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:25 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:25.816578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3b7bb1a5-b159-431f-b61b-d914d8a5da5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:25.817188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3b7bb1a5-b159-431f-b61b-d914d8a5da5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:25.823688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b7bb1a5-b159-431f-b61b-d914d8a5da5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:25.824123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b7bb1a5-b159-431f-b61b-d914d8a5da5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:25.824921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b7bb1a5-b159-431f-b61b-d914d8a5da5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:25.825350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b7bb1a5-b159-431f-b61b-d914d8a5da5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:25.953346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3b7bb1a5-b159-431f-b61b-d914d8a5da5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:25.961162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3b7bb1a5-b159-431f-b61b-d914d8a5da5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148443 Jul 27 23:10:25.961732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1225/2272] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:26.159646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a5b8b60b-fc60-482b-99aa-c1b440619bd2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:26.160248 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a5b8b60b-fc60-482b-99aa-c1b440619bd2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:26.166436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a5b8b60b-fc60-482b-99aa-c1b440619bd2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:26.166876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a5b8b60b-fc60-482b-99aa-c1b440619bd2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:26.167625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a5b8b60b-fc60-482b-99aa-c1b440619bd2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:26.168053 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a5b8b60b-fc60-482b-99aa-c1b440619bd2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:26.228297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a5b8b60b-fc60-482b-99aa-c1b440619bd2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:26.236883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a5b8b60b-fc60-482b-99aa-c1b440619bd2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:26.238378 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a5b8b60b-fc60-482b-99aa-c1b440619bd2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:26.239509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a5b8b60b-fc60-482b-99aa-c1b440619bd2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.152620 Jul 27 23:10:26.240053 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1048/2273] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:26 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:26.458417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-54ad8642-0dfc-4d00-a4f0-99375e2158f9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:26.459024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-54ad8642-0dfc-4d00-a4f0-99375e2158f9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:26.465027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-54ad8642-0dfc-4d00-a4f0-99375e2158f9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:26.465468 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-54ad8642-0dfc-4d00-a4f0-99375e2158f9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:26.466223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-54ad8642-0dfc-4d00-a4f0-99375e2158f9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:26.466650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-54ad8642-0dfc-4d00-a4f0-99375e2158f9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:26.492980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-08bbb379-fe2e-45cf-95df-6ce9e772dc87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:26.493590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-08bbb379-fe2e-45cf-95df-6ce9e772dc87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:26.500085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08bbb379-fe2e-45cf-95df-6ce9e772dc87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:26.500529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08bbb379-fe2e-45cf-95df-6ce9e772dc87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:26.501332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08bbb379-fe2e-45cf-95df-6ce9e772dc87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:26.501748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08bbb379-fe2e-45cf-95df-6ce9e772dc87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:26.664490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-54ad8642-0dfc-4d00-a4f0-99375e2158f9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:26.672840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-54ad8642-0dfc-4d00-a4f0-99375e2158f9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.289482 Jul 27 23:10:26.673411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1226/2274] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:26 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:26.675960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-08bbb379-fe2e-45cf-95df-6ce9e772dc87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:26.684598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-08bbb379-fe2e-45cf-95df-6ce9e772dc87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.195354 Jul 27 23:10:26.685163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1049/2275] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:26 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:26.983732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fca27089-41fe-4bf4-ab18-b324cf4290f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:26.984261 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fca27089-41fe-4bf4-ab18-b324cf4290f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:26.990238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fca27089-41fe-4bf4-ab18-b324cf4290f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:26.990679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fca27089-41fe-4bf4-ab18-b324cf4290f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:26.991424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fca27089-41fe-4bf4-ab18-b324cf4290f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:26.991855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fca27089-41fe-4bf4-ab18-b324cf4290f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:27.115995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fca27089-41fe-4bf4-ab18-b324cf4290f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:27.123772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fca27089-41fe-4bf4-ab18-b324cf4290f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.144721 Jul 27 23:10:27.124324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1227/2276] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:26 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:27.263114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-05d26d76-561f-4029-a8e6-b38fd920b24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:27.263659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-05d26d76-561f-4029-a8e6-b38fd920b24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:27.270070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05d26d76-561f-4029-a8e6-b38fd920b24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:27.270510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05d26d76-561f-4029-a8e6-b38fd920b24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:27.271257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05d26d76-561f-4029-a8e6-b38fd920b24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:27.271686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05d26d76-561f-4029-a8e6-b38fd920b24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:27.336313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-05d26d76-561f-4029-a8e6-b38fd920b24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:27.345385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-05d26d76-561f-4029-a8e6-b38fd920b24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:27.346882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-05d26d76-561f-4029-a8e6-b38fd920b24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:27.348021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-05d26d76-561f-4029-a8e6-b38fd920b24e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.089400 Jul 27 23:10:27.348597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1050/2277] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:27 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:27.696400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-133058ad-a57d-4e63-b28d-282895305faf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:27.697065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-133058ad-a57d-4e63-b28d-282895305faf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:27.705993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5fe2858b-ebd5-4904-a98a-82d61be6800e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:27.706218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-133058ad-a57d-4e63-b28d-282895305faf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:27.706598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5fe2858b-ebd5-4904-a98a-82d61be6800e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:27.706707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-133058ad-a57d-4e63-b28d-282895305faf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:27.707417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-133058ad-a57d-4e63-b28d-282895305faf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:27.707846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-133058ad-a57d-4e63-b28d-282895305faf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:27.712453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5fe2858b-ebd5-4904-a98a-82d61be6800e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:27.713527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5fe2858b-ebd5-4904-a98a-82d61be6800e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:27.714176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5fe2858b-ebd5-4904-a98a-82d61be6800e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:27.714607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5fe2858b-ebd5-4904-a98a-82d61be6800e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:27.905429 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-133058ad-a57d-4e63-b28d-282895305faf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:27.908120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5fe2858b-ebd5-4904-a98a-82d61be6800e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:27.913550 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-133058ad-a57d-4e63-b28d-282895305faf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.221262 Jul 27 23:10:27.914123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1228/2278] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:27 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:27.916696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5fe2858b-ebd5-4904-a98a-82d61be6800e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.213840 Jul 27 23:10:27.917266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1051/2279] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:27 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:28.144706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-21c703a2-a6ca-4a01-8a0d-b4f2317f0bb5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:28.145325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-21c703a2-a6ca-4a01-8a0d-b4f2317f0bb5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:28.151929 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21c703a2-a6ca-4a01-8a0d-b4f2317f0bb5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:28.152374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21c703a2-a6ca-4a01-8a0d-b4f2317f0bb5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:28.153151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21c703a2-a6ca-4a01-8a0d-b4f2317f0bb5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:28.153576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21c703a2-a6ca-4a01-8a0d-b4f2317f0bb5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:28.277666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-21c703a2-a6ca-4a01-8a0d-b4f2317f0bb5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:28.285421 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-21c703a2-a6ca-4a01-8a0d-b4f2317f0bb5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.144596 Jul 27 23:10:28.285971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1229/2280] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:28 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:28.370983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-729a273f-798b-4009-9389-9410462d6ee6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:28.371508 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-729a273f-798b-4009-9389-9410462d6ee6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:28.378048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-729a273f-798b-4009-9389-9410462d6ee6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:28.378494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-729a273f-798b-4009-9389-9410462d6ee6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:28.379251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-729a273f-798b-4009-9389-9410462d6ee6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:28.379687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-729a273f-798b-4009-9389-9410462d6ee6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:28.440170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-729a273f-798b-4009-9389-9410462d6ee6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:28.449282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-729a273f-798b-4009-9389-9410462d6ee6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:28.450792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-729a273f-798b-4009-9389-9410462d6ee6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:28.451925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-729a273f-798b-4009-9389-9410462d6ee6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085393 Jul 27 23:10:28.452480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1052/2281] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:28 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:28.935924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8e621cf1-db9e-4605-a91d-a69c116b4de2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:28.936538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8e621cf1-db9e-4605-a91d-a69c116b4de2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:28.938153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6f3fc2e6-a01c-4259-8eb9-8e678945171b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:28.938799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6f3fc2e6-a01c-4259-8eb9-8e678945171b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:28.943104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e621cf1-db9e-4605-a91d-a69c116b4de2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:28.943575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e621cf1-db9e-4605-a91d-a69c116b4de2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:28.944329 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e621cf1-db9e-4605-a91d-a69c116b4de2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:28.944792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e621cf1-db9e-4605-a91d-a69c116b4de2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:28.944925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f3fc2e6-a01c-4259-8eb9-8e678945171b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:28.945240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f3fc2e6-a01c-4259-8eb9-8e678945171b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:28.946005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f3fc2e6-a01c-4259-8eb9-8e678945171b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:28.946439 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6f3fc2e6-a01c-4259-8eb9-8e678945171b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:29.133401 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8e621cf1-db9e-4605-a91d-a69c116b4de2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:29.140955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6f3fc2e6-a01c-4259-8eb9-8e678945171b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:29.141586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8e621cf1-db9e-4605-a91d-a69c116b4de2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.210160 Jul 27 23:10:29.142169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1230/2282] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:28 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:29.148955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6f3fc2e6-a01c-4259-8eb9-8e678945171b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214537 Jul 27 23:10:29.149671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1053/2283] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:28 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:29.305974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cbfe8af1-0662-4354-97e2-621d100ef944 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:29.306589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cbfe8af1-0662-4354-97e2-621d100ef944 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:29.312639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cbfe8af1-0662-4354-97e2-621d100ef944 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:29.313089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cbfe8af1-0662-4354-97e2-621d100ef944 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:29.313844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cbfe8af1-0662-4354-97e2-621d100ef944 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:29.314281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cbfe8af1-0662-4354-97e2-621d100ef944 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:29.441195 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cbfe8af1-0662-4354-97e2-621d100ef944 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:29.449611 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cbfe8af1-0662-4354-97e2-621d100ef944 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147461 Jul 27 23:10:29.450176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1231/2284] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:29 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:29.473450 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6d91de4c-5c4b-4d00-84dc-a8bb90815a3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:29.474078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6d91de4c-5c4b-4d00-84dc-a8bb90815a3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:29.480574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6d91de4c-5c4b-4d00-84dc-a8bb90815a3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:29.481038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6d91de4c-5c4b-4d00-84dc-a8bb90815a3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:29.481801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6d91de4c-5c4b-4d00-84dc-a8bb90815a3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:29.482239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6d91de4c-5c4b-4d00-84dc-a8bb90815a3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:29.542302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6d91de4c-5c4b-4d00-84dc-a8bb90815a3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:29.550806 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6d91de4c-5c4b-4d00-84dc-a8bb90815a3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:29.552318 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6d91de4c-5c4b-4d00-84dc-a8bb90815a3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:29.553482 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6d91de4c-5c4b-4d00-84dc-a8bb90815a3e tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083946 Jul 27 23:10:29.554044 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1054/2285] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:29 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:30.163222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-013703b8-10b2-4da3-bda7-27f4d608ef4a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:30.163842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-013703b8-10b2-4da3-bda7-27f4d608ef4a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:30.170135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-48483250-23cc-4a12-8ab2-929d9c6f894d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:30.170603 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-013703b8-10b2-4da3-bda7-27f4d608ef4a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:30.170747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-48483250-23cc-4a12-8ab2-929d9c6f894d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:30.171053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-013703b8-10b2-4da3-bda7-27f4d608ef4a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:30.171819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-013703b8-10b2-4da3-bda7-27f4d608ef4a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:30.172258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-013703b8-10b2-4da3-bda7-27f4d608ef4a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:30.176671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48483250-23cc-4a12-8ab2-929d9c6f894d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:30.177110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48483250-23cc-4a12-8ab2-929d9c6f894d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:30.177860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48483250-23cc-4a12-8ab2-929d9c6f894d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:30.178308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-48483250-23cc-4a12-8ab2-929d9c6f894d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:30.366655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-013703b8-10b2-4da3-bda7-27f4d608ef4a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:30.370192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-48483250-23cc-4a12-8ab2-929d9c6f894d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:30.375289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-013703b8-10b2-4da3-bda7-27f4d608ef4a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.215938 Jul 27 23:10:30.375846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1232/2286] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:30 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:30.378240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-48483250-23cc-4a12-8ab2-929d9c6f894d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.211871 Jul 27 23:10:30.378802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1055/2287] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:30 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:30.470827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7bc3cc62-c62e-43c6-8d90-8f3fcf0c9aa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:30.471428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7bc3cc62-c62e-43c6-8d90-8f3fcf0c9aa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:30.477392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7bc3cc62-c62e-43c6-8d90-8f3fcf0c9aa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:30.477839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7bc3cc62-c62e-43c6-8d90-8f3fcf0c9aa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:30.479146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7bc3cc62-c62e-43c6-8d90-8f3fcf0c9aa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:30.479575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7bc3cc62-c62e-43c6-8d90-8f3fcf0c9aa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:30.575237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-59827dad-5325-455a-b050-f41d9a5e4eb7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:30.575888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-59827dad-5325-455a-b050-f41d9a5e4eb7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:30.582370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-59827dad-5325-455a-b050-f41d9a5e4eb7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:30.582806 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-59827dad-5325-455a-b050-f41d9a5e4eb7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:30.583560 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-59827dad-5325-455a-b050-f41d9a5e4eb7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:30.583994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-59827dad-5325-455a-b050-f41d9a5e4eb7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:30.607412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7bc3cc62-c62e-43c6-8d90-8f3fcf0c9aa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:30.615656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7bc3cc62-c62e-43c6-8d90-8f3fcf0c9aa3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148489 Jul 27 23:10:30.616154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1233/2288] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:30 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:30.644964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-59827dad-5325-455a-b050-f41d9a5e4eb7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:30.653779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-59827dad-5325-455a-b050-f41d9a5e4eb7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:30.655268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-59827dad-5325-455a-b050-f41d9a5e4eb7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:30.656388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-59827dad-5325-455a-b050-f41d9a5e4eb7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.085098 Jul 27 23:10:30.656961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1056/2289] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:10:31.396439 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-38f91248-a144-43f3-b691-bde7c9d751fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:31.397080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-38f91248-a144-43f3-b691-bde7c9d751fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:31.399164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8475152c-a266-4d0d-ab8f-5d9ee3a73cd0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:31.399769 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8475152c-a266-4d0d-ab8f-5d9ee3a73cd0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:31.403666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-38f91248-a144-43f3-b691-bde7c9d751fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:31.404105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-38f91248-a144-43f3-b691-bde7c9d751fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:31.404937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-38f91248-a144-43f3-b691-bde7c9d751fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:31.405310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-38f91248-a144-43f3-b691-bde7c9d751fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:31.405620 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8475152c-a266-4d0d-ab8f-5d9ee3a73cd0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:31.406060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8475152c-a266-4d0d-ab8f-5d9ee3a73cd0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:31.406806 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8475152c-a266-4d0d-ab8f-5d9ee3a73cd0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:31.407234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8475152c-a266-4d0d-ab8f-5d9ee3a73cd0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:31.595817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-38f91248-a144-43f3-b691-bde7c9d751fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:31.600065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8475152c-a266-4d0d-ab8f-5d9ee3a73cd0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:31.603831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-38f91248-a144-43f3-b691-bde7c9d751fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.211169 Jul 27 23:10:31.604390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1234/2290] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:31 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:31.608845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8475152c-a266-4d0d-ab8f-5d9ee3a73cd0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.213137 Jul 27 23:10:31.609392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1057/2291] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:31 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:31.637165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-80ee9915-16ce-4322-98f6-63bbb0ecbf2b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:31.637769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-80ee9915-16ce-4322-98f6-63bbb0ecbf2b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:31.643556 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-80ee9915-16ce-4322-98f6-63bbb0ecbf2b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:31.643994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-80ee9915-16ce-4322-98f6-63bbb0ecbf2b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:31.644772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-80ee9915-16ce-4322-98f6-63bbb0ecbf2b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:31.645202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-80ee9915-16ce-4322-98f6-63bbb0ecbf2b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:31.680574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b817da88-3c94-4cd8-b036-9056d8e65102 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:31.681105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b817da88-3c94-4cd8-b036-9056d8e65102 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:31.687778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b817da88-3c94-4cd8-b036-9056d8e65102 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:31.688215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b817da88-3c94-4cd8-b036-9056d8e65102 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:31.689113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b817da88-3c94-4cd8-b036-9056d8e65102 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:31.689870 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b817da88-3c94-4cd8-b036-9056d8e65102 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:31.767912 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b817da88-3c94-4cd8-b036-9056d8e65102 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:31.776257 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b817da88-3c94-4cd8-b036-9056d8e65102 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:31.777775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b817da88-3c94-4cd8-b036-9056d8e65102 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:31.778900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b817da88-3c94-4cd8-b036-9056d8e65102 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.102364 Jul 27 23:10:31.779449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1058/2292] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:31 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:10:31.797108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-80ee9915-16ce-4322-98f6-63bbb0ecbf2b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:31.799266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:31.806066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-80ee9915-16ce-4322-98f6-63bbb0ecbf2b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.173305 Jul 27 23:10:31.807225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1235/2293] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:31 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:32.625541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-012825c9-8022-4815-806a-e936d602ba85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:32.626272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-012825c9-8022-4815-806a-e936d602ba85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:32.630445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-decae337-98cb-40a0-a769-106870ef4174 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:32.631060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-decae337-98cb-40a0-a769-106870ef4174 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:32.632690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-012825c9-8022-4815-806a-e936d602ba85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:32.633133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-012825c9-8022-4815-806a-e936d602ba85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:32.633924 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-012825c9-8022-4815-806a-e936d602ba85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:32.634361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-012825c9-8022-4815-806a-e936d602ba85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:32.638081 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-decae337-98cb-40a0-a769-106870ef4174 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:32.638528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-decae337-98cb-40a0-a769-106870ef4174 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:32.639282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-decae337-98cb-40a0-a769-106870ef4174 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:32.639715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-decae337-98cb-40a0-a769-106870ef4174 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:32.830634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-012825c9-8022-4815-806a-e936d602ba85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:32.833465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-decae337-98cb-40a0-a769-106870ef4174 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:32.838686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-012825c9-8022-4815-806a-e936d602ba85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217010 Jul 27 23:10:32.839251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1059/2294] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:32 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:32.841726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-decae337-98cb-40a0-a769-106870ef4174 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215440 Jul 27 23:10:32.842413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1236/2295] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:32 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:32.852273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8b04482f-a5de-46e6-8444-9c020266c3a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:32.852273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8b04482f-a5de-46e6-8444-9c020266c3a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:32.852575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a745ffe4-15be-4d2b-9061-8be52a5546d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:32.852575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a745ffe4-15be-4d2b-9061-8be52a5546d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:32.852762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8b04482f-a5de-46e6-8444-9c020266c3a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:32.852762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8b04482f-a5de-46e6-8444-9c020266c3a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:32.852762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8b04482f-a5de-46e6-8444-9c020266c3a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:32.852762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8b04482f-a5de-46e6-8444-9c020266c3a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:32.854098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a745ffe4-15be-4d2b-9061-8be52a5546d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:32.854593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a745ffe4-15be-4d2b-9061-8be52a5546d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:32.855331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a745ffe4-15be-4d2b-9061-8be52a5546d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:32.855767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a745ffe4-15be-4d2b-9061-8be52a5546d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:32.933652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8b04482f-a5de-46e6-8444-9c020266c3a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:32.941981 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8b04482f-a5de-46e6-8444-9c020266c3a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:32.943525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8b04482f-a5de-46e6-8444-9c020266c3a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:32.944715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8b04482f-a5de-46e6-8444-9c020266c3a9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.104499 Jul 27 23:10:32.945497 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1060/2296] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:32 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:33.002266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a745ffe4-15be-4d2b-9061-8be52a5546d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:33.010842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a745ffe4-15be-4d2b-9061-8be52a5546d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.166974 Jul 27 23:10:33.011401 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1237/2297] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:32 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:33.860677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a99ca2ca-33f0-42ce-a028-66fa6a4b8c38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:33.861321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a99ca2ca-33f0-42ce-a028-66fa6a4b8c38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:33.863171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ffdedae6-d65a-4c31-a991-c056c0da5190 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:33.863785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ffdedae6-d65a-4c31-a991-c056c0da5190 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:33.867949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a99ca2ca-33f0-42ce-a028-66fa6a4b8c38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:33.868402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a99ca2ca-33f0-42ce-a028-66fa6a4b8c38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:33.869202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a99ca2ca-33f0-42ce-a028-66fa6a4b8c38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:33.869643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a99ca2ca-33f0-42ce-a028-66fa6a4b8c38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:33.870117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffdedae6-d65a-4c31-a991-c056c0da5190 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:33.870560 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffdedae6-d65a-4c31-a991-c056c0da5190 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:33.871377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffdedae6-d65a-4c31-a991-c056c0da5190 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:33.871816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffdedae6-d65a-4c31-a991-c056c0da5190 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:34.058528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a99ca2ca-33f0-42ce-a028-66fa6a4b8c38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:34.065320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ffdedae6-d65a-4c31-a991-c056c0da5190 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:34.066459 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a99ca2ca-33f0-42ce-a028-66fa6a4b8c38 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.210050 Jul 27 23:10:34.067037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1061/2298] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:33 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:34.071567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b754af1d-8d84-4de6-addc-25f154120e2c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:34.072176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b754af1d-8d84-4de6-addc-25f154120e2c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:34.073756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ffdedae6-d65a-4c31-a991-c056c0da5190 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214325 Jul 27 23:10:34.080441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1238/2299] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:33 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:34.080625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b754af1d-8d84-4de6-addc-25f154120e2c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:34.080625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b754af1d-8d84-4de6-addc-25f154120e2c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:34.080625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b754af1d-8d84-4de6-addc-25f154120e2c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:34.080625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b754af1d-8d84-4de6-addc-25f154120e2c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:34.083743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8588627f-117b-4e25-871b-49db69779cae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:34.084464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8588627f-117b-4e25-871b-49db69779cae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:34.091086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8588627f-117b-4e25-871b-49db69779cae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:34.091533 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8588627f-117b-4e25-871b-49db69779cae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:34.092297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8588627f-117b-4e25-871b-49db69779cae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:34.092758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8588627f-117b-4e25-871b-49db69779cae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:34.095404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:34.151889 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b754af1d-8d84-4de6-addc-25f154120e2c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:34.160623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b754af1d-8d84-4de6-addc-25f154120e2c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:34.162139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b754af1d-8d84-4de6-addc-25f154120e2c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:34.163320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b754af1d-8d84-4de6-addc-25f154120e2c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.095373 Jul 27 23:10:34.163877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1062/2300] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:34 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:34.234258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8588627f-117b-4e25-871b-49db69779cae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:34.242118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8588627f-117b-4e25-871b-49db69779cae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.166896 Jul 27 23:10:34.242671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1239/2301] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:34 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:35.087988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2403ba72-3511-4f6c-b303-292c6e8279e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:35.089152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2403ba72-3511-4f6c-b303-292c6e8279e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:35.094701 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-54994128-4d0a-4284-93ed-8efd0d96cf6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:35.095337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-54994128-4d0a-4284-93ed-8efd0d96cf6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:35.095606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2403ba72-3511-4f6c-b303-292c6e8279e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:35.096050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2403ba72-3511-4f6c-b303-292c6e8279e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:35.096843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2403ba72-3511-4f6c-b303-292c6e8279e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:35.097274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2403ba72-3511-4f6c-b303-292c6e8279e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:35.101743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-54994128-4d0a-4284-93ed-8efd0d96cf6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:35.102187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-54994128-4d0a-4284-93ed-8efd0d96cf6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:35.102935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-54994128-4d0a-4284-93ed-8efd0d96cf6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:35.103365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-54994128-4d0a-4284-93ed-8efd0d96cf6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:35.294240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2403ba72-3511-4f6c-b303-292c6e8279e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:35.298213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-54994128-4d0a-4284-93ed-8efd0d96cf6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:35.302253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2403ba72-3511-4f6c-b303-292c6e8279e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.218114 Jul 27 23:10:35.302817 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1063/2302] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:35 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:35.306273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-54994128-4d0a-4284-93ed-8efd0d96cf6d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215345 Jul 27 23:10:35.316708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1240/2303] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:35 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:35.316909 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ac48d2b9-4443-4485-977f-c80b3565a6e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:35.316909 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ac48d2b9-4443-4485-977f-c80b3565a6e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:35.317108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b36c2456-e71a-4d24-8c6f-9b4232181cc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:35.317108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b36c2456-e71a-4d24-8c6f-9b4232181cc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:35.317278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac48d2b9-4443-4485-977f-c80b3565a6e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:35.317278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac48d2b9-4443-4485-977f-c80b3565a6e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:35.317278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac48d2b9-4443-4485-977f-c80b3565a6e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:35.317278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac48d2b9-4443-4485-977f-c80b3565a6e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:35.318049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b36c2456-e71a-4d24-8c6f-9b4232181cc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:35.318495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b36c2456-e71a-4d24-8c6f-9b4232181cc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:35.319257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b36c2456-e71a-4d24-8c6f-9b4232181cc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:35.319687 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b36c2456-e71a-4d24-8c6f-9b4232181cc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:35.382819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ac48d2b9-4443-4485-977f-c80b3565a6e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:35.391309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ac48d2b9-4443-4485-977f-c80b3565a6e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:35.392839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ac48d2b9-4443-4485-977f-c80b3565a6e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:35.393991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ac48d2b9-4443-4485-977f-c80b3565a6e7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.090271 Jul 27 23:10:35.394550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1064/2304] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:35.467463 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b36c2456-e71a-4d24-8c6f-9b4232181cc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:35.475286 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b36c2456-e71a-4d24-8c6f-9b4232181cc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.167561 Jul 27 23:10:35.475848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1241/2305] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:35 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:36.324411 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b62201c2-7aa2-45e0-9ed5-fc6b8f5e8a32 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:36.325056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b62201c2-7aa2-45e0-9ed5-fc6b8f5e8a32 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:36.329176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ef231f8d-f94d-4cb0-b5ef-ffb110c86ff2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:36.329789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ef231f8d-f94d-4cb0-b5ef-ffb110c86ff2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:36.331516 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b62201c2-7aa2-45e0-9ed5-fc6b8f5e8a32 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:36.331960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b62201c2-7aa2-45e0-9ed5-fc6b8f5e8a32 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:36.332750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b62201c2-7aa2-45e0-9ed5-fc6b8f5e8a32 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:36.333190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b62201c2-7aa2-45e0-9ed5-fc6b8f5e8a32 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:36.336116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef231f8d-f94d-4cb0-b5ef-ffb110c86ff2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:36.336582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef231f8d-f94d-4cb0-b5ef-ffb110c86ff2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:36.337420 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef231f8d-f94d-4cb0-b5ef-ffb110c86ff2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:36.337852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ef231f8d-f94d-4cb0-b5ef-ffb110c86ff2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:36.526857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b62201c2-7aa2-45e0-9ed5-fc6b8f5e8a32 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:36.530005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ef231f8d-f94d-4cb0-b5ef-ffb110c86ff2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:36.535161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b62201c2-7aa2-45e0-9ed5-fc6b8f5e8a32 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.215258 Jul 27 23:10:36.535733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1065/2306] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:36 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:36.537837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ef231f8d-f94d-4cb0-b5ef-ffb110c86ff2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.212563 Jul 27 23:10:36.538553 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1242/2307] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:36 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:36.540601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4c4a44f4-d710-4eb5-989f-a61e1a7314bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:36.541209 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4c4a44f4-d710-4eb5-989f-a61e1a7314bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:36.543318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dd01b041-18b9-4dd2-9fb6-d0d116c4ec86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:36.543926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dd01b041-18b9-4dd2-9fb6-d0d116c4ec86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:36.547144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4c4a44f4-d710-4eb5-989f-a61e1a7314bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:36.547589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4c4a44f4-d710-4eb5-989f-a61e1a7314bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:36.548594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4c4a44f4-d710-4eb5-989f-a61e1a7314bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:36.549100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4c4a44f4-d710-4eb5-989f-a61e1a7314bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:36.549631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd01b041-18b9-4dd2-9fb6-d0d116c4ec86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:36.550082 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd01b041-18b9-4dd2-9fb6-d0d116c4ec86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:36.550846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd01b041-18b9-4dd2-9fb6-d0d116c4ec86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:36.551374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd01b041-18b9-4dd2-9fb6-d0d116c4ec86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:36.619213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4c4a44f4-d710-4eb5-989f-a61e1a7314bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:36.628053 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4c4a44f4-d710-4eb5-989f-a61e1a7314bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:36.629576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4c4a44f4-d710-4eb5-989f-a61e1a7314bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:36.630709 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4c4a44f4-d710-4eb5-989f-a61e1a7314bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.094070 Jul 27 23:10:36.631267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1066/2308] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:36.700396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dd01b041-18b9-4dd2-9fb6-d0d116c4ec86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:36.708600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dd01b041-18b9-4dd2-9fb6-d0d116c4ec86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.168685 Jul 27 23:10:36.709161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1243/2309] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:36 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:37.566156 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5e089c14-d814-4116-bebd-445630621b5e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:37.566764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5e089c14-d814-4116-bebd-445630621b5e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:37.570137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b1074b9c-1309-435b-b3b0-093f4f46c77d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:37.570744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b1074b9c-1309-435b-b3b0-093f4f46c77d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:37.573243 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e089c14-d814-4116-bebd-445630621b5e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:37.573693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e089c14-d814-4116-bebd-445630621b5e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:37.574447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e089c14-d814-4116-bebd-445630621b5e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:37.574876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5e089c14-d814-4116-bebd-445630621b5e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:37.577124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1074b9c-1309-435b-b3b0-093f4f46c77d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:37.577571 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1074b9c-1309-435b-b3b0-093f4f46c77d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:37.578317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1074b9c-1309-435b-b3b0-093f4f46c77d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:37.578745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1074b9c-1309-435b-b3b0-093f4f46c77d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:37.767982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5e089c14-d814-4116-bebd-445630621b5e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:37.774815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b1074b9c-1309-435b-b3b0-093f4f46c77d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:37.776640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5e089c14-d814-4116-bebd-445630621b5e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.213617 Jul 27 23:10:37.777214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1067/2310] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:37 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:37.781679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a80afe77-d1bd-4ea6-a33e-8b24e0b9e10b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:37.782292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a80afe77-d1bd-4ea6-a33e-8b24e0b9e10b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:37.787104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b1074b9c-1309-435b-b3b0-093f4f46c77d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.220533 Jul 27 23:10:37.790326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1244/2311] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:37 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:37.790480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a80afe77-d1bd-4ea6-a33e-8b24e0b9e10b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:37.790480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a80afe77-d1bd-4ea6-a33e-8b24e0b9e10b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:37.790480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a80afe77-d1bd-4ea6-a33e-8b24e0b9e10b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:37.790480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a80afe77-d1bd-4ea6-a33e-8b24e0b9e10b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:37.792119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-98d70b52-bc8d-43b0-9f00-998433480879 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:37.792773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-98d70b52-bc8d-43b0-9f00-998433480879 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:37.798357 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98d70b52-bc8d-43b0-9f00-998433480879 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:37.798797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98d70b52-bc8d-43b0-9f00-998433480879 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:37.799540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98d70b52-bc8d-43b0-9f00-998433480879 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:37.799966 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98d70b52-bc8d-43b0-9f00-998433480879 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:37.876201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a80afe77-d1bd-4ea6-a33e-8b24e0b9e10b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:37.884733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a80afe77-d1bd-4ea6-a33e-8b24e0b9e10b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:37.886792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a80afe77-d1bd-4ea6-a33e-8b24e0b9e10b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:37.887939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a80afe77-d1bd-4ea6-a33e-8b24e0b9e10b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.109809 Jul 27 23:10:37.888530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1068/2312] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:37.942247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-98d70b52-bc8d-43b0-9f00-998433480879 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:37.950869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-98d70b52-bc8d-43b0-9f00-998433480879 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.162269 Jul 27 23:10:37.951430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1245/2313] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:37 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:38.798030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6c66a738-103d-4dea-ae5c-12f633af3c30 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:38.798638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6c66a738-103d-4dea-ae5c-12f633af3c30 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:38.805390 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c66a738-103d-4dea-ae5c-12f633af3c30 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:38.805832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c66a738-103d-4dea-ae5c-12f633af3c30 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:38.806590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c66a738-103d-4dea-ae5c-12f633af3c30 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:38.807528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c66a738-103d-4dea-ae5c-12f633af3c30 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:38.808481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-00460755-9f60-4b62-a97c-63d85f22a325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:38.809123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-00460755-9f60-4b62-a97c-63d85f22a325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:38.815622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-00460755-9f60-4b62-a97c-63d85f22a325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:38.816071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-00460755-9f60-4b62-a97c-63d85f22a325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:38.816865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-00460755-9f60-4b62-a97c-63d85f22a325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:38.817305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-00460755-9f60-4b62-a97c-63d85f22a325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:39.000250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6c66a738-103d-4dea-ae5c-12f633af3c30 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:39.003692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-00460755-9f60-4b62-a97c-63d85f22a325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:39.008635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6c66a738-103d-4dea-ae5c-12f633af3c30 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214468 Jul 27 23:10:39.009394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1069/2314] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:38 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:39.012527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-00460755-9f60-4b62-a97c-63d85f22a325 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.207951 Jul 27 23:10:39.013335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1246/2315] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:38 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:39.014388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cba3e025-9d10-4de3-88ae-3ba9ee05984f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:39.015000 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cba3e025-9d10-4de3-88ae-3ba9ee05984f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:39.017611 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-63958496-3eb8-40b3-bc96-03d47322e8d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:39.018249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-63958496-3eb8-40b3-bc96-03d47322e8d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:39.021212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cba3e025-9d10-4de3-88ae-3ba9ee05984f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:39.021729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cba3e025-9d10-4de3-88ae-3ba9ee05984f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:39.022578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cba3e025-9d10-4de3-88ae-3ba9ee05984f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:39.023061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cba3e025-9d10-4de3-88ae-3ba9ee05984f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:39.024128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-63958496-3eb8-40b3-bc96-03d47322e8d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:39.024584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-63958496-3eb8-40b3-bc96-03d47322e8d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:39.025335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-63958496-3eb8-40b3-bc96-03d47322e8d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:39.025772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-63958496-3eb8-40b3-bc96-03d47322e8d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:39.110810 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cba3e025-9d10-4de3-88ae-3ba9ee05984f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:39.119727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cba3e025-9d10-4de3-88ae-3ba9ee05984f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:39.121276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cba3e025-9d10-4de3-88ae-3ba9ee05984f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:39.122401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cba3e025-9d10-4de3-88ae-3ba9ee05984f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.112298 Jul 27 23:10:39.122961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1070/2316] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:39 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:39.175671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-63958496-3eb8-40b3-bc96-03d47322e8d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:39.184101 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-63958496-3eb8-40b3-bc96-03d47322e8d6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.169912 Jul 27 23:10:39.184737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1247/2317] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:39 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:40.039072 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-281eb8e6-7fab-4077-ba9a-237cf6aebb86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:40.039720 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-281eb8e6-7fab-4077-ba9a-237cf6aebb86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:40.039888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fb64d0a3-1780-4a15-9e8b-98dcfb9aa3ab tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:40.040494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fb64d0a3-1780-4a15-9e8b-98dcfb9aa3ab tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:40.046153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-281eb8e6-7fab-4077-ba9a-237cf6aebb86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:40.046599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-281eb8e6-7fab-4077-ba9a-237cf6aebb86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:40.046783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb64d0a3-1780-4a15-9e8b-98dcfb9aa3ab tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:40.047222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb64d0a3-1780-4a15-9e8b-98dcfb9aa3ab tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:40.047361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-281eb8e6-7fab-4077-ba9a-237cf6aebb86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:40.047797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-281eb8e6-7fab-4077-ba9a-237cf6aebb86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:40.047966 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb64d0a3-1780-4a15-9e8b-98dcfb9aa3ab tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:40.048394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb64d0a3-1780-4a15-9e8b-98dcfb9aa3ab tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:40.246860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-281eb8e6-7fab-4077-ba9a-237cf6aebb86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:40.249690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fb64d0a3-1780-4a15-9e8b-98dcfb9aa3ab tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:40.254748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-281eb8e6-7fab-4077-ba9a-237cf6aebb86 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.219533 Jul 27 23:10:40.255310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1071/2318] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:40 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:40.259647 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cd99399b-5510-44a7-be0a-e752aed2b28d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:40.260933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cd99399b-5510-44a7-be0a-e752aed2b28d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:40.263347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fb64d0a3-1780-4a15-9e8b-98dcfb9aa3ab tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.227307 Jul 27 23:10:40.263952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1248/2319] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:40 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:40.266782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd99399b-5510-44a7-be0a-e752aed2b28d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:40.267410 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd99399b-5510-44a7-be0a-e752aed2b28d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:40.268327 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd99399b-5510-44a7-be0a-e752aed2b28d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:40.268705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-70f0ac17-c74c-430e-b476-febc7d5b3cc8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:40.269100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd99399b-5510-44a7-be0a-e752aed2b28d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:40.269503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-70f0ac17-c74c-430e-b476-febc7d5b3cc8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:40.275361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70f0ac17-c74c-430e-b476-febc7d5b3cc8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:40.276492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70f0ac17-c74c-430e-b476-febc7d5b3cc8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:40.277368 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70f0ac17-c74c-430e-b476-febc7d5b3cc8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:40.277901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70f0ac17-c74c-430e-b476-febc7d5b3cc8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:40.354323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cd99399b-5510-44a7-be0a-e752aed2b28d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:40.362962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cd99399b-5510-44a7-be0a-e752aed2b28d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:40.364456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cd99399b-5510-44a7-be0a-e752aed2b28d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:40.365657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cd99399b-5510-44a7-be0a-e752aed2b28d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.109452 Jul 27 23:10:40.366216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1072/2320] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:40.419884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-70f0ac17-c74c-430e-b476-febc7d5b3cc8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:40.427834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-70f0ac17-c74c-430e-b476-febc7d5b3cc8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.162881 Jul 27 23:10:40.428394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1249/2321] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:40 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:41.277036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3914a157-df44-476d-8ad3-cd55cf276ece tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:41.277640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3914a157-df44-476d-8ad3-cd55cf276ece tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:41.284108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3914a157-df44-476d-8ad3-cd55cf276ece tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:41.284573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3914a157-df44-476d-8ad3-cd55cf276ece tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:41.285215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fec7cada-d670-459c-b4f8-f2a9b3c92561 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:41.285635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3914a157-df44-476d-8ad3-cd55cf276ece tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:41.285748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3914a157-df44-476d-8ad3-cd55cf276ece tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:41.285844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fec7cada-d670-459c-b4f8-f2a9b3c92561 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:41.292776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fec7cada-d670-459c-b4f8-f2a9b3c92561 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:41.293226 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fec7cada-d670-459c-b4f8-f2a9b3c92561 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:41.293982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fec7cada-d670-459c-b4f8-f2a9b3c92561 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:41.294415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fec7cada-d670-459c-b4f8-f2a9b3c92561 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:41.478402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3914a157-df44-476d-8ad3-cd55cf276ece tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:41.482937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fec7cada-d670-459c-b4f8-f2a9b3c92561 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:41.487871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3914a157-df44-476d-8ad3-cd55cf276ece tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.214758 Jul 27 23:10:41.491222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fec7cada-d670-459c-b4f8-f2a9b3c92561 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.209756 Jul 27 23:10:41.491779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1250/2322] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:41 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:41.495706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1073/2323] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:41 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:41.497705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6ff8346e-74ab-4cfd-a2e2-8df5d86301ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:41.498554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6ff8346e-74ab-4cfd-a2e2-8df5d86301ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:41.502083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0aad2cc6-072b-4f2d-b1b8-8838fd5454e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:41.502695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0aad2cc6-072b-4f2d-b1b8-8838fd5454e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:41.505794 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6ff8346e-74ab-4cfd-a2e2-8df5d86301ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:41.506430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6ff8346e-74ab-4cfd-a2e2-8df5d86301ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:41.507206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6ff8346e-74ab-4cfd-a2e2-8df5d86301ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:41.507639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6ff8346e-74ab-4cfd-a2e2-8df5d86301ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:41.510908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0aad2cc6-072b-4f2d-b1b8-8838fd5454e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:41.511361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0aad2cc6-072b-4f2d-b1b8-8838fd5454e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:41.512912 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0aad2cc6-072b-4f2d-b1b8-8838fd5454e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:41.513414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0aad2cc6-072b-4f2d-b1b8-8838fd5454e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:41.593485 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6ff8346e-74ab-4cfd-a2e2-8df5d86301ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:41.601943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6ff8346e-74ab-4cfd-a2e2-8df5d86301ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:41.603448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6ff8346e-74ab-4cfd-a2e2-8df5d86301ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:41.605127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6ff8346e-74ab-4cfd-a2e2-8df5d86301ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.112264 Jul 27 23:10:41.605681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1251/2324] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:41.657700 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0aad2cc6-072b-4f2d-b1b8-8838fd5454e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:41.665549 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0aad2cc6-072b-4f2d-b1b8-8838fd5454e2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.168713 Jul 27 23:10:41.666111 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1074/2325] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:41 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:42.511448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0ca03def-46b5-40a9-a0eb-a1342084f637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:42.511977 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0ca03def-46b5-40a9-a0eb-a1342084f637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:42.513830 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-044b08e6-8eeb-440a-a0d1-b47be562757b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:42.514446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-044b08e6-8eeb-440a-a0d1-b47be562757b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:42.518262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0ca03def-46b5-40a9-a0eb-a1342084f637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:42.518711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0ca03def-46b5-40a9-a0eb-a1342084f637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:42.519478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0ca03def-46b5-40a9-a0eb-a1342084f637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:42.519909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0ca03def-46b5-40a9-a0eb-a1342084f637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:42.520674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-044b08e6-8eeb-440a-a0d1-b47be562757b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:42.521120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-044b08e6-8eeb-440a-a0d1-b47be562757b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:42.521882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-044b08e6-8eeb-440a-a0d1-b47be562757b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:42.522319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-044b08e6-8eeb-440a-a0d1-b47be562757b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:42.535174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:42.715125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0ca03def-46b5-40a9-a0eb-a1342084f637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:42.718407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-044b08e6-8eeb-440a-a0d1-b47be562757b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:42.723390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0ca03def-46b5-40a9-a0eb-a1342084f637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.216362 Jul 27 23:10:42.724040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1252/2326] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:42 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:42.726395 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-044b08e6-8eeb-440a-a0d1-b47be562757b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216894 Jul 27 23:10:42.727303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1075/2327] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:42 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:42.728874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1df8df16-44c5-4dad-b402-523b89a3ba73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:42.729667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1df8df16-44c5-4dad-b402-523b89a3ba73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:42.735725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1df8df16-44c5-4dad-b402-523b89a3ba73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:42.736253 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1df8df16-44c5-4dad-b402-523b89a3ba73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:42.737105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1df8df16-44c5-4dad-b402-523b89a3ba73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:42.737604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1df8df16-44c5-4dad-b402-523b89a3ba73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:42.741377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6cd067b5-3ba4-49d8-8ed1-1502fd176c41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:42.741995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6cd067b5-3ba4-49d8-8ed1-1502fd176c41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:42.748317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6cd067b5-3ba4-49d8-8ed1-1502fd176c41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:42.748799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6cd067b5-3ba4-49d8-8ed1-1502fd176c41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:42.749570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6cd067b5-3ba4-49d8-8ed1-1502fd176c41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:42.750003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6cd067b5-3ba4-49d8-8ed1-1502fd176c41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:42.810036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1df8df16-44c5-4dad-b402-523b89a3ba73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:42.818418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1df8df16-44c5-4dad-b402-523b89a3ba73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:42.819908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1df8df16-44c5-4dad-b402-523b89a3ba73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:42.821064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1df8df16-44c5-4dad-b402-523b89a3ba73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.096025 Jul 27 23:10:42.821620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1253/2328] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:42.891141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6cd067b5-3ba4-49d8-8ed1-1502fd176c41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:42.899090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6cd067b5-3ba4-49d8-8ed1-1502fd176c41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.161330 Jul 27 23:10:42.899654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1076/2329] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:42 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:43.745013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-18595158-deff-4fef-b543-fdbe6d492b4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:43.745628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-18595158-deff-4fef-b543-fdbe6d492b4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:43.749909 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-58a43688-3c33-452c-bf3a-e232ab5f885e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:43.750514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-58a43688-3c33-452c-bf3a-e232ab5f885e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:43.752223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18595158-deff-4fef-b543-fdbe6d492b4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:43.752693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18595158-deff-4fef-b543-fdbe6d492b4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:43.753452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18595158-deff-4fef-b543-fdbe6d492b4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:43.753880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18595158-deff-4fef-b543-fdbe6d492b4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:43.756801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58a43688-3c33-452c-bf3a-e232ab5f885e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:43.757245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58a43688-3c33-452c-bf3a-e232ab5f885e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:43.758007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58a43688-3c33-452c-bf3a-e232ab5f885e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:43.758432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58a43688-3c33-452c-bf3a-e232ab5f885e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:43.945649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-18595158-deff-4fef-b543-fdbe6d492b4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:43.954111 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-58a43688-3c33-452c-bf3a-e232ab5f885e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:43.954474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-18595158-deff-4fef-b543-fdbe6d492b4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.213222 Jul 27 23:10:43.955064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1254/2330] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:43 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:43.959530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c0f48ac7-f7f5-46ad-ae1b-316f7049c75b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:43.960137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c0f48ac7-f7f5-46ad-ae1b-316f7049c75b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:43.962796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-58a43688-3c33-452c-bf3a-e232ab5f885e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216609 Jul 27 23:10:43.964113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1077/2331] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:43 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:43.966858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c0f48ac7-f7f5-46ad-ae1b-316f7049c75b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:43.967307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c0f48ac7-f7f5-46ad-ae1b-316f7049c75b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:43.968063 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c0f48ac7-f7f5-46ad-ae1b-316f7049c75b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:43.968495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c0f48ac7-f7f5-46ad-ae1b-316f7049c75b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:43.968916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fc7d9815-7251-469f-b0c7-4cec25de8af4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:43.969589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fc7d9815-7251-469f-b0c7-4cec25de8af4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:43.975318 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc7d9815-7251-469f-b0c7-4cec25de8af4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:43.975857 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc7d9815-7251-469f-b0c7-4cec25de8af4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:43.976727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc7d9815-7251-469f-b0c7-4cec25de8af4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:43.977236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc7d9815-7251-469f-b0c7-4cec25de8af4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:44.050500 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c0f48ac7-f7f5-46ad-ae1b-316f7049c75b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:44.059523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c0f48ac7-f7f5-46ad-ae1b-316f7049c75b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:44.061039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c0f48ac7-f7f5-46ad-ae1b-316f7049c75b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:44.062165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c0f48ac7-f7f5-46ad-ae1b-316f7049c75b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.106163 Jul 27 23:10:44.062745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1255/2332] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:44.123159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fc7d9815-7251-469f-b0c7-4cec25de8af4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:44.131119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fc7d9815-7251-469f-b0c7-4cec25de8af4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.165905 Jul 27 23:10:44.131678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1078/2333] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:43 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:44.989018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7a02f81b-27f8-46cc-a000-69699d9c4353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:44.989570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3fca899a-02e0-4dcc-a9e2-97cf4e62d3c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:44.989963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7a02f81b-27f8-46cc-a000-69699d9c4353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:44.990076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3fca899a-02e0-4dcc-a9e2-97cf4e62d3c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:44.996626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a02f81b-27f8-46cc-a000-69699d9c4353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:44.996801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3fca899a-02e0-4dcc-a9e2-97cf4e62d3c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:44.997068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a02f81b-27f8-46cc-a000-69699d9c4353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:44.997190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3fca899a-02e0-4dcc-a9e2-97cf4e62d3c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:44.997875 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3fca899a-02e0-4dcc-a9e2-97cf4e62d3c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:44.998242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a02f81b-27f8-46cc-a000-69699d9c4353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:44.998357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3fca899a-02e0-4dcc-a9e2-97cf4e62d3c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:44.998674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a02f81b-27f8-46cc-a000-69699d9c4353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:45.000928 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:45.388561 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7a02f81b-27f8-46cc-a000-69699d9c4353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:45.391880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3fca899a-02e0-4dcc-a9e2-97cf4e62d3c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:45.396608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7a02f81b-27f8-46cc-a000-69699d9c4353 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.411331 Jul 27 23:10:45.397512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1256/2334] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:44 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:45.399628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3fca899a-02e0-4dcc-a9e2-97cf4e62d3c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.414382 Jul 27 23:10:45.400332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1079/2335] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:44 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:45.402228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bb4c9168-8de3-4ede-91df-d246d6379af9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:45.402834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bb4c9168-8de3-4ede-91df-d246d6379af9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:45.405330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0bf38e92-0f5d-4cb4-94c1-f41cee2e9f04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:45.405934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0bf38e92-0f5d-4cb4-94c1-f41cee2e9f04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:45.408773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb4c9168-8de3-4ede-91df-d246d6379af9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:45.409222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb4c9168-8de3-4ede-91df-d246d6379af9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:45.409986 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb4c9168-8de3-4ede-91df-d246d6379af9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:45.410421 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb4c9168-8de3-4ede-91df-d246d6379af9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:45.411867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bf38e92-0f5d-4cb4-94c1-f41cee2e9f04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:45.412372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bf38e92-0f5d-4cb4-94c1-f41cee2e9f04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:45.413219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bf38e92-0f5d-4cb4-94c1-f41cee2e9f04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:45.413715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bf38e92-0f5d-4cb4-94c1-f41cee2e9f04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:45.478782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bb4c9168-8de3-4ede-91df-d246d6379af9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:45.487452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bb4c9168-8de3-4ede-91df-d246d6379af9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:45.488998 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bb4c9168-8de3-4ede-91df-d246d6379af9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:45.490142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bb4c9168-8de3-4ede-91df-d246d6379af9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.091944 Jul 27 23:10:45.490914 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1257/2336] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:45 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:45.559266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0bf38e92-0f5d-4cb4-94c1-f41cee2e9f04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:45.567454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0bf38e92-0f5d-4cb4-94c1-f41cee2e9f04 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.165701 Jul 27 23:10:45.568013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1080/2337] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:45 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:46.427013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4eb75aff-ceaa-4caa-ac58-12d5535a1356 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:46.427580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4eb75aff-ceaa-4caa-ac58-12d5535a1356 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:46.430825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0e3a7251-4a92-4683-bf6f-ac44dc44e836 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:46.431434 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0e3a7251-4a92-4683-bf6f-ac44dc44e836 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:46.434793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4eb75aff-ceaa-4caa-ac58-12d5535a1356 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:46.435248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4eb75aff-ceaa-4caa-ac58-12d5535a1356 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:46.436011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4eb75aff-ceaa-4caa-ac58-12d5535a1356 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:46.436473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4eb75aff-ceaa-4caa-ac58-12d5535a1356 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:46.438572 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e3a7251-4a92-4683-bf6f-ac44dc44e836 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:46.439138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e3a7251-4a92-4683-bf6f-ac44dc44e836 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:46.439937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e3a7251-4a92-4683-bf6f-ac44dc44e836 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:46.440377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e3a7251-4a92-4683-bf6f-ac44dc44e836 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:46.630256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4eb75aff-ceaa-4caa-ac58-12d5535a1356 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:46.633476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0e3a7251-4a92-4683-bf6f-ac44dc44e836 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:46.638397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4eb75aff-ceaa-4caa-ac58-12d5535a1356 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.215345 Jul 27 23:10:46.639159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1258/2338] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:46 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:46.641376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0e3a7251-4a92-4683-bf6f-ac44dc44e836 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214316 Jul 27 23:10:46.642055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1081/2339] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:46 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:46.646345 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-33afa4b2-f5d7-4ca4-8ea7-c2fca29a1e9e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:46.646938 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-33afa4b2-f5d7-4ca4-8ea7-c2fca29a1e9e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:46.653352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-33afa4b2-f5d7-4ca4-8ea7-c2fca29a1e9e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:46.653791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-33afa4b2-f5d7-4ca4-8ea7-c2fca29a1e9e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:46.654252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0d2c0b10-8c3e-4ea7-823c-4960012c62ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:46.654532 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-33afa4b2-f5d7-4ca4-8ea7-c2fca29a1e9e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:46.654877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0d2c0b10-8c3e-4ea7-823c-4960012c62ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:46.655035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-33afa4b2-f5d7-4ca4-8ea7-c2fca29a1e9e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:46.663246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d2c0b10-8c3e-4ea7-823c-4960012c62ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:46.663693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d2c0b10-8c3e-4ea7-823c-4960012c62ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:46.664446 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d2c0b10-8c3e-4ea7-823c-4960012c62ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:46.664903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d2c0b10-8c3e-4ea7-823c-4960012c62ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:46.746349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0d2c0b10-8c3e-4ea7-823c-4960012c62ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:46.754632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0d2c0b10-8c3e-4ea7-823c-4960012c62ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:46.756124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0d2c0b10-8c3e-4ea7-823c-4960012c62ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:46.757282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0d2c0b10-8c3e-4ea7-823c-4960012c62ef tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.117421 Jul 27 23:10:46.758017 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1259/2340] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:46.808295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-33afa4b2-f5d7-4ca4-8ea7-c2fca29a1e9e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:46.816186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-33afa4b2-f5d7-4ca4-8ea7-c2fca29a1e9e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.173300 Jul 27 23:10:46.816782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1082/2341] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:46 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:47.660019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-abed0349-8281-4cd2-ac4b-ec9235f92f64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:47.660646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-abed0349-8281-4cd2-ac4b-ec9235f92f64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:47.667460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5056e557-7c90-40b8-a365-f2c826c3e913 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:47.667951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-abed0349-8281-4cd2-ac4b-ec9235f92f64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:47.668070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5056e557-7c90-40b8-a365-f2c826c3e913 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:47.668313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-abed0349-8281-4cd2-ac4b-ec9235f92f64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:47.669091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-abed0349-8281-4cd2-ac4b-ec9235f92f64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:47.669523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-abed0349-8281-4cd2-ac4b-ec9235f92f64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:47.670370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:47.675646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5056e557-7c90-40b8-a365-f2c826c3e913 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:47.676089 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5056e557-7c90-40b8-a365-f2c826c3e913 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:47.676878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5056e557-7c90-40b8-a365-f2c826c3e913 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:47.677312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5056e557-7c90-40b8-a365-f2c826c3e913 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:47.862781 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-abed0349-8281-4cd2-ac4b-ec9235f92f64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:47.866825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5056e557-7c90-40b8-a365-f2c826c3e913 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:47.872229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-abed0349-8281-4cd2-ac4b-ec9235f92f64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.215961 Jul 27 23:10:47.872835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1260/2342] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:47 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:47.874782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5056e557-7c90-40b8-a365-f2c826c3e913 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.211615 Jul 27 23:10:47.888244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1083/2343] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:47 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:47.888444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b71c827f-0d90-4a4f-a867-ac696c519cbd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:47.888444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b71c827f-0d90-4a4f-a867-ac696c519cbd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:47.888690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0632ff49-3a3f-4ee3-85be-8b9697e6b48f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:47.888690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0632ff49-3a3f-4ee3-85be-8b9697e6b48f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:47.888880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b71c827f-0d90-4a4f-a867-ac696c519cbd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:47.888880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b71c827f-0d90-4a4f-a867-ac696c519cbd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:47.888880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b71c827f-0d90-4a4f-a867-ac696c519cbd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:47.888880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b71c827f-0d90-4a4f-a867-ac696c519cbd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:47.889207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0632ff49-3a3f-4ee3-85be-8b9697e6b48f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:47.889207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0632ff49-3a3f-4ee3-85be-8b9697e6b48f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:47.889207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0632ff49-3a3f-4ee3-85be-8b9697e6b48f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:47.889207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0632ff49-3a3f-4ee3-85be-8b9697e6b48f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:47.968243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b71c827f-0d90-4a4f-a867-ac696c519cbd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:47.976835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b71c827f-0d90-4a4f-a867-ac696c519cbd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:47.978514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b71c827f-0d90-4a4f-a867-ac696c519cbd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:47.980293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b71c827f-0d90-4a4f-a867-ac696c519cbd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.106538 Jul 27 23:10:47.980881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1261/2344] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:48.035571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0632ff49-3a3f-4ee3-85be-8b9697e6b48f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:48.044144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0632ff49-3a3f-4ee3-85be-8b9697e6b48f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.167868 Jul 27 23:10:48.044724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1084/2345] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:47 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:48.893569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ba60dcf7-edc4-4efa-9d4f-c2249a93f964 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:48.894127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ba60dcf7-edc4-4efa-9d4f-c2249a93f964 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:48.895346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0b701059-07e6-4270-ae30-545dc0a2f9f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:48.895961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0b701059-07e6-4270-ae30-545dc0a2f9f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:48.896377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=96 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:48.902052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba60dcf7-edc4-4efa-9d4f-c2249a93f964 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:48.902472 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b701059-07e6-4270-ae30-545dc0a2f9f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:48.902602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba60dcf7-edc4-4efa-9d4f-c2249a93f964 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:48.902921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b701059-07e6-4270-ae30-545dc0a2f9f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:48.903249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba60dcf7-edc4-4efa-9d4f-c2249a93f964 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:48.903668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba60dcf7-edc4-4efa-9d4f-c2249a93f964 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:48.903794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b701059-07e6-4270-ae30-545dc0a2f9f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:48.904100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b701059-07e6-4270-ae30-545dc0a2f9f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:49.095995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0b701059-07e6-4270-ae30-545dc0a2f9f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:49.098909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ba60dcf7-edc4-4efa-9d4f-c2249a93f964 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:49.104573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0b701059-07e6-4270-ae30-545dc0a2f9f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.212475 Jul 27 23:10:49.105152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1085/2346] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:48 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:49.107405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ba60dcf7-edc4-4efa-9d4f-c2249a93f964 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217788 Jul 27 23:10:49.116723 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1262/2347] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:48 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:49.116907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-874201e9-68c6-41a4-8140-424c076f0afd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:49.116907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-874201e9-68c6-41a4-8140-424c076f0afd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:49.117084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-72bd6b03-f356-4d41-bfaa-e3942a22017d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:49.117084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-72bd6b03-f356-4d41-bfaa-e3942a22017d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:49.117237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-874201e9-68c6-41a4-8140-424c076f0afd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:49.117237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-874201e9-68c6-41a4-8140-424c076f0afd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:49.117572 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-874201e9-68c6-41a4-8140-424c076f0afd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:49.117980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-874201e9-68c6-41a4-8140-424c076f0afd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:49.120863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72bd6b03-f356-4d41-bfaa-e3942a22017d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:49.120863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72bd6b03-f356-4d41-bfaa-e3942a22017d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:49.120863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72bd6b03-f356-4d41-bfaa-e3942a22017d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:49.121194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72bd6b03-f356-4d41-bfaa-e3942a22017d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:49.189743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-874201e9-68c6-41a4-8140-424c076f0afd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:49.198529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-874201e9-68c6-41a4-8140-424c076f0afd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:49.200034 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-874201e9-68c6-41a4-8140-424c076f0afd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:49.201202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-874201e9-68c6-41a4-8140-424c076f0afd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.095150 Jul 27 23:10:49.201969 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1086/2348] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:49 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:49.270051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-72bd6b03-f356-4d41-bfaa-e3942a22017d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:49.278415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-72bd6b03-f356-4d41-bfaa-e3942a22017d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.169262 Jul 27 23:10:49.279088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1263/2349] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:49 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:50.127786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d47e55ca-4d72-4efc-8652-8665a60ba824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:50.128404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d47e55ca-4d72-4efc-8652-8665a60ba824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:50.129828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6f1e9a89-178a-4b1e-83d1-0b08bd593206 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:50.130472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6f1e9a89-178a-4b1e-83d1-0b08bd593206 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:50.135954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d47e55ca-4d72-4efc-8652-8665a60ba824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:50.136381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d47e55ca-4d72-4efc-8652-8665a60ba824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:50.137134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d47e55ca-4d72-4efc-8652-8665a60ba824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:50.137627 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d47e55ca-4d72-4efc-8652-8665a60ba824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:50.137755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f1e9a89-178a-4b1e-83d1-0b08bd593206 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:50.138093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f1e9a89-178a-4b1e-83d1-0b08bd593206 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:50.138858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f1e9a89-178a-4b1e-83d1-0b08bd593206 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:50.139501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f1e9a89-178a-4b1e-83d1-0b08bd593206 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:50.329138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6f1e9a89-178a-4b1e-83d1-0b08bd593206 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:50.335789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d47e55ca-4d72-4efc-8652-8665a60ba824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:50.337099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6f1e9a89-178a-4b1e-83d1-0b08bd593206 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.211054 Jul 27 23:10:50.337870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1264/2350] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:50 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:50.342286 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-20b98226-3bcf-4ff0-a512-833ce9182654 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:50.342886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-20b98226-3bcf-4ff0-a512-833ce9182654 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:50.343985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d47e55ca-4d72-4efc-8652-8665a60ba824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.221297 Jul 27 23:10:50.344738 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1087/2351] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:50 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:50.348763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20b98226-3bcf-4ff0-a512-833ce9182654 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:50.349208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20b98226-3bcf-4ff0-a512-833ce9182654 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:50.349961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20b98226-3bcf-4ff0-a512-833ce9182654 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:50.350399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20b98226-3bcf-4ff0-a512-833ce9182654 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:50.357348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-78320573-d9f9-461f-8207-663c29761052 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:50.358028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-78320573-d9f9-461f-8207-663c29761052 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:50.365022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78320573-d9f9-461f-8207-663c29761052 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:50.365539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78320573-d9f9-461f-8207-663c29761052 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:50.366299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78320573-d9f9-461f-8207-663c29761052 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:50.366729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78320573-d9f9-461f-8207-663c29761052 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:50.415395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-20b98226-3bcf-4ff0-a512-833ce9182654 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:50.424373 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-20b98226-3bcf-4ff0-a512-833ce9182654 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:50.425908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-20b98226-3bcf-4ff0-a512-833ce9182654 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:50.427046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-20b98226-3bcf-4ff0-a512-833ce9182654 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.088401 Jul 27 23:10:50.427612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1265/2352] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:50 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:50.508160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-78320573-d9f9-461f-8207-663c29761052 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:50.516980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-78320573-d9f9-461f-8207-663c29761052 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.163288 Jul 27 23:10:50.517536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1088/2353] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:51.358256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d232761b-8cc0-4c18-9378-11d692b840bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:51.359047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d232761b-8cc0-4c18-9378-11d692b840bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:51.365504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bf3f6cb4-1b40-47fe-9383-52b10cb7b929 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:51.365926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d232761b-8cc0-4c18-9378-11d692b840bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:51.366035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d232761b-8cc0-4c18-9378-11d692b840bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:51.366152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bf3f6cb4-1b40-47fe-9383-52b10cb7b929 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:51.366749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d232761b-8cc0-4c18-9378-11d692b840bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:51.367176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d232761b-8cc0-4c18-9378-11d692b840bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:51.372643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf3f6cb4-1b40-47fe-9383-52b10cb7b929 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:51.373101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf3f6cb4-1b40-47fe-9383-52b10cb7b929 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:51.373863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf3f6cb4-1b40-47fe-9383-52b10cb7b929 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:51.374299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf3f6cb4-1b40-47fe-9383-52b10cb7b929 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:51.563941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d232761b-8cc0-4c18-9378-11d692b840bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:51.567236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bf3f6cb4-1b40-47fe-9383-52b10cb7b929 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:51.572104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d232761b-8cc0-4c18-9378-11d692b840bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217702 Jul 27 23:10:51.584746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1266/2354] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:51 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:51.584927 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bf3f6cb4-1b40-47fe-9383-52b10cb7b929 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214006 Jul 27 23:10:51.584927 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1089/2355] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:51 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:51.585110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-09e5829b-cd87-4d0f-b994-3a7ea3d56758 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:51.585110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-09e5829b-cd87-4d0f-b994-3a7ea3d56758 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:51.585286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6873af0f-2830-4fb7-acca-a45cb37deef4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:51.585286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6873af0f-2830-4fb7-acca-a45cb37deef4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:51.585431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-09e5829b-cd87-4d0f-b994-3a7ea3d56758 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:51.585431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-09e5829b-cd87-4d0f-b994-3a7ea3d56758 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:51.585799 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-09e5829b-cd87-4d0f-b994-3a7ea3d56758 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:51.586123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-09e5829b-cd87-4d0f-b994-3a7ea3d56758 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:51.586883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6873af0f-2830-4fb7-acca-a45cb37deef4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:51.588958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6873af0f-2830-4fb7-acca-a45cb37deef4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:51.588958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6873af0f-2830-4fb7-acca-a45cb37deef4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:51.588958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6873af0f-2830-4fb7-acca-a45cb37deef4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:51.671516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-09e5829b-cd87-4d0f-b994-3a7ea3d56758 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:51.679743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-09e5829b-cd87-4d0f-b994-3a7ea3d56758 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:51.681276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-09e5829b-cd87-4d0f-b994-3a7ea3d56758 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:51.682962 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-09e5829b-cd87-4d0f-b994-3a7ea3d56758 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.108739 Jul 27 23:10:51.683520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1267/2356] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:51 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:51.743880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6873af0f-2830-4fb7-acca-a45cb37deef4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:51.752246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6873af0f-2830-4fb7-acca-a45cb37deef4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.175060 Jul 27 23:10:51.752829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1090/2357] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:51 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:52.596464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-57366011-6b1e-48cb-bde3-791bf700130a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:52.597049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ff486198-cde3-46d8-8fcb-ec8efd198303 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:52.597438 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-57366011-6b1e-48cb-bde3-791bf700130a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:52.597533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ff486198-cde3-46d8-8fcb-ec8efd198303 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:52.603534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-57366011-6b1e-48cb-bde3-791bf700130a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:52.603692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff486198-cde3-46d8-8fcb-ec8efd198303 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:52.604609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff486198-cde3-46d8-8fcb-ec8efd198303 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:52.604751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-57366011-6b1e-48cb-bde3-791bf700130a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:52.605376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff486198-cde3-46d8-8fcb-ec8efd198303 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:52.605489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-57366011-6b1e-48cb-bde3-791bf700130a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:52.605809 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff486198-cde3-46d8-8fcb-ec8efd198303 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:52.605913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-57366011-6b1e-48cb-bde3-791bf700130a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:52.798544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-57366011-6b1e-48cb-bde3-791bf700130a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:52.801964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ff486198-cde3-46d8-8fcb-ec8efd198303 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:52.806700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-57366011-6b1e-48cb-bde3-791bf700130a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.214034 Jul 27 23:10:52.807377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1268/2358] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:52 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:52.810088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ff486198-cde3-46d8-8fcb-ec8efd198303 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.217423 Jul 27 23:10:52.810804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1091/2359] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:52 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:52.812035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e6fafaaa-db99-4df9-a34f-64c57f6de8eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:52.812655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e6fafaaa-db99-4df9-a34f-64c57f6de8eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:52.818519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e6fafaaa-db99-4df9-a34f-64c57f6de8eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:52.819164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e6fafaaa-db99-4df9-a34f-64c57f6de8eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:52.819967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e6fafaaa-db99-4df9-a34f-64c57f6de8eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:52.820772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e6fafaaa-db99-4df9-a34f-64c57f6de8eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:52.824673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:52.827317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3e6bb20b-b61d-4b15-9b8d-218b62e3fe45 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:52.828592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3e6bb20b-b61d-4b15-9b8d-218b62e3fe45 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:52.834827 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e6bb20b-b61d-4b15-9b8d-218b62e3fe45 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:52.835268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e6bb20b-b61d-4b15-9b8d-218b62e3fe45 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:52.836030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e6bb20b-b61d-4b15-9b8d-218b62e3fe45 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:52.836458 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e6bb20b-b61d-4b15-9b8d-218b62e3fe45 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:52.897437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e6fafaaa-db99-4df9-a34f-64c57f6de8eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:52.906343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e6fafaaa-db99-4df9-a34f-64c57f6de8eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:52.907817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e6fafaaa-db99-4df9-a34f-64c57f6de8eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:52.909018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e6fafaaa-db99-4df9-a34f-64c57f6de8eb tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.100847 Jul 27 23:10:52.909557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1269/2360] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:52 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:52.982252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3e6bb20b-b61d-4b15-9b8d-218b62e3fe45 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:52.990441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3e6bb20b-b61d-4b15-9b8d-218b62e3fe45 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.167922 Jul 27 23:10:52.991006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1092/2361] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:52 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:53.828205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c86fc5aa-8e20-469f-bc49-9d20ec250498 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:53.828858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c86fc5aa-8e20-469f-bc49-9d20ec250498 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:53.835355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c86fc5aa-8e20-469f-bc49-9d20ec250498 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:53.835813 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c86fc5aa-8e20-469f-bc49-9d20ec250498 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:53.836589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c86fc5aa-8e20-469f-bc49-9d20ec250498 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:53.837031 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c86fc5aa-8e20-469f-bc49-9d20ec250498 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:53.841109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0b8d45c4-2c46-40ff-bd67-7b08b8d1dd09 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:53.841726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0b8d45c4-2c46-40ff-bd67-7b08b8d1dd09 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:53.848141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b8d45c4-2c46-40ff-bd67-7b08b8d1dd09 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:53.848611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b8d45c4-2c46-40ff-bd67-7b08b8d1dd09 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:53.849383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b8d45c4-2c46-40ff-bd67-7b08b8d1dd09 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:53.849815 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b8d45c4-2c46-40ff-bd67-7b08b8d1dd09 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:54.021428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c86fc5aa-8e20-469f-bc49-9d20ec250498 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:54.030120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c86fc5aa-8e20-469f-bc49-9d20ec250498 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.205553 Jul 27 23:10:54.032781 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1270/2362] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:53 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:54.032921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0b8d45c4-2c46-40ff-bd67-7b08b8d1dd09 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:54.035208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d4283796-4fc6-4a8b-a959-eada17b33e64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:54.036013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d4283796-4fc6-4a8b-a959-eada17b33e64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:54.042188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d4283796-4fc6-4a8b-a959-eada17b33e64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:54.042740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d4283796-4fc6-4a8b-a959-eada17b33e64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:54.042854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0b8d45c4-2c46-40ff-bd67-7b08b8d1dd09 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.206017 Jul 27 23:10:54.043879 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1093/2363] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:53 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:54.044023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d4283796-4fc6-4a8b-a959-eada17b33e64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:54.044023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d4283796-4fc6-4a8b-a959-eada17b33e64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:54.047951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-43c7b3a9-63bc-4fe1-b63d-08f00b4defac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:54.048525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-43c7b3a9-63bc-4fe1-b63d-08f00b4defac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:54.054452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43c7b3a9-63bc-4fe1-b63d-08f00b4defac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:54.054902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43c7b3a9-63bc-4fe1-b63d-08f00b4defac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:54.055669 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43c7b3a9-63bc-4fe1-b63d-08f00b4defac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:54.056112 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43c7b3a9-63bc-4fe1-b63d-08f00b4defac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:54.118527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d4283796-4fc6-4a8b-a959-eada17b33e64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:54.126925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d4283796-4fc6-4a8b-a959-eada17b33e64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:54.128434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d4283796-4fc6-4a8b-a959-eada17b33e64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:54.129743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d4283796-4fc6-4a8b-a959-eada17b33e64 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.098291 Jul 27 23:10:54.130291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1271/2364] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:54 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:54.205723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-43c7b3a9-63bc-4fe1-b63d-08f00b4defac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:54.214514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-43c7b3a9-63bc-4fe1-b63d-08f00b4defac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.170146 Jul 27 23:10:54.215079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1094/2365] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:54 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:55.051421 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1e3f0838-d427-4b2a-ab1c-d6cddb6b1150 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:55.052027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1e3f0838-d427-4b2a-ab1c-d6cddb6b1150 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:55.059048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e3f0838-d427-4b2a-ab1c-d6cddb6b1150 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:55.059491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e3f0838-d427-4b2a-ab1c-d6cddb6b1150 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:55.060348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e3f0838-d427-4b2a-ab1c-d6cddb6b1150 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:55.060858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e3f0838-d427-4b2a-ab1c-d6cddb6b1150 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:55.064772 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4c37370a-7f37-4879-a73c-94dea55e9872 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:55.065429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4c37370a-7f37-4879-a73c-94dea55e9872 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:55.072001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4c37370a-7f37-4879-a73c-94dea55e9872 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:55.072455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4c37370a-7f37-4879-a73c-94dea55e9872 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:55.073256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4c37370a-7f37-4879-a73c-94dea55e9872 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:55.073696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4c37370a-7f37-4879-a73c-94dea55e9872 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:55.263594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1e3f0838-d427-4b2a-ab1c-d6cddb6b1150 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:55.266846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4c37370a-7f37-4879-a73c-94dea55e9872 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:55.269126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:10:55.271900 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1e3f0838-d427-4b2a-ab1c-d6cddb6b1150 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.224231 Jul 27 23:10:55.272513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1272/2366] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:55 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:55.276897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4c37370a-7f37-4879-a73c-94dea55e9872 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216671 Jul 27 23:10:55.277753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1095/2367] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:55 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:55.280631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3cb1fd90-d4d5-4b66-a3ce-2cc96d5be4cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:55.281239 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3cb1fd90-d4d5-4b66-a3ce-2cc96d5be4cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:55.287143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3cb1fd90-d4d5-4b66-a3ce-2cc96d5be4cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:55.287593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3cb1fd90-d4d5-4b66-a3ce-2cc96d5be4cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:55.288343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3cb1fd90-d4d5-4b66-a3ce-2cc96d5be4cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:55.288810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3cb1fd90-d4d5-4b66-a3ce-2cc96d5be4cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:55.291008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ab47884f-ff17-4c51-939d-00fe4037d388 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:55.292197 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ab47884f-ff17-4c51-939d-00fe4037d388 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:55.298205 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab47884f-ff17-4c51-939d-00fe4037d388 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:55.298646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab47884f-ff17-4c51-939d-00fe4037d388 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:55.299402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab47884f-ff17-4c51-939d-00fe4037d388 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:55.299835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ab47884f-ff17-4c51-939d-00fe4037d388 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:55.357218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3cb1fd90-d4d5-4b66-a3ce-2cc96d5be4cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:55.365798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3cb1fd90-d4d5-4b66-a3ce-2cc96d5be4cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:55.367294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3cb1fd90-d4d5-4b66-a3ce-2cc96d5be4cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:55.368425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3cb1fd90-d4d5-4b66-a3ce-2cc96d5be4cd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.091423 Jul 27 23:10:55.369003 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1273/2368] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:55 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:55.440609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ab47884f-ff17-4c51-939d-00fe4037d388 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:55.448324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ab47884f-ff17-4c51-939d-00fe4037d388 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.160957 Jul 27 23:10:55.448917 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1096/2369] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:55 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:56.294240 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-880e83b8-0693-43e8-9e2c-5be8defccc47 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:56.294889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-880e83b8-0693-43e8-9e2c-5be8defccc47 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:56.297764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f420fbca-f7a4-4663-8e52-33236324f87c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:56.298377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f420fbca-f7a4-4663-8e52-33236324f87c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:56.301457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-880e83b8-0693-43e8-9e2c-5be8defccc47 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:56.301910 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-880e83b8-0693-43e8-9e2c-5be8defccc47 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:56.302675 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-880e83b8-0693-43e8-9e2c-5be8defccc47 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:56.303111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-880e83b8-0693-43e8-9e2c-5be8defccc47 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:56.304901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f420fbca-f7a4-4663-8e52-33236324f87c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:56.305354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f420fbca-f7a4-4663-8e52-33236324f87c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:56.306110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f420fbca-f7a4-4663-8e52-33236324f87c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:56.306897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f420fbca-f7a4-4663-8e52-33236324f87c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:56.490906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-880e83b8-0693-43e8-9e2c-5be8defccc47 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:56.499014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-880e83b8-0693-43e8-9e2c-5be8defccc47 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.209292 Jul 27 23:10:56.499592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1274/2370] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:56 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:56.501982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f420fbca-f7a4-4663-8e52-33236324f87c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:56.504783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-eb2592d5-05d1-4d6d-b98d-e51d1b873b35 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:56.505393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-eb2592d5-05d1-4d6d-b98d-e51d1b873b35 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:56.511452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f420fbca-f7a4-4663-8e52-33236324f87c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.217801 Jul 27 23:10:56.511933 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb2592d5-05d1-4d6d-b98d-e51d1b873b35 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:56.516630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1097/2371] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:56 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:56.516790 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb2592d5-05d1-4d6d-b98d-e51d1b873b35 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:56.516790 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb2592d5-05d1-4d6d-b98d-e51d1b873b35 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:56.516790 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb2592d5-05d1-4d6d-b98d-e51d1b873b35 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:56.517062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f29d621d-e9eb-4464-bf8e-d92dd2451e29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:56.517668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f29d621d-e9eb-4464-bf8e-d92dd2451e29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:56.523616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f29d621d-e9eb-4464-bf8e-d92dd2451e29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:56.524168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f29d621d-e9eb-4464-bf8e-d92dd2451e29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:56.525028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f29d621d-e9eb-4464-bf8e-d92dd2451e29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:56.525536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f29d621d-e9eb-4464-bf8e-d92dd2451e29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:56.584008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eb2592d5-05d1-4d6d-b98d-e51d1b873b35 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:56.593792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eb2592d5-05d1-4d6d-b98d-e51d1b873b35 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:56.595310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eb2592d5-05d1-4d6d-b98d-e51d1b873b35 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:56.596643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-eb2592d5-05d1-4d6d-b98d-e51d1b873b35 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.095373 Jul 27 23:10:56.597208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1275/2372] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:56.666598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f29d621d-e9eb-4464-bf8e-d92dd2451e29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:56.674476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f29d621d-e9eb-4464-bf8e-d92dd2451e29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.160987 Jul 27 23:10:56.675030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1098/2373] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:56 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:57.521674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5410ea72-acb6-4e95-b779-310d4101bd09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:57.522305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5410ea72-acb6-4e95-b779-310d4101bd09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:57.529316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5410ea72-acb6-4e95-b779-310d4101bd09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:57.529754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5410ea72-acb6-4e95-b779-310d4101bd09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:57.530504 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5410ea72-acb6-4e95-b779-310d4101bd09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:57.530936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5410ea72-acb6-4e95-b779-310d4101bd09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:57.532046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a08ef517-d365-4e98-9a4a-5b83a17792fe tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:57.532715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a08ef517-d365-4e98-9a4a-5b83a17792fe tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:57.539095 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a08ef517-d365-4e98-9a4a-5b83a17792fe tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:57.539536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a08ef517-d365-4e98-9a4a-5b83a17792fe tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:57.540284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a08ef517-d365-4e98-9a4a-5b83a17792fe tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:57.540744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a08ef517-d365-4e98-9a4a-5b83a17792fe tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:57.724659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5410ea72-acb6-4e95-b779-310d4101bd09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:57.736720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5410ea72-acb6-4e95-b779-310d4101bd09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.218719 Jul 27 23:10:57.742829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a08ef517-d365-4e98-9a4a-5b83a17792fe tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:57.749621 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a08ef517-d365-4e98-9a4a-5b83a17792fe tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.221245 Jul 27 23:10:57.750804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1099/2374] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:57 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:57.753793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1276/2375] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:57 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:57.756194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e34a49c0-af99-4de2-b990-d3e8ac90bcc7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:57.757148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e34a49c0-af99-4de2-b990-d3e8ac90bcc7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:57.760411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6fb55a5c-541e-41c7-ac76-b788467ca6ef tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:57.761071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6fb55a5c-541e-41c7-ac76-b788467ca6ef tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:57.764325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e34a49c0-af99-4de2-b990-d3e8ac90bcc7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:57.765124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e34a49c0-af99-4de2-b990-d3e8ac90bcc7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:57.766114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e34a49c0-af99-4de2-b990-d3e8ac90bcc7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:57.766869 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e34a49c0-af99-4de2-b990-d3e8ac90bcc7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:57.768155 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6fb55a5c-541e-41c7-ac76-b788467ca6ef tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:57.768631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6fb55a5c-541e-41c7-ac76-b788467ca6ef tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:57.769401 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6fb55a5c-541e-41c7-ac76-b788467ca6ef tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:57.769837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6fb55a5c-541e-41c7-ac76-b788467ca6ef tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:57.841877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e34a49c0-af99-4de2-b990-d3e8ac90bcc7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:57.850301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e34a49c0-af99-4de2-b990-d3e8ac90bcc7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:57.851914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e34a49c0-af99-4de2-b990-d3e8ac90bcc7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:57.853163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e34a49c0-af99-4de2-b990-d3e8ac90bcc7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.101231 Jul 27 23:10:57.854390 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1100/2376] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:57 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:57.931294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6fb55a5c-541e-41c7-ac76-b788467ca6ef tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:57.939304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6fb55a5c-541e-41c7-ac76-b788467ca6ef tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.184430 Jul 27 23:10:57.939870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1277/2377] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:57 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:58.766361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-90e4f2fe-0166-4671-bb1f-e2b6f73247a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:58.767007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-90e4f2fe-0166-4671-bb1f-e2b6f73247a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:58.770632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7f6bb181-2808-495f-b591-f04bc9566961 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:58.771239 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7f6bb181-2808-495f-b591-f04bc9566961 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:58.773552 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-90e4f2fe-0166-4671-bb1f-e2b6f73247a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:58.774001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-90e4f2fe-0166-4671-bb1f-e2b6f73247a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:58.774770 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-90e4f2fe-0166-4671-bb1f-e2b6f73247a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:58.775206 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-90e4f2fe-0166-4671-bb1f-e2b6f73247a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:58.778222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7f6bb181-2808-495f-b591-f04bc9566961 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:58.778664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7f6bb181-2808-495f-b591-f04bc9566961 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:58.779413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7f6bb181-2808-495f-b591-f04bc9566961 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:58.779843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7f6bb181-2808-495f-b591-f04bc9566961 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:58.962560 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-90e4f2fe-0166-4671-bb1f-e2b6f73247a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:58.971071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-90e4f2fe-0166-4671-bb1f-e2b6f73247a6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.208585 Jul 27 23:10:58.971632 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1101/2378] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:58 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:58.973973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7f6bb181-2808-495f-b591-f04bc9566961 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:58.975996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4228f371-eb4e-4fa3-b15f-68e803cccb4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:58.976642 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4228f371-eb4e-4fa3-b15f-68e803cccb4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:58.981994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7f6bb181-2808-495f-b591-f04bc9566961 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215052 Jul 27 23:10:58.982715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1278/2379] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:58 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:10:58.982830 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4228f371-eb4e-4fa3-b15f-68e803cccb4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:58.983048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4228f371-eb4e-4fa3-b15f-68e803cccb4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:58.984092 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4228f371-eb4e-4fa3-b15f-68e803cccb4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:58.984614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4228f371-eb4e-4fa3-b15f-68e803cccb4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:58.991418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c0f02db6-1c25-4d03-a98a-95890db5231e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:58.992035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c0f02db6-1c25-4d03-a98a-95890db5231e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:58.997934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c0f02db6-1c25-4d03-a98a-95890db5231e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:58.998383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c0f02db6-1c25-4d03-a98a-95890db5231e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:58.999159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c0f02db6-1c25-4d03-a98a-95890db5231e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:10:58.999598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c0f02db6-1c25-4d03-a98a-95890db5231e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:10:59.048682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4228f371-eb4e-4fa3-b15f-68e803cccb4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:59.057754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4228f371-eb4e-4fa3-b15f-68e803cccb4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:59.059244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4228f371-eb4e-4fa3-b15f-68e803cccb4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:59.060509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4228f371-eb4e-4fa3-b15f-68e803cccb4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087976 Jul 27 23:10:59.061085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1102/2380] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:10:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:10:59.140983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c0f02db6-1c25-4d03-a98a-95890db5231e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:10:59.148924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c0f02db6-1c25-4d03-a98a-95890db5231e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.161069 Jul 27 23:10:59.149492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1279/2381] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:58 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:10:59.992460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0ba7954c-08bc-4aeb-b8e2-829c26c5cb01 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:10:59.993081 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0ba7954c-08bc-4aeb-b8e2-829c26c5cb01 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:10:59.999706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ba7954c-08bc-4aeb-b8e2-829c26c5cb01 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:00.000145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ba7954c-08bc-4aeb-b8e2-829c26c5cb01 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:00.000927 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ba7954c-08bc-4aeb-b8e2-829c26c5cb01 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:00.001355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0ba7954c-08bc-4aeb-b8e2-829c26c5cb01 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:00.003248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5034011f-6cb7-4fd5-8c50-853e96bdeb3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:00.003865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5034011f-6cb7-4fd5-8c50-853e96bdeb3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:00.010730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5034011f-6cb7-4fd5-8c50-853e96bdeb3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:00.011227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5034011f-6cb7-4fd5-8c50-853e96bdeb3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:00.012140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5034011f-6cb7-4fd5-8c50-853e96bdeb3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:00.012594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5034011f-6cb7-4fd5-8c50-853e96bdeb3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:00.199633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0ba7954c-08bc-4aeb-b8e2-829c26c5cb01 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:00.202709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5034011f-6cb7-4fd5-8c50-853e96bdeb3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:00.207639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0ba7954c-08bc-4aeb-b8e2-829c26c5cb01 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.219003 Jul 27 23:11:00.208282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1103/2382] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:59 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:00.210604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5034011f-6cb7-4fd5-8c50-853e96bdeb3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.211166 Jul 27 23:11:00.211354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1280/2383] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:10:59 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:00.213692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f3312c5c-b8cc-44c4-9064-26a4738cd5bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:00.214300 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f3312c5c-b8cc-44c4-9064-26a4738cd5bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:00.217822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fc1d07d3-e5de-4be7-aaec-08bf6d2c49ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:00.218682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fc1d07d3-e5de-4be7-aaec-08bf6d2c49ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:00.220042 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3312c5c-b8cc-44c4-9064-26a4738cd5bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:00.220605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3312c5c-b8cc-44c4-9064-26a4738cd5bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:00.221250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3312c5c-b8cc-44c4-9064-26a4738cd5bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:00.221680 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3312c5c-b8cc-44c4-9064-26a4738cd5bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:00.225829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc1d07d3-e5de-4be7-aaec-08bf6d2c49ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:00.226364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc1d07d3-e5de-4be7-aaec-08bf6d2c49ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:00.227190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc1d07d3-e5de-4be7-aaec-08bf6d2c49ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:00.227628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fc1d07d3-e5de-4be7-aaec-08bf6d2c49ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:00.293296 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f3312c5c-b8cc-44c4-9064-26a4738cd5bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:00.301574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f3312c5c-b8cc-44c4-9064-26a4738cd5bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:00.303071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f3312c5c-b8cc-44c4-9064-26a4738cd5bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:00.304201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f3312c5c-b8cc-44c4-9064-26a4738cd5bc tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.094927 Jul 27 23:11:00.304794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1104/2384] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:00 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:00.375283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fc1d07d3-e5de-4be7-aaec-08bf6d2c49ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:00.383136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fc1d07d3-e5de-4be7-aaec-08bf6d2c49ea tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.170258 Jul 27 23:11:00.383695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1281/2385] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:00 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:01.231004 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-362c7b4a-ad34-4770-b654-c88b0157413a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:01.231609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-362c7b4a-ad34-4770-b654-c88b0157413a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:01.232324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a217a554-926b-47d2-9fc8-efef72123933 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:01.232959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a217a554-926b-47d2-9fc8-efef72123933 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:01.238535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-362c7b4a-ad34-4770-b654-c88b0157413a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:01.238974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-362c7b4a-ad34-4770-b654-c88b0157413a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:01.239348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a217a554-926b-47d2-9fc8-efef72123933 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:01.239722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-362c7b4a-ad34-4770-b654-c88b0157413a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:01.239844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a217a554-926b-47d2-9fc8-efef72123933 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:01.240153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-362c7b4a-ad34-4770-b654-c88b0157413a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:01.240688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a217a554-926b-47d2-9fc8-efef72123933 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:01.241126 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a217a554-926b-47d2-9fc8-efef72123933 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:01.394067 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:11:01.394296 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:11:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff (ip 10.222.0.47) !!! Jul 27 23:11:01.432851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-362c7b4a-ad34-4770-b654-c88b0157413a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:01.436919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a217a554-926b-47d2-9fc8-efef72123933 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:01.440906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-362c7b4a-ad34-4770-b654-c88b0157413a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.214400 Jul 27 23:11:01.441470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1105/2386] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:01 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:01.444866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a217a554-926b-47d2-9fc8-efef72123933 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216777 Jul 27 23:11:01.445547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1282/2387] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:01 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:01.445960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8c8f7511-560f-43f7-93f8-49b2e958a62f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:01.446582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8c8f7511-560f-43f7-93f8-49b2e958a62f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:01.449835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1040d0da-a8c9-41a1-894a-0daac423554d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:01.450470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1040d0da-a8c9-41a1-894a-0daac423554d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:01.452303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c8f7511-560f-43f7-93f8-49b2e958a62f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:01.452783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c8f7511-560f-43f7-93f8-49b2e958a62f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:01.453539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c8f7511-560f-43f7-93f8-49b2e958a62f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:01.453967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c8f7511-560f-43f7-93f8-49b2e958a62f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:01.456259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1040d0da-a8c9-41a1-894a-0daac423554d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:01.456736 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1040d0da-a8c9-41a1-894a-0daac423554d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:01.457683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1040d0da-a8c9-41a1-894a-0daac423554d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:01.457923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1040d0da-a8c9-41a1-894a-0daac423554d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:01.525184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8c8f7511-560f-43f7-93f8-49b2e958a62f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:01.534093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8c8f7511-560f-43f7-93f8-49b2e958a62f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:01.535578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8c8f7511-560f-43f7-93f8-49b2e958a62f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:01.536739 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8c8f7511-560f-43f7-93f8-49b2e958a62f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.094271 Jul 27 23:11:01.537298 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1106/2388] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:01 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:01.606251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1040d0da-a8c9-41a1-894a-0daac423554d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:01.614404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1040d0da-a8c9-41a1-894a-0daac423554d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.168019 Jul 27 23:11:01.614967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1283/2389] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:01 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:02.471188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a8b50a45-8422-4cdf-8c4f-4b9c5e6c187c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:02.471726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8f65c4fc-52af-47b3-bed4-fa7764de85db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:02.472103 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a8b50a45-8422-4cdf-8c4f-4b9c5e6c187c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:02.472215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8f65c4fc-52af-47b3-bed4-fa7764de85db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:02.478261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8b50a45-8422-4cdf-8c4f-4b9c5e6c187c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:02.478407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f65c4fc-52af-47b3-bed4-fa7764de85db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:02.479209 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8b50a45-8422-4cdf-8c4f-4b9c5e6c187c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:02.479434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f65c4fc-52af-47b3-bed4-fa7764de85db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:02.479965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8b50a45-8422-4cdf-8c4f-4b9c5e6c187c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:02.480396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8b50a45-8422-4cdf-8c4f-4b9c5e6c187c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:02.480641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f65c4fc-52af-47b3-bed4-fa7764de85db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:02.481079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f65c4fc-52af-47b3-bed4-fa7764de85db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:02.673788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a8b50a45-8422-4cdf-8c4f-4b9c5e6c187c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:02.677814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8f65c4fc-52af-47b3-bed4-fa7764de85db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:02.682529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a8b50a45-8422-4cdf-8c4f-4b9c5e6c187c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214643 Jul 27 23:11:02.683099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1107/2390] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:02 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:02.686420 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8f65c4fc-52af-47b3-bed4-fa7764de85db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.219099 Jul 27 23:11:02.696727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1284/2391] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:02 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:02.696922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ec212afc-c28b-455e-9956-99ff043553c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:02.696922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ec212afc-c28b-455e-9956-99ff043553c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:02.697093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4549f79e-5189-4524-8c2b-8cea9122d035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:02.697093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4549f79e-5189-4524-8c2b-8cea9122d035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:02.697299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec212afc-c28b-455e-9956-99ff043553c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:02.697299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec212afc-c28b-455e-9956-99ff043553c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:02.697299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec212afc-c28b-455e-9956-99ff043553c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:02.697299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ec212afc-c28b-455e-9956-99ff043553c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:02.697672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4549f79e-5189-4524-8c2b-8cea9122d035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:02.698126 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4549f79e-5189-4524-8c2b-8cea9122d035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:02.698883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4549f79e-5189-4524-8c2b-8cea9122d035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:02.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4549f79e-5189-4524-8c2b-8cea9122d035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:02.763598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ec212afc-c28b-455e-9956-99ff043553c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:02.772003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ec212afc-c28b-455e-9956-99ff043553c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:02.773532 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ec212afc-c28b-455e-9956-99ff043553c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:02.774673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ec212afc-c28b-455e-9956-99ff043553c9 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.090524 Jul 27 23:11:02.775234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1108/2392] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:02 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:02.848036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4549f79e-5189-4524-8c2b-8cea9122d035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:02.850289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:02.857155 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4549f79e-5189-4524-8c2b-8cea9122d035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.169266 Jul 27 23:11:02.857718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1285/2393] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:02 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:03.704061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-636c7223-8582-4b78-8fe3-d960c09fd917 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:03.704705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-636c7223-8582-4b78-8fe3-d960c09fd917 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:03.707618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5ccb6190-3da5-4cc3-bdf7-4c4e9d070c10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:03.708232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5ccb6190-3da5-4cc3-bdf7-4c4e9d070c10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:03.711406 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-636c7223-8582-4b78-8fe3-d960c09fd917 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:03.711860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-636c7223-8582-4b78-8fe3-d960c09fd917 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:03.712637 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-636c7223-8582-4b78-8fe3-d960c09fd917 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:03.713069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-636c7223-8582-4b78-8fe3-d960c09fd917 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:03.715058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ccb6190-3da5-4cc3-bdf7-4c4e9d070c10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:03.715504 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ccb6190-3da5-4cc3-bdf7-4c4e9d070c10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:03.716249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ccb6190-3da5-4cc3-bdf7-4c4e9d070c10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:03.716710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ccb6190-3da5-4cc3-bdf7-4c4e9d070c10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:03.915252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-636c7223-8582-4b78-8fe3-d960c09fd917 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:03.919689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5ccb6190-3da5-4cc3-bdf7-4c4e9d070c10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:03.924052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-636c7223-8582-4b78-8fe3-d960c09fd917 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.223899 Jul 27 23:11:03.924634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1109/2394] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:03 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:03.928305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5ccb6190-3da5-4cc3-bdf7-4c4e9d070c10 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.224605 Jul 27 23:11:03.928983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-36069e41-55da-4fb1-a8cc-9b6875cf4665 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:03.929576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-36069e41-55da-4fb1-a8cc-9b6875cf4665 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:03.935508 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36069e41-55da-4fb1-a8cc-9b6875cf4665 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:03.935951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36069e41-55da-4fb1-a8cc-9b6875cf4665 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:03.936730 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36069e41-55da-4fb1-a8cc-9b6875cf4665 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:03.937159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36069e41-55da-4fb1-a8cc-9b6875cf4665 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:03.937951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1286/2395] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:03 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:03.942331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6931f94e-b00c-473e-b781-61acb8dc92fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:03.942934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6931f94e-b00c-473e-b781-61acb8dc92fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:03.949481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6931f94e-b00c-473e-b781-61acb8dc92fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:03.949926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6931f94e-b00c-473e-b781-61acb8dc92fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:03.950681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6931f94e-b00c-473e-b781-61acb8dc92fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:03.951112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6931f94e-b00c-473e-b781-61acb8dc92fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:03.999819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-36069e41-55da-4fb1-a8cc-9b6875cf4665 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:04.008387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-36069e41-55da-4fb1-a8cc-9b6875cf4665 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:04.009897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-36069e41-55da-4fb1-a8cc-9b6875cf4665 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:04.011530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-36069e41-55da-4fb1-a8cc-9b6875cf4665 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086000 Jul 27 23:11:04.012276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1110/2396] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:04.092488 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6931f94e-b00c-473e-b781-61acb8dc92fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:04.100360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6931f94e-b00c-473e-b781-61acb8dc92fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.161614 Jul 27 23:11:04.100952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1287/2397] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:03 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:04.945310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e63d1e07-f15b-4898-9d7b-5b062951faec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:04.945916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e63d1e07-f15b-4898-9d7b-5b062951faec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:04.950162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4d96c50d-861f-40be-a252-bb7d15da4fc4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:04.950779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4d96c50d-861f-40be-a252-bb7d15da4fc4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:04.953109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e63d1e07-f15b-4898-9d7b-5b062951faec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:04.953556 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e63d1e07-f15b-4898-9d7b-5b062951faec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:04.954310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e63d1e07-f15b-4898-9d7b-5b062951faec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:04.954768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e63d1e07-f15b-4898-9d7b-5b062951faec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:04.957100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d96c50d-861f-40be-a252-bb7d15da4fc4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:04.957549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d96c50d-861f-40be-a252-bb7d15da4fc4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:04.958300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d96c50d-861f-40be-a252-bb7d15da4fc4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:04.958735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d96c50d-861f-40be-a252-bb7d15da4fc4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:05.151439 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e63d1e07-f15b-4898-9d7b-5b062951faec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:05.155738 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4d96c50d-861f-40be-a252-bb7d15da4fc4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:05.159689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e63d1e07-f15b-4898-9d7b-5b062951faec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.218230 Jul 27 23:11:05.160261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1111/2398] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:04 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:05.163575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4d96c50d-861f-40be-a252-bb7d15da4fc4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217674 Jul 27 23:11:05.164320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1288/2399] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:04 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:05.170404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a1a786c2-f960-41ee-b410-e93b6a9abe50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:05.171153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a1a786c2-f960-41ee-b410-e93b6a9abe50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:05.177151 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1a786c2-f960-41ee-b410-e93b6a9abe50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:05.177319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5e3bd45d-cf81-47e9-8f48-8ba120d30009 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:05.177590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1a786c2-f960-41ee-b410-e93b6a9abe50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:05.177850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5e3bd45d-cf81-47e9-8f48-8ba120d30009 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:05.178344 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1a786c2-f960-41ee-b410-e93b6a9abe50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:05.178793 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1a786c2-f960-41ee-b410-e93b6a9abe50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:05.184473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5e3bd45d-cf81-47e9-8f48-8ba120d30009 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:05.185131 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5e3bd45d-cf81-47e9-8f48-8ba120d30009 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:05.185937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5e3bd45d-cf81-47e9-8f48-8ba120d30009 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:05.186380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5e3bd45d-cf81-47e9-8f48-8ba120d30009 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:05.193981 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:05.251208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1a786c2-f960-41ee-b410-e93b6a9abe50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:05.259589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1a786c2-f960-41ee-b410-e93b6a9abe50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:05.261682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1a786c2-f960-41ee-b410-e93b6a9abe50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:05.262823 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a1a786c2-f960-41ee-b410-e93b6a9abe50 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.101630 Jul 27 23:11:05.263574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1112/2400] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:05 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:05.333001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5e3bd45d-cf81-47e9-8f48-8ba120d30009 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:05.341060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5e3bd45d-cf81-47e9-8f48-8ba120d30009 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.175815 Jul 27 23:11:05.341714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1289/2401] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:05 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:06.181179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2ced5887-a003-4690-973f-9b822fe56501 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:06.181801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2ced5887-a003-4690-973f-9b822fe56501 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:06.184453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7486ed1c-b34e-4ea1-b49a-5990f8a1f4fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:06.185094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7486ed1c-b34e-4ea1-b49a-5990f8a1f4fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:06.188439 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ced5887-a003-4690-973f-9b822fe56501 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:06.188912 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ced5887-a003-4690-973f-9b822fe56501 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:06.189664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ced5887-a003-4690-973f-9b822fe56501 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:06.190092 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2ced5887-a003-4690-973f-9b822fe56501 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:06.191481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7486ed1c-b34e-4ea1-b49a-5990f8a1f4fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:06.191929 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7486ed1c-b34e-4ea1-b49a-5990f8a1f4fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:06.192709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7486ed1c-b34e-4ea1-b49a-5990f8a1f4fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:06.193141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7486ed1c-b34e-4ea1-b49a-5990f8a1f4fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:06.382070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2ced5887-a003-4690-973f-9b822fe56501 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:06.386528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7486ed1c-b34e-4ea1-b49a-5990f8a1f4fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:06.390633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2ced5887-a003-4690-973f-9b822fe56501 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.213233 Jul 27 23:11:06.391193 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1113/2402] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:06 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:06.394423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7486ed1c-b34e-4ea1-b49a-5990f8a1f4fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.213730 Jul 27 23:11:06.395151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1290/2403] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:06 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:06.395565 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6aaedfca-d66c-4ec1-b1ec-65e50fb39d73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:06.396155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6aaedfca-d66c-4ec1-b1ec-65e50fb39d73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:06.399265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fa2db258-1d0a-436e-9152-254b7e22bd6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:06.399859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fa2db258-1d0a-436e-9152-254b7e22bd6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:06.406175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6aaedfca-d66c-4ec1-b1ec-65e50fb39d73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:06.406626 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6aaedfca-d66c-4ec1-b1ec-65e50fb39d73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:06.407376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6aaedfca-d66c-4ec1-b1ec-65e50fb39d73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:06.407807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6aaedfca-d66c-4ec1-b1ec-65e50fb39d73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:06.414661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fa2db258-1d0a-436e-9152-254b7e22bd6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:06.415105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fa2db258-1d0a-436e-9152-254b7e22bd6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:06.415866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fa2db258-1d0a-436e-9152-254b7e22bd6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:06.416297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fa2db258-1d0a-436e-9152-254b7e22bd6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:06.489251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6aaedfca-d66c-4ec1-b1ec-65e50fb39d73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:06.497630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6aaedfca-d66c-4ec1-b1ec-65e50fb39d73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:06.499143 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6aaedfca-d66c-4ec1-b1ec-65e50fb39d73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:06.500290 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6aaedfca-d66c-4ec1-b1ec-65e50fb39d73 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.108193 Jul 27 23:11:06.500889 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1114/2404] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:06.554538 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fa2db258-1d0a-436e-9152-254b7e22bd6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:06.562952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fa2db258-1d0a-436e-9152-254b7e22bd6a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.167063 Jul 27 23:11:06.563506 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1291/2405] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:06 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:07.413222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a9826791-f3bb-40fe-82e5-45894a8ab6a9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:07.413843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a9826791-f3bb-40fe-82e5-45894a8ab6a9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:07.419652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-01884d67-6a4a-447b-97e2-f4484896ac4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:07.420257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-01884d67-6a4a-447b-97e2-f4484896ac4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:07.420377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9826791-f3bb-40fe-82e5-45894a8ab6a9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:07.420780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9826791-f3bb-40fe-82e5-45894a8ab6a9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:07.421548 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9826791-f3bb-40fe-82e5-45894a8ab6a9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:07.421989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9826791-f3bb-40fe-82e5-45894a8ab6a9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:07.426747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01884d67-6a4a-447b-97e2-f4484896ac4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:07.427187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01884d67-6a4a-447b-97e2-f4484896ac4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:07.427939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01884d67-6a4a-447b-97e2-f4484896ac4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:07.428372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01884d67-6a4a-447b-97e2-f4484896ac4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:07.625444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a9826791-f3bb-40fe-82e5-45894a8ab6a9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:07.629249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-01884d67-6a4a-447b-97e2-f4484896ac4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:07.633321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a9826791-f3bb-40fe-82e5-45894a8ab6a9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.224071 Jul 27 23:11:07.633885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1115/2406] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:07 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:07.637233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-01884d67-6a4a-447b-97e2-f4484896ac4b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.221301 Jul 27 23:11:07.648735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1292/2407] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:07 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:07.648925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-77d1910b-365d-4b98-a5f8-75beb0ff9da7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:07.648925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-77d1910b-365d-4b98-a5f8-75beb0ff9da7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:07.649135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a905e969-c0cb-4af9-a905-0c3b4b8951d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:07.649135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a905e969-c0cb-4af9-a905-0c3b4b8951d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:07.649328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77d1910b-365d-4b98-a5f8-75beb0ff9da7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:07.649328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77d1910b-365d-4b98-a5f8-75beb0ff9da7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:07.649328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77d1910b-365d-4b98-a5f8-75beb0ff9da7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:07.649328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77d1910b-365d-4b98-a5f8-75beb0ff9da7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:07.649693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a905e969-c0cb-4af9-a905-0c3b4b8951d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:07.649693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a905e969-c0cb-4af9-a905-0c3b4b8951d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:07.652189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a905e969-c0cb-4af9-a905-0c3b4b8951d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:07.652189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a905e969-c0cb-4af9-a905-0c3b4b8951d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:07.731962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-77d1910b-365d-4b98-a5f8-75beb0ff9da7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:07.740427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-77d1910b-365d-4b98-a5f8-75beb0ff9da7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:07.741944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-77d1910b-365d-4b98-a5f8-75beb0ff9da7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:07.743066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-77d1910b-365d-4b98-a5f8-75beb0ff9da7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.108284 Jul 27 23:11:07.743610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1116/2408] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:07 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:07.800132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a905e969-c0cb-4af9-a905-0c3b4b8951d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:07.810001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a905e969-c0cb-4af9-a905-0c3b4b8951d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.170658 Jul 27 23:11:07.810567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1293/2409] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:07 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:08.655871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ae633593-a84f-46db-9fa5-f0797a0c206f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:08.656496 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ae633593-a84f-46db-9fa5-f0797a0c206f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:08.659842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7d37ff2c-8b17-4032-984a-e5bbeb7ebdfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:08.660451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7d37ff2c-8b17-4032-984a-e5bbeb7ebdfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:08.663994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ae633593-a84f-46db-9fa5-f0797a0c206f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:08.664445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ae633593-a84f-46db-9fa5-f0797a0c206f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:08.665270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ae633593-a84f-46db-9fa5-f0797a0c206f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:08.665740 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ae633593-a84f-46db-9fa5-f0797a0c206f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:08.666557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7d37ff2c-8b17-4032-984a-e5bbeb7ebdfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:08.667009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7d37ff2c-8b17-4032-984a-e5bbeb7ebdfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:08.667754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7d37ff2c-8b17-4032-984a-e5bbeb7ebdfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:08.668186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7d37ff2c-8b17-4032-984a-e5bbeb7ebdfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:09.049079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ae633593-a84f-46db-9fa5-f0797a0c206f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:09.051757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7d37ff2c-8b17-4032-984a-e5bbeb7ebdfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:09.057765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ae633593-a84f-46db-9fa5-f0797a0c206f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.405285 Jul 27 23:11:09.058418 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1117/2410] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:08 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:09.060191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7d37ff2c-8b17-4032-984a-e5bbeb7ebdfa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.404116 Jul 27 23:11:09.072722 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1294/2411] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:08 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:09.073427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-94e5d447-c0d8-4afe-9c71-3339665e36a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:09.073427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-94e5d447-c0d8-4afe-9c71-3339665e36a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:09.073634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bda73fcb-471f-412a-8ba0-f3f48adcf77e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:09.073634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bda73fcb-471f-412a-8ba0-f3f48adcf77e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:09.073833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94e5d447-c0d8-4afe-9c71-3339665e36a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:09.073833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94e5d447-c0d8-4afe-9c71-3339665e36a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:09.073833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94e5d447-c0d8-4afe-9c71-3339665e36a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:09.073833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94e5d447-c0d8-4afe-9c71-3339665e36a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:09.074167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bda73fcb-471f-412a-8ba0-f3f48adcf77e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:09.074167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bda73fcb-471f-412a-8ba0-f3f48adcf77e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:09.074167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bda73fcb-471f-412a-8ba0-f3f48adcf77e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:09.074167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bda73fcb-471f-412a-8ba0-f3f48adcf77e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:09.154996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-94e5d447-c0d8-4afe-9c71-3339665e36a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:09.163334 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-94e5d447-c0d8-4afe-9c71-3339665e36a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:09.164894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-94e5d447-c0d8-4afe-9c71-3339665e36a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:09.166027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-94e5d447-c0d8-4afe-9c71-3339665e36a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.106703 Jul 27 23:11:09.167099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1118/2412] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:09 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:09.223512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bda73fcb-471f-412a-8ba0-f3f48adcf77e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:09.231857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bda73fcb-471f-412a-8ba0-f3f48adcf77e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.170175 Jul 27 23:11:09.232416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1295/2413] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:09 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:10.079241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-187cdb5e-3b6c-4614-b432-adb43c250742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:10.079855 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-187cdb5e-3b6c-4614-b432-adb43c250742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:10.082196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0db9154e-34c2-4bd4-86dd-9177d9804b41 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:10.082805 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0db9154e-34c2-4bd4-86dd-9177d9804b41 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:10.086481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-187cdb5e-3b6c-4614-b432-adb43c250742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:10.086925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-187cdb5e-3b6c-4614-b432-adb43c250742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:10.087688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-187cdb5e-3b6c-4614-b432-adb43c250742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:10.088122 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-187cdb5e-3b6c-4614-b432-adb43c250742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:10.089396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0db9154e-34c2-4bd4-86dd-9177d9804b41 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:10.089841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0db9154e-34c2-4bd4-86dd-9177d9804b41 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:10.090597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0db9154e-34c2-4bd4-86dd-9177d9804b41 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:10.091024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0db9154e-34c2-4bd4-86dd-9177d9804b41 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:10.279468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-187cdb5e-3b6c-4614-b432-adb43c250742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:10.286309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0db9154e-34c2-4bd4-86dd-9177d9804b41 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:10.287333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-187cdb5e-3b6c-4614-b432-adb43c250742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.211908 Jul 27 23:11:10.287897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1119/2414] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:10 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:10.292397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-96c0ad45-86af-411e-bf29-de60ee9bb26a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:10.293632 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-96c0ad45-86af-411e-bf29-de60ee9bb26a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:10.294873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0db9154e-34c2-4bd4-86dd-9177d9804b41 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.216428 Jul 27 23:11:10.303981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1296/2415] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:10 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:10.304153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-96c0ad45-86af-411e-bf29-de60ee9bb26a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:10.304267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3df2a000-8e29-4fb2-a0a4-bc07ce8cdc95 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:10.304357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-96c0ad45-86af-411e-bf29-de60ee9bb26a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:10.304444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3df2a000-8e29-4fb2-a0a4-bc07ce8cdc95 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:10.304528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-96c0ad45-86af-411e-bf29-de60ee9bb26a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:10.304528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-96c0ad45-86af-411e-bf29-de60ee9bb26a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:10.306360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3df2a000-8e29-4fb2-a0a4-bc07ce8cdc95 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:10.307896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3df2a000-8e29-4fb2-a0a4-bc07ce8cdc95 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:10.307896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3df2a000-8e29-4fb2-a0a4-bc07ce8cdc95 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:10.308093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3df2a000-8e29-4fb2-a0a4-bc07ce8cdc95 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:10.385310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-96c0ad45-86af-411e-bf29-de60ee9bb26a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:10.393527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-96c0ad45-86af-411e-bf29-de60ee9bb26a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:10.395019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-96c0ad45-86af-411e-bf29-de60ee9bb26a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:10.396143 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-96c0ad45-86af-411e-bf29-de60ee9bb26a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.107350 Jul 27 23:11:10.396719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1120/2416] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:10 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:10.450891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3df2a000-8e29-4fb2-a0a4-bc07ce8cdc95 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:10.458805 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3df2a000-8e29-4fb2-a0a4-bc07ce8cdc95 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.162394 Jul 27 23:11:10.459391 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1297/2417] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:10 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:11.315022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d6e3f63f-a710-4a3e-a708-d00f0dfc7fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:11.315627 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d6e3f63f-a710-4a3e-a708-d00f0dfc7fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:11.320649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6f43f279-0de1-4944-9322-ca17ae19079d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:11.321384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6f43f279-0de1-4944-9322-ca17ae19079d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:11.322056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d6e3f63f-a710-4a3e-a708-d00f0dfc7fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:11.322494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d6e3f63f-a710-4a3e-a708-d00f0dfc7fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:11.323254 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d6e3f63f-a710-4a3e-a708-d00f0dfc7fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:11.324272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d6e3f63f-a710-4a3e-a708-d00f0dfc7fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:11.328517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f43f279-0de1-4944-9322-ca17ae19079d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:11.328992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f43f279-0de1-4944-9322-ca17ae19079d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:11.329750 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f43f279-0de1-4944-9322-ca17ae19079d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:11.330182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6f43f279-0de1-4944-9322-ca17ae19079d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:11.514667 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d6e3f63f-a710-4a3e-a708-d00f0dfc7fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:11.518569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6f43f279-0de1-4944-9322-ca17ae19079d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:11.522573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d6e3f63f-a710-4a3e-a708-d00f0dfc7fc9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.211394 Jul 27 23:11:11.523144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1121/2418] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:11 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:11.526629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6f43f279-0de1-4944-9322-ca17ae19079d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.209774 Jul 27 23:11:11.528171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3db858ca-835e-4f85-ae85-6eea7f282209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:11.528795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3db858ca-835e-4f85-ae85-6eea7f282209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:11.534834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3db858ca-835e-4f85-ae85-6eea7f282209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:11.535272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3db858ca-835e-4f85-ae85-6eea7f282209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:11.536022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3db858ca-835e-4f85-ae85-6eea7f282209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:11.536401 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1298/2419] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:11 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:11.536528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3db858ca-835e-4f85-ae85-6eea7f282209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:11.541059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a2d211e4-dd6e-482a-a6a9-9b44f28fce13 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:11.541678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a2d211e4-dd6e-482a-a6a9-9b44f28fce13 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:11.548038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2d211e4-dd6e-482a-a6a9-9b44f28fce13 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:11.548483 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2d211e4-dd6e-482a-a6a9-9b44f28fce13 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:11.549282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2d211e4-dd6e-482a-a6a9-9b44f28fce13 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:11.549719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a2d211e4-dd6e-482a-a6a9-9b44f28fce13 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:11.598622 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3db858ca-835e-4f85-ae85-6eea7f282209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:11.607661 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3db858ca-835e-4f85-ae85-6eea7f282209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:11.609434 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3db858ca-835e-4f85-ae85-6eea7f282209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:11.610567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3db858ca-835e-4f85-ae85-6eea7f282209 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086533 Jul 27 23:11:11.611120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1122/2420] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:11 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:11.693426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a2d211e4-dd6e-482a-a6a9-9b44f28fce13 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:11.701316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a2d211e4-dd6e-482a-a6a9-9b44f28fce13 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.163891 Jul 27 23:11:11.701877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1299/2421] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:11 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:12.543900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8dfae5f9-4598-4df0-ace7-86df9e6fae5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:12.544516 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8dfae5f9-4598-4df0-ace7-86df9e6fae5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:12.547689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5f0e4e1b-7b7a-4494-b3ab-7c83567650b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:12.548367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5f0e4e1b-7b7a-4494-b3ab-7c83567650b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:12.551720 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8dfae5f9-4598-4df0-ace7-86df9e6fae5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:12.552168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8dfae5f9-4598-4df0-ace7-86df9e6fae5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:12.552966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8dfae5f9-4598-4df0-ace7-86df9e6fae5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:12.553404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8dfae5f9-4598-4df0-ace7-86df9e6fae5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:12.554470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f0e4e1b-7b7a-4494-b3ab-7c83567650b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:12.554917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f0e4e1b-7b7a-4494-b3ab-7c83567650b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:12.555667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f0e4e1b-7b7a-4494-b3ab-7c83567650b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:12.556097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f0e4e1b-7b7a-4494-b3ab-7c83567650b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:12.749360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8dfae5f9-4598-4df0-ace7-86df9e6fae5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:12.753555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5f0e4e1b-7b7a-4494-b3ab-7c83567650b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:12.757346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8dfae5f9-4598-4df0-ace7-86df9e6fae5e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217933 Jul 27 23:11:12.757911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1123/2422] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:12 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:12.761367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5f0e4e1b-7b7a-4494-b3ab-7c83567650b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.217561 Jul 27 23:11:12.764901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1300/2423] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:12 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:12.765049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-28c67eab-4df4-4c2c-8d63-63e9d648ce7c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:12.765049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-28c67eab-4df4-4c2c-8d63-63e9d648ce7c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:12.766199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1f8cd73e-1b27-41e6-bb47-903a6bfc1c85 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:12.767008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1f8cd73e-1b27-41e6-bb47-903a6bfc1c85 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:12.770252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-28c67eab-4df4-4c2c-8d63-63e9d648ce7c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:12.770856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-28c67eab-4df4-4c2c-8d63-63e9d648ce7c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:12.771761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-28c67eab-4df4-4c2c-8d63-63e9d648ce7c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:12.772352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-28c67eab-4df4-4c2c-8d63-63e9d648ce7c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:12.772480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f8cd73e-1b27-41e6-bb47-903a6bfc1c85 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:12.772964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f8cd73e-1b27-41e6-bb47-903a6bfc1c85 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:12.773720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f8cd73e-1b27-41e6-bb47-903a6bfc1c85 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:12.774160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f8cd73e-1b27-41e6-bb47-903a6bfc1c85 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:12.854628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-28c67eab-4df4-4c2c-8d63-63e9d648ce7c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:12.863958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-28c67eab-4df4-4c2c-8d63-63e9d648ce7c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:12.865489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-28c67eab-4df4-4c2c-8d63-63e9d648ce7c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:12.866640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-28c67eab-4df4-4c2c-8d63-63e9d648ce7c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.107816 Jul 27 23:11:12.867201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1124/2424] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:12.922343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1f8cd73e-1b27-41e6-bb47-903a6bfc1c85 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:12.930290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1f8cd73e-1b27-41e6-bb47-903a6bfc1c85 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.167467 Jul 27 23:11:12.930843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1301/2425] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:12 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:13.778736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-208071e5-dff3-4c68-96d9-e2d01049b9c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:13.779348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-208071e5-dff3-4c68-96d9-e2d01049b9c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:13.782820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-faa6747b-c745-4a71-b5ac-78c58b15a789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:13.783443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-faa6747b-c745-4a71-b5ac-78c58b15a789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:13.786245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-208071e5-dff3-4c68-96d9-e2d01049b9c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:13.786407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-208071e5-dff3-4c68-96d9-e2d01049b9c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:13.787208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-208071e5-dff3-4c68-96d9-e2d01049b9c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:13.787673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-208071e5-dff3-4c68-96d9-e2d01049b9c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:13.789632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-faa6747b-c745-4a71-b5ac-78c58b15a789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:13.790082 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-faa6747b-c745-4a71-b5ac-78c58b15a789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:13.790841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-faa6747b-c745-4a71-b5ac-78c58b15a789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:13.791279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-faa6747b-c745-4a71-b5ac-78c58b15a789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:13.811995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:13.984007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-208071e5-dff3-4c68-96d9-e2d01049b9c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:13.987920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-faa6747b-c745-4a71-b5ac-78c58b15a789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:13.992029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-208071e5-dff3-4c68-96d9-e2d01049b9c8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217725 Jul 27 23:11:13.992611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1125/2426] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:13 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:13.996338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-faa6747b-c745-4a71-b5ac-78c58b15a789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.217203 Jul 27 23:11:13.997078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1302/2427] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:13 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:13.997535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-09d1ab42-47b1-4ed8-8ae4-60d2eafdbfe4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:13.998136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-09d1ab42-47b1-4ed8-8ae4-60d2eafdbfe4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:14.003986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-09d1ab42-47b1-4ed8-8ae4-60d2eafdbfe4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:14.004435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-09d1ab42-47b1-4ed8-8ae4-60d2eafdbfe4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:14.005235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-09d1ab42-47b1-4ed8-8ae4-60d2eafdbfe4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:14.005670 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-09d1ab42-47b1-4ed8-8ae4-60d2eafdbfe4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:14.015555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-31c3fbb8-8ab2-49a9-879a-033c8acfbb4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:14.016168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-31c3fbb8-8ab2-49a9-879a-033c8acfbb4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:14.022194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31c3fbb8-8ab2-49a9-879a-033c8acfbb4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:14.022644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31c3fbb8-8ab2-49a9-879a-033c8acfbb4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:14.023409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31c3fbb8-8ab2-49a9-879a-033c8acfbb4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:14.023858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-31c3fbb8-8ab2-49a9-879a-033c8acfbb4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:14.071067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-09d1ab42-47b1-4ed8-8ae4-60d2eafdbfe4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:14.080350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-09d1ab42-47b1-4ed8-8ae4-60d2eafdbfe4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:14.081900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-09d1ab42-47b1-4ed8-8ae4-60d2eafdbfe4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:14.083038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-09d1ab42-47b1-4ed8-8ae4-60d2eafdbfe4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.089525 Jul 27 23:11:14.083595 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1126/2428] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:13 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:14.164291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-31c3fbb8-8ab2-49a9-879a-033c8acfbb4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:14.172397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-31c3fbb8-8ab2-49a9-879a-033c8acfbb4b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.162811 Jul 27 23:11:14.172967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1303/2429] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:13 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:15.014217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-97670e35-5c91-4a69-ac24-c05023d82856 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:15.014823 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-97670e35-5c91-4a69-ac24-c05023d82856 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:15.021392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b82cd39b-f7a3-4530-a6e0-f8e2c93387d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:15.021819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97670e35-5c91-4a69-ac24-c05023d82856 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:15.021936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97670e35-5c91-4a69-ac24-c05023d82856 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:15.022034 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b82cd39b-f7a3-4530-a6e0-f8e2c93387d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:15.022647 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97670e35-5c91-4a69-ac24-c05023d82856 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:15.023079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-97670e35-5c91-4a69-ac24-c05023d82856 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:15.028982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b82cd39b-f7a3-4530-a6e0-f8e2c93387d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:15.029425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b82cd39b-f7a3-4530-a6e0-f8e2c93387d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:15.030173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b82cd39b-f7a3-4530-a6e0-f8e2c93387d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:15.030600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b82cd39b-f7a3-4530-a6e0-f8e2c93387d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:15.220621 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-97670e35-5c91-4a69-ac24-c05023d82856 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:15.223392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b82cd39b-f7a3-4530-a6e0-f8e2c93387d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:15.228590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-97670e35-5c91-4a69-ac24-c05023d82856 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.218202 Jul 27 23:11:15.229157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1127/2430] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:15.231199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b82cd39b-f7a3-4530-a6e0-f8e2c93387d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.213549 Jul 27 23:11:15.231896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1304/2431] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:15 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:15.233517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5dd91048-f042-4de3-aa40-5e93bcf95e84 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:15.234376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5dd91048-f042-4de3-aa40-5e93bcf95e84 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:15.236308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4c6ff6a4-fd06-4ccd-8808-63cecdc86843 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:15.236934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4c6ff6a4-fd06-4ccd-8808-63cecdc86843 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:15.240161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5dd91048-f042-4de3-aa40-5e93bcf95e84 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:15.240629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5dd91048-f042-4de3-aa40-5e93bcf95e84 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:15.241503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5dd91048-f042-4de3-aa40-5e93bcf95e84 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:15.241872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5dd91048-f042-4de3-aa40-5e93bcf95e84 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:15.242676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c6ff6a4-fd06-4ccd-8808-63cecdc86843 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:15.243114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c6ff6a4-fd06-4ccd-8808-63cecdc86843 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:15.243858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c6ff6a4-fd06-4ccd-8808-63cecdc86843 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:15.244282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c6ff6a4-fd06-4ccd-8808-63cecdc86843 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:15.329951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5dd91048-f042-4de3-aa40-5e93bcf95e84 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:15.338334 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5dd91048-f042-4de3-aa40-5e93bcf95e84 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:15.340484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5dd91048-f042-4de3-aa40-5e93bcf95e84 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:15.341639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5dd91048-f042-4de3-aa40-5e93bcf95e84 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.111586 Jul 27 23:11:15.342384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1128/2432] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:15 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:15.394822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4c6ff6a4-fd06-4ccd-8808-63cecdc86843 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:15.403552 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4c6ff6a4-fd06-4ccd-8808-63cecdc86843 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.170850 Jul 27 23:11:15.404106 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1305/2433] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:15 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:16.257780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d9b7cbc4-0804-4824-905a-03701f59a698 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:16.258289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-648ee261-4ac0-4ae9-8705-b632ee843c2c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:16.258677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d9b7cbc4-0804-4824-905a-03701f59a698 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:16.258787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-648ee261-4ac0-4ae9-8705-b632ee843c2c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:16.264860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9b7cbc4-0804-4824-905a-03701f59a698 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:16.265014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-648ee261-4ac0-4ae9-8705-b632ee843c2c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:16.265308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9b7cbc4-0804-4824-905a-03701f59a698 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:16.265476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-648ee261-4ac0-4ae9-8705-b632ee843c2c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:16.266057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9b7cbc4-0804-4824-905a-03701f59a698 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:16.266170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-648ee261-4ac0-4ae9-8705-b632ee843c2c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:16.266484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9b7cbc4-0804-4824-905a-03701f59a698 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:16.266591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-648ee261-4ac0-4ae9-8705-b632ee843c2c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:16.270330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:16.456446 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-648ee261-4ac0-4ae9-8705-b632ee843c2c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:16.464825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-648ee261-4ac0-4ae9-8705-b632ee843c2c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.210277 Jul 27 23:11:16.465693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1306/2434] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:16 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:16.468684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d9b7cbc4-0804-4824-905a-03701f59a698 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:16.470221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1cf1e4bc-4ba6-4218-81fc-322b08a46190 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:16.470820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1cf1e4bc-4ba6-4218-81fc-322b08a46190 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:16.476525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1cf1e4bc-4ba6-4218-81fc-322b08a46190 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:16.476957 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d9b7cbc4-0804-4824-905a-03701f59a698 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.222877 Jul 27 23:11:16.477078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1cf1e4bc-4ba6-4218-81fc-322b08a46190 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:16.477622 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1129/2435] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:16 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:16.478546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1cf1e4bc-4ba6-4218-81fc-322b08a46190 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:16.479059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1cf1e4bc-4ba6-4218-81fc-322b08a46190 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:16.483038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-09996258-9392-4a88-ae75-17a869565743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:16.483978 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-09996258-9392-4a88-ae75-17a869565743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:16.489724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-09996258-9392-4a88-ae75-17a869565743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:16.490251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-09996258-9392-4a88-ae75-17a869565743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:16.491107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-09996258-9392-4a88-ae75-17a869565743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:16.491617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-09996258-9392-4a88-ae75-17a869565743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:16.549567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1cf1e4bc-4ba6-4218-81fc-322b08a46190 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:16.558377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1cf1e4bc-4ba6-4218-81fc-322b08a46190 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:16.559910 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1cf1e4bc-4ba6-4218-81fc-322b08a46190 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:16.561078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1cf1e4bc-4ba6-4218-81fc-322b08a46190 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.094469 Jul 27 23:11:16.561637 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1307/2436] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:16 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:16.631260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-09996258-9392-4a88-ae75-17a869565743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:16.639850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-09996258-9392-4a88-ae75-17a869565743 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.161041 Jul 27 23:11:16.640405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1130/2437] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:16 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:17.487005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3dac7b36-15a0-4051-b14b-78d1c0e2a281 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:17.487516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3dac7b36-15a0-4051-b14b-78d1c0e2a281 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:17.494006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3dac7b36-15a0-4051-b14b-78d1c0e2a281 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:17.494449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3dac7b36-15a0-4051-b14b-78d1c0e2a281 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:17.495203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3dac7b36-15a0-4051-b14b-78d1c0e2a281 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:17.496274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3dac7b36-15a0-4051-b14b-78d1c0e2a281 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:17.499258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-58e8b203-f3a7-431e-862c-be9b16c3b20e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:17.500688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-58e8b203-f3a7-431e-862c-be9b16c3b20e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:17.506282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58e8b203-f3a7-431e-862c-be9b16c3b20e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:17.506720 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58e8b203-f3a7-431e-862c-be9b16c3b20e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:17.507468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58e8b203-f3a7-431e-862c-be9b16c3b20e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:17.507893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58e8b203-f3a7-431e-862c-be9b16c3b20e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:17.688387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3dac7b36-15a0-4051-b14b-78d1c0e2a281 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:17.694964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-58e8b203-f3a7-431e-862c-be9b16c3b20e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:17.696292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3dac7b36-15a0-4051-b14b-78d1c0e2a281 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.213519 Jul 27 23:11:17.696885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1308/2438] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:17 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:17.701359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2b331038-3d7e-4558-a446-5eb53f6aa2e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:17.702011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2b331038-3d7e-4558-a446-5eb53f6aa2e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:17.703023 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-58e8b203-f3a7-431e-862c-be9b16c3b20e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.208176 Jul 27 23:11:17.703773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1131/2439] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:17 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:17.707793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b331038-3d7e-4558-a446-5eb53f6aa2e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:17.707943 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c80feb9d-526d-41da-b371-847ec6060866 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:17.708233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b331038-3d7e-4558-a446-5eb53f6aa2e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:17.708494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c80feb9d-526d-41da-b371-847ec6060866 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:17.709074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b331038-3d7e-4558-a446-5eb53f6aa2e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:17.709508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b331038-3d7e-4558-a446-5eb53f6aa2e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:17.711404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=98 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:17.715424 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c80feb9d-526d-41da-b371-847ec6060866 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:17.715917 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c80feb9d-526d-41da-b371-847ec6060866 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:17.716714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c80feb9d-526d-41da-b371-847ec6060866 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:17.717157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c80feb9d-526d-41da-b371-847ec6060866 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:17.777999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2b331038-3d7e-4558-a446-5eb53f6aa2e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:17.786259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2b331038-3d7e-4558-a446-5eb53f6aa2e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:17.787746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2b331038-3d7e-4558-a446-5eb53f6aa2e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:17.788925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2b331038-3d7e-4558-a446-5eb53f6aa2e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.091127 Jul 27 23:11:17.789724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1309/2440] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:17 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:17.864639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c80feb9d-526d-41da-b371-847ec6060866 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:17.872525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c80feb9d-526d-41da-b371-847ec6060866 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.168008 Jul 27 23:11:17.873108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1132/2441] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:17 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:18.724658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ac5f218e-b45b-4807-861a-eb0974e35f8b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:18.725265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ac5f218e-b45b-4807-861a-eb0974e35f8b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:18.730868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9185bda6-eb89-4e79-b398-bb3b69e3af03 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:18.731478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9185bda6-eb89-4e79-b398-bb3b69e3af03 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:18.732330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ac5f218e-b45b-4807-861a-eb0974e35f8b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:18.732795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ac5f218e-b45b-4807-861a-eb0974e35f8b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:18.733546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ac5f218e-b45b-4807-861a-eb0974e35f8b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:18.734569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ac5f218e-b45b-4807-861a-eb0974e35f8b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:18.738608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9185bda6-eb89-4e79-b398-bb3b69e3af03 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:18.739067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9185bda6-eb89-4e79-b398-bb3b69e3af03 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:18.739835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9185bda6-eb89-4e79-b398-bb3b69e3af03 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:18.740273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9185bda6-eb89-4e79-b398-bb3b69e3af03 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:18.928378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ac5f218e-b45b-4807-861a-eb0974e35f8b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:18.931228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9185bda6-eb89-4e79-b398-bb3b69e3af03 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:18.936521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ac5f218e-b45b-4807-861a-eb0974e35f8b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216030 Jul 27 23:11:18.937117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1310/2442] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:18 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:18.939224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9185bda6-eb89-4e79-b398-bb3b69e3af03 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.212682 Jul 27 23:11:18.939934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1133/2443] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:18 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:18.944068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-635515d9-1e8c-440f-a150-a0e6339a6cdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:18.944696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-635515d9-1e8c-440f-a150-a0e6339a6cdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:18.950865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-131c0356-e9e7-4f73-936a-dbc2dda85a20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:18.951016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-635515d9-1e8c-440f-a150-a0e6339a6cdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:18.951352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-635515d9-1e8c-440f-a150-a0e6339a6cdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:18.951486 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-131c0356-e9e7-4f73-936a-dbc2dda85a20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:18.952104 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-635515d9-1e8c-440f-a150-a0e6339a6cdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:18.952536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-635515d9-1e8c-440f-a150-a0e6339a6cdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:18.954760 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=98 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:18.960210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-131c0356-e9e7-4f73-936a-dbc2dda85a20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:18.960688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-131c0356-e9e7-4f73-936a-dbc2dda85a20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:18.961451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-131c0356-e9e7-4f73-936a-dbc2dda85a20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:18.961886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-131c0356-e9e7-4f73-936a-dbc2dda85a20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:19.040343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-131c0356-e9e7-4f73-936a-dbc2dda85a20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:19.048734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-131c0356-e9e7-4f73-936a-dbc2dda85a20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:19.050234 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-131c0356-e9e7-4f73-936a-dbc2dda85a20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:19.051367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-131c0356-e9e7-4f73-936a-dbc2dda85a20 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.113341 Jul 27 23:11:19.051925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1311/2444] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:18 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:19.104521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-635515d9-1e8c-440f-a150-a0e6339a6cdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:19.112717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-635515d9-1e8c-440f-a150-a0e6339a6cdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.172007 Jul 27 23:11:19.113267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1134/2445] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:18 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:19.958345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-082ecc83-92f1-4c7a-96fe-0475505900d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:19.958881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-082ecc83-92f1-4c7a-96fe-0475505900d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:19.964391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-51557fa9-4fce-4fee-bc08-7790a9f91383 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:19.965031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-51557fa9-4fce-4fee-bc08-7790a9f91383 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:19.965539 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-082ecc83-92f1-4c7a-96fe-0475505900d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:19.965985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-082ecc83-92f1-4c7a-96fe-0475505900d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:19.966747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-082ecc83-92f1-4c7a-96fe-0475505900d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:19.967185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-082ecc83-92f1-4c7a-96fe-0475505900d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:19.971413 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51557fa9-4fce-4fee-bc08-7790a9f91383 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:19.971866 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51557fa9-4fce-4fee-bc08-7790a9f91383 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:19.972623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51557fa9-4fce-4fee-bc08-7790a9f91383 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:19.973054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51557fa9-4fce-4fee-bc08-7790a9f91383 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:20.159197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-082ecc83-92f1-4c7a-96fe-0475505900d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:20.163074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-51557fa9-4fce-4fee-bc08-7790a9f91383 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:20.167911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-082ecc83-92f1-4c7a-96fe-0475505900d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.212765 Jul 27 23:11:20.168480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1312/2446] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:19 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:20.171841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-51557fa9-4fce-4fee-bc08-7790a9f91383 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.211214 Jul 27 23:11:20.172597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1135/2447] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:19 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:20.172921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e3e7478f-102d-4472-add5-444be534cd52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:20.173524 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e3e7478f-102d-4472-add5-444be534cd52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:20.179291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3e7478f-102d-4472-add5-444be534cd52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:20.179743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3e7478f-102d-4472-add5-444be534cd52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:20.180496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3e7478f-102d-4472-add5-444be534cd52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:20.180950 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3e7478f-102d-4472-add5-444be534cd52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:20.186278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4365201d-9c2a-46e3-b26b-514c63f340f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:20.186874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4365201d-9c2a-46e3-b26b-514c63f340f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:20.192674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4365201d-9c2a-46e3-b26b-514c63f340f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:20.193122 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4365201d-9c2a-46e3-b26b-514c63f340f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:20.193866 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4365201d-9c2a-46e3-b26b-514c63f340f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:20.194291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4365201d-9c2a-46e3-b26b-514c63f340f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:20.243323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e3e7478f-102d-4472-add5-444be534cd52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:20.251698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e3e7478f-102d-4472-add5-444be534cd52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:20.253222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e3e7478f-102d-4472-add5-444be534cd52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:20.254360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e3e7478f-102d-4472-add5-444be534cd52 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.084955 Jul 27 23:11:20.254917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1313/2448] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:20 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:20.336090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4365201d-9c2a-46e3-b26b-514c63f340f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:20.344380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4365201d-9c2a-46e3-b26b-514c63f340f5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.161762 Jul 27 23:11:20.344985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1136/2449] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:20 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:21.190009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-65ac7c7a-dae9-4d4b-ac27-46ba60731643 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:21.190793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-65ac7c7a-dae9-4d4b-ac27-46ba60731643 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:21.193014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cd73c22a-a7be-49bc-99f5-7540b7917c46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:21.193692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cd73c22a-a7be-49bc-99f5-7540b7917c46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:21.197578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65ac7c7a-dae9-4d4b-ac27-46ba60731643 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:21.198021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65ac7c7a-dae9-4d4b-ac27-46ba60731643 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:21.198797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65ac7c7a-dae9-4d4b-ac27-46ba60731643 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:21.199225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-65ac7c7a-dae9-4d4b-ac27-46ba60731643 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:21.200868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd73c22a-a7be-49bc-99f5-7540b7917c46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:21.201312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd73c22a-a7be-49bc-99f5-7540b7917c46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:21.202094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd73c22a-a7be-49bc-99f5-7540b7917c46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:21.202523 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd73c22a-a7be-49bc-99f5-7540b7917c46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:21.391474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-65ac7c7a-dae9-4d4b-ac27-46ba60731643 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:21.395514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cd73c22a-a7be-49bc-99f5-7540b7917c46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:21.399796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-65ac7c7a-dae9-4d4b-ac27-46ba60731643 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.213846 Jul 27 23:11:21.400367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1314/2450] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:21 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:21.403525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cd73c22a-a7be-49bc-99f5-7540b7917c46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.215048 Jul 27 23:11:21.404128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1137/2451] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:21 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:21.405112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8c297f9c-23e7-402f-a1a3-899e67efb826 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:21.405713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8c297f9c-23e7-402f-a1a3-899e67efb826 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:21.408972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-503dc35d-4538-4b77-b03a-67d7d1481117 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:21.409723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-503dc35d-4538-4b77-b03a-67d7d1481117 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:21.413127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c297f9c-23e7-402f-a1a3-899e67efb826 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:21.413576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c297f9c-23e7-402f-a1a3-899e67efb826 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:21.414473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c297f9c-23e7-402f-a1a3-899e67efb826 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:21.415085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c297f9c-23e7-402f-a1a3-899e67efb826 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:21.415972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-503dc35d-4538-4b77-b03a-67d7d1481117 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:21.416445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-503dc35d-4538-4b77-b03a-67d7d1481117 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:21.417747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-503dc35d-4538-4b77-b03a-67d7d1481117 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:21.418182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-503dc35d-4538-4b77-b03a-67d7d1481117 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:21.499918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8c297f9c-23e7-402f-a1a3-899e67efb826 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:21.508300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8c297f9c-23e7-402f-a1a3-899e67efb826 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:21.509827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8c297f9c-23e7-402f-a1a3-899e67efb826 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:21.510956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8c297f9c-23e7-402f-a1a3-899e67efb826 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.109501 Jul 27 23:11:21.511515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1315/2452] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:21 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:21.566971 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-503dc35d-4538-4b77-b03a-67d7d1481117 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:21.574731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-503dc35d-4538-4b77-b03a-67d7d1481117 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.169500 Jul 27 23:11:21.575285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1138/2453] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:21 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:22.421559 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2018ebb8-f63e-4ae0-81cd-33738bcb735c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:22.422102 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2018ebb8-f63e-4ae0-81cd-33738bcb735c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:22.424231 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e23bc28b-20f2-4944-b67b-f3fd97c46eb6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:22.424865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e23bc28b-20f2-4944-b67b-f3fd97c46eb6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:22.428620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2018ebb8-f63e-4ae0-81cd-33738bcb735c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:22.429065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2018ebb8-f63e-4ae0-81cd-33738bcb735c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:22.429822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2018ebb8-f63e-4ae0-81cd-33738bcb735c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:22.430256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2018ebb8-f63e-4ae0-81cd-33738bcb735c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:22.431244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e23bc28b-20f2-4944-b67b-f3fd97c46eb6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:22.431693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e23bc28b-20f2-4944-b67b-f3fd97c46eb6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:22.432451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e23bc28b-20f2-4944-b67b-f3fd97c46eb6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:22.433423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e23bc28b-20f2-4944-b67b-f3fd97c46eb6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:22.627936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2018ebb8-f63e-4ae0-81cd-33738bcb735c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:22.631913 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e23bc28b-20f2-4944-b67b-f3fd97c46eb6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:22.636605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2018ebb8-f63e-4ae0-81cd-33738bcb735c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.218527 Jul 27 23:11:22.637182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1316/2454] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:22 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:22.640797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e23bc28b-20f2-4944-b67b-f3fd97c46eb6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.220270 Jul 27 23:11:22.641551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1139/2455] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:22 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:22.641798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3b3d031a-ba2c-4981-b0c4-3d2d7e704129 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:22.642468 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3b3d031a-ba2c-4981-b0c4-3d2d7e704129 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:22.646544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0f5fe24e-8cb5-4ae0-b158-bb5638123486 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:22.647540 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0f5fe24e-8cb5-4ae0-b158-bb5638123486 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:22.648281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b3d031a-ba2c-4981-b0c4-3d2d7e704129 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:22.648830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b3d031a-ba2c-4981-b0c4-3d2d7e704129 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:22.649734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b3d031a-ba2c-4981-b0c4-3d2d7e704129 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:22.650166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b3d031a-ba2c-4981-b0c4-3d2d7e704129 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:22.654528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f5fe24e-8cb5-4ae0-b158-bb5638123486 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:22.655052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f5fe24e-8cb5-4ae0-b158-bb5638123486 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:22.655885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f5fe24e-8cb5-4ae0-b158-bb5638123486 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:22.656328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0f5fe24e-8cb5-4ae0-b158-bb5638123486 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:22.735436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3b3d031a-ba2c-4981-b0c4-3d2d7e704129 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:22.743667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3b3d031a-ba2c-4981-b0c4-3d2d7e704129 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:22.745241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3b3d031a-ba2c-4981-b0c4-3d2d7e704129 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:22.746893 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3b3d031a-ba2c-4981-b0c4-3d2d7e704129 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.108811 Jul 27 23:11:22.747449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1317/2456] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:22 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:22.801278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0f5fe24e-8cb5-4ae0-b158-bb5638123486 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:22.809719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0f5fe24e-8cb5-4ae0-b158-bb5638123486 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.166821 Jul 27 23:11:22.810276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1140/2457] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:22 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:23.658648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-55ea23e5-b8b3-40ba-a19f-d76c17f39a99 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:23.659256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-55ea23e5-b8b3-40ba-a19f-d76c17f39a99 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:23.661450 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ed82f370-d4e1-4052-bdf0-94c017a24993 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:23.662064 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ed82f370-d4e1-4052-bdf0-94c017a24993 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:23.665936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55ea23e5-b8b3-40ba-a19f-d76c17f39a99 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:23.666381 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55ea23e5-b8b3-40ba-a19f-d76c17f39a99 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:23.667187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55ea23e5-b8b3-40ba-a19f-d76c17f39a99 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:23.667614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-55ea23e5-b8b3-40ba-a19f-d76c17f39a99 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:23.668503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed82f370-d4e1-4052-bdf0-94c017a24993 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:23.668989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed82f370-d4e1-4052-bdf0-94c017a24993 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:23.669754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed82f370-d4e1-4052-bdf0-94c017a24993 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:23.670197 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed82f370-d4e1-4052-bdf0-94c017a24993 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:23.872121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-55ea23e5-b8b3-40ba-a19f-d76c17f39a99 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:23.875237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ed82f370-d4e1-4052-bdf0-94c017a24993 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:23.880309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-55ea23e5-b8b3-40ba-a19f-d76c17f39a99 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.225408 Jul 27 23:11:23.881372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1318/2458] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:23 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:23.887414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-921ac943-417c-4f5b-a19c-203e3f3321ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:23.888013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-921ac943-417c-4f5b-a19c-203e3f3321ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:23.892346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ed82f370-d4e1-4052-bdf0-94c017a24993 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.234510 Jul 27 23:11:23.893258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1141/2459] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:23 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:23.897966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9c2df388-27b9-4d34-997e-82ab1caa8082 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:23.898238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-921ac943-417c-4f5b-a19c-203e3f3321ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:23.898570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9c2df388-27b9-4d34-997e-82ab1caa8082 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:23.898839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-921ac943-417c-4f5b-a19c-203e3f3321ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:23.899678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-921ac943-417c-4f5b-a19c-203e3f3321ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:23.900591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-921ac943-417c-4f5b-a19c-203e3f3321ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:23.904967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c2df388-27b9-4d34-997e-82ab1caa8082 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:23.905419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c2df388-27b9-4d34-997e-82ab1caa8082 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:23.906180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c2df388-27b9-4d34-997e-82ab1caa8082 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:23.906551 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:23.906662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c2df388-27b9-4d34-997e-82ab1caa8082 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:23.992431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-921ac943-417c-4f5b-a19c-203e3f3321ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:24.002917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-921ac943-417c-4f5b-a19c-203e3f3321ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:24.004479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-921ac943-417c-4f5b-a19c-203e3f3321ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:24.006017 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-921ac943-417c-4f5b-a19c-203e3f3321ce tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.123592 Jul 27 23:11:24.006583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1319/2460] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:23 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:24.059759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9c2df388-27b9-4d34-997e-82ab1caa8082 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:24.067639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9c2df388-27b9-4d34-997e-82ab1caa8082 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.173256 Jul 27 23:11:24.068196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1142/2461] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:23 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:24.903732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9a7a2b89-16e8-4979-94a6-71e3bd5b74b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:24.904364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9a7a2b89-16e8-4979-94a6-71e3bd5b74b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:24.911183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a7a2b89-16e8-4979-94a6-71e3bd5b74b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:24.911620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a7a2b89-16e8-4979-94a6-71e3bd5b74b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:24.912398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a7a2b89-16e8-4979-94a6-71e3bd5b74b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:24.912842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a7a2b89-16e8-4979-94a6-71e3bd5b74b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:24.913018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-aed5ed06-009a-48f3-8e79-21f5f3dce332 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:24.913675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-aed5ed06-009a-48f3-8e79-21f5f3dce332 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:24.920148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aed5ed06-009a-48f3-8e79-21f5f3dce332 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:24.923381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aed5ed06-009a-48f3-8e79-21f5f3dce332 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:24.923381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aed5ed06-009a-48f3-8e79-21f5f3dce332 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:24.923381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aed5ed06-009a-48f3-8e79-21f5f3dce332 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:25.133170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-aed5ed06-009a-48f3-8e79-21f5f3dce332 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:25.133640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9a7a2b89-16e8-4979-94a6-71e3bd5b74b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:25.143668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-aed5ed06-009a-48f3-8e79-21f5f3dce332 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.234416 Jul 27 23:11:25.143993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9a7a2b89-16e8-4979-94a6-71e3bd5b74b9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.244209 Jul 27 23:11:25.144474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1143/2462] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:24 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:25.149119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9b042a94-3206-4624-a807-7347922c7399 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:25.149731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9b042a94-3206-4624-a807-7347922c7399 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:25.156878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b042a94-3206-4624-a807-7347922c7399 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:25.157228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b042a94-3206-4624-a807-7347922c7399 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:25.157440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1320/2463] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:24 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:25.157988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b042a94-3206-4624-a807-7347922c7399 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:25.159329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9b042a94-3206-4624-a807-7347922c7399 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:25.166172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c67a49e4-ba7f-40a0-9e3b-0f9f445605af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:25.166823 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c67a49e4-ba7f-40a0-9e3b-0f9f445605af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:25.172821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c67a49e4-ba7f-40a0-9e3b-0f9f445605af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:25.173263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c67a49e4-ba7f-40a0-9e3b-0f9f445605af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:25.174022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c67a49e4-ba7f-40a0-9e3b-0f9f445605af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:25.174455 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c67a49e4-ba7f-40a0-9e3b-0f9f445605af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:25.230036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9b042a94-3206-4624-a807-7347922c7399 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:25.239392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9b042a94-3206-4624-a807-7347922c7399 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:25.241041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9b042a94-3206-4624-a807-7347922c7399 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:25.242277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9b042a94-3206-4624-a807-7347922c7399 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.097104 Jul 27 23:11:25.242836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1144/2464] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:25 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:25.329354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c67a49e4-ba7f-40a0-9e3b-0f9f445605af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:25.337300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c67a49e4-ba7f-40a0-9e3b-0f9f445605af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.178801 Jul 27 23:11:25.337878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1321/2465] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:26.165705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ae0a77af-ee70-4b3e-b1aa-108d13d299dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:26.166609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ae0a77af-ee70-4b3e-b1aa-108d13d299dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:26.171597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-086472ec-2b7d-4a1a-bb2f-b17bfb2edb2e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:26.172210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-086472ec-2b7d-4a1a-bb2f-b17bfb2edb2e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:26.173782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ae0a77af-ee70-4b3e-b1aa-108d13d299dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:26.174226 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ae0a77af-ee70-4b3e-b1aa-108d13d299dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:26.174980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ae0a77af-ee70-4b3e-b1aa-108d13d299dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:26.175408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ae0a77af-ee70-4b3e-b1aa-108d13d299dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:26.178743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-086472ec-2b7d-4a1a-bb2f-b17bfb2edb2e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:26.179182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-086472ec-2b7d-4a1a-bb2f-b17bfb2edb2e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:26.179923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-086472ec-2b7d-4a1a-bb2f-b17bfb2edb2e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:26.180352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-086472ec-2b7d-4a1a-bb2f-b17bfb2edb2e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:26.376972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ae0a77af-ee70-4b3e-b1aa-108d13d299dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:26.379172 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:26.381037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-086472ec-2b7d-4a1a-bb2f-b17bfb2edb2e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:26.386811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ae0a77af-ee70-4b3e-b1aa-108d13d299dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.224861 Jul 27 23:11:26.387607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1145/2466] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:26 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:26.392085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b77a19d2-5ad6-416e-8567-d12ebb5adb47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:26.392723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b77a19d2-5ad6-416e-8567-d12ebb5adb47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:26.398570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b77a19d2-5ad6-416e-8567-d12ebb5adb47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:26.399031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b77a19d2-5ad6-416e-8567-d12ebb5adb47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:26.399794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b77a19d2-5ad6-416e-8567-d12ebb5adb47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:26.400230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b77a19d2-5ad6-416e-8567-d12ebb5adb47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:26.405764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-086472ec-2b7d-4a1a-bb2f-b17bfb2edb2e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.238515 Jul 27 23:11:26.406380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1322/2467] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:26 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:26.410958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-62fe849e-1719-41ec-950f-3e54b50f259e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:26.411564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-62fe849e-1719-41ec-950f-3e54b50f259e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:26.417543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62fe849e-1719-41ec-950f-3e54b50f259e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:26.418215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62fe849e-1719-41ec-950f-3e54b50f259e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:26.419499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62fe849e-1719-41ec-950f-3e54b50f259e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:26.420147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62fe849e-1719-41ec-950f-3e54b50f259e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:26.467172 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b77a19d2-5ad6-416e-8567-d12ebb5adb47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:26.475660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b77a19d2-5ad6-416e-8567-d12ebb5adb47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:26.477185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b77a19d2-5ad6-416e-8567-d12ebb5adb47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:26.478321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b77a19d2-5ad6-416e-8567-d12ebb5adb47 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.090024 Jul 27 23:11:26.492574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1146/2468] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:26 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:26.561466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-62fe849e-1719-41ec-950f-3e54b50f259e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:26.569335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-62fe849e-1719-41ec-950f-3e54b50f259e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.162005 Jul 27 23:11:26.569899 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1323/2469] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:26 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:27.413481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f317e245-2c21-4165-b177-d832c51c858a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:27.414090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f317e245-2c21-4165-b177-d832c51c858a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:27.421063 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f317e245-2c21-4165-b177-d832c51c858a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:27.421509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f317e245-2c21-4165-b177-d832c51c858a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:27.422258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f317e245-2c21-4165-b177-d832c51c858a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:27.422687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f317e245-2c21-4165-b177-d832c51c858a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:27.427163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-aa6c8214-86ed-4a4a-b879-46d0bec19aff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:27.427770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-aa6c8214-86ed-4a4a-b879-46d0bec19aff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:27.434740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa6c8214-86ed-4a4a-b879-46d0bec19aff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:27.435182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa6c8214-86ed-4a4a-b879-46d0bec19aff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:27.435930 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa6c8214-86ed-4a4a-b879-46d0bec19aff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:27.436364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa6c8214-86ed-4a4a-b879-46d0bec19aff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:27.612978 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f317e245-2c21-4165-b177-d832c51c858a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:27.619672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-aa6c8214-86ed-4a4a-b879-46d0bec19aff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:27.620893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f317e245-2c21-4165-b177-d832c51c858a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.211242 Jul 27 23:11:27.621482 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1147/2470] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:27 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:27.625975 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-31440f7e-c553-4240-a01c-3db28af4d959 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:27.626569 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-31440f7e-c553-4240-a01c-3db28af4d959 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:27.628038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-aa6c8214-86ed-4a4a-b879-46d0bec19aff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.204630 Jul 27 23:11:27.628715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1324/2471] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:27 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:27.633009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a9a166a6-308f-42a7-b9c9-80069defa901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:27.633286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-31440f7e-c553-4240-a01c-3db28af4d959 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:27.634058 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-31440f7e-c553-4240-a01c-3db28af4d959 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:27.634216 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a9a166a6-308f-42a7-b9c9-80069defa901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:27.635113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-31440f7e-c553-4240-a01c-3db28af4d959 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:27.635559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-31440f7e-c553-4240-a01c-3db28af4d959 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:27.640344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9a166a6-308f-42a7-b9c9-80069defa901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:27.641075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9a166a6-308f-42a7-b9c9-80069defa901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:27.642017 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9a166a6-308f-42a7-b9c9-80069defa901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:27.642448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a9a166a6-308f-42a7-b9c9-80069defa901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:27.722175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-31440f7e-c553-4240-a01c-3db28af4d959 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:27.731184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-31440f7e-c553-4240-a01c-3db28af4d959 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:27.732713 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-31440f7e-c553-4240-a01c-3db28af4d959 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:27.734118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-31440f7e-c553-4240-a01c-3db28af4d959 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.111467 Jul 27 23:11:27.734678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1148/2472] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:27 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:27.789191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a9a166a6-308f-42a7-b9c9-80069defa901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:27.797719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a9a166a6-308f-42a7-b9c9-80069defa901 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.168246 Jul 27 23:11:27.798272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1325/2473] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:27 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:28.643223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1ffb4a53-9786-4399-a995-808262136cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:28.644938 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1ffb4a53-9786-4399-a995-808262136cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:28.649598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a402b2ed-6f5e-4393-91c8-9ff7ce3b7862 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:28.650350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a402b2ed-6f5e-4393-91c8-9ff7ce3b7862 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:28.652985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ffb4a53-9786-4399-a995-808262136cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:28.653702 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ffb4a53-9786-4399-a995-808262136cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:28.655321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ffb4a53-9786-4399-a995-808262136cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:28.656127 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ffb4a53-9786-4399-a995-808262136cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:28.657944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a402b2ed-6f5e-4393-91c8-9ff7ce3b7862 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:28.658495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a402b2ed-6f5e-4393-91c8-9ff7ce3b7862 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:28.659473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a402b2ed-6f5e-4393-91c8-9ff7ce3b7862 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:28.659983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a402b2ed-6f5e-4393-91c8-9ff7ce3b7862 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:28.856453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a402b2ed-6f5e-4393-91c8-9ff7ce3b7862 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:28.860280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1ffb4a53-9786-4399-a995-808262136cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:28.865741 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a402b2ed-6f5e-4393-91c8-9ff7ce3b7862 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.220366 Jul 27 23:11:28.868500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1ffb4a53-9786-4399-a995-808262136cca tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.229001 Jul 27 23:11:28.869301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1149/2474] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:28 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:28.874302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-003b695c-37f7-41ea-9382-96493f2c1815 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:28.874877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-003b695c-37f7-41ea-9382-96493f2c1815 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:28.881096 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-003b695c-37f7-41ea-9382-96493f2c1815 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:28.881247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1326/2475] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:28 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:28.881617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-003b695c-37f7-41ea-9382-96493f2c1815 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:28.882386 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-003b695c-37f7-41ea-9382-96493f2c1815 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:28.882822 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-003b695c-37f7-41ea-9382-96493f2c1815 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:28.890072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-56c1dfea-488a-48e5-82fd-e2c142d5eb47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:28.890697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-56c1dfea-488a-48e5-82fd-e2c142d5eb47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:28.896876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56c1dfea-488a-48e5-82fd-e2c142d5eb47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:28.897410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56c1dfea-488a-48e5-82fd-e2c142d5eb47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:28.898094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56c1dfea-488a-48e5-82fd-e2c142d5eb47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:28.898889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-56c1dfea-488a-48e5-82fd-e2c142d5eb47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:28.957345 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-003b695c-37f7-41ea-9382-96493f2c1815 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:28.965877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-003b695c-37f7-41ea-9382-96493f2c1815 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:28.967384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-003b695c-37f7-41ea-9382-96493f2c1815 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:28.968519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-003b695c-37f7-41ea-9382-96493f2c1815 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.098436 Jul 27 23:11:28.969297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1150/2476] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:28 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:29.038384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-56c1dfea-488a-48e5-82fd-e2c142d5eb47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:29.046875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-56c1dfea-488a-48e5-82fd-e2c142d5eb47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.164205 Jul 27 23:11:29.047430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1327/2477] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:28 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:29.891309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-51dc4351-afa0-4b2c-984f-0133af225f36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:29.891925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-51dc4351-afa0-4b2c-984f-0133af225f36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:29.892998 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-67517e5e-74b0-4dcf-9a4a-cea59bf73464 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:29.893628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-67517e5e-74b0-4dcf-9a4a-cea59bf73464 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:29.898489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51dc4351-afa0-4b2c-984f-0133af225f36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:29.898934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51dc4351-afa0-4b2c-984f-0133af225f36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:29.899688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51dc4351-afa0-4b2c-984f-0133af225f36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:29.899943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-67517e5e-74b0-4dcf-9a4a-cea59bf73464 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:29.900118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51dc4351-afa0-4b2c-984f-0133af225f36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:29.900391 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-67517e5e-74b0-4dcf-9a4a-cea59bf73464 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:29.901179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-67517e5e-74b0-4dcf-9a4a-cea59bf73464 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:29.901629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-67517e5e-74b0-4dcf-9a4a-cea59bf73464 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:30.096833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-51dc4351-afa0-4b2c-984f-0133af225f36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:30.100766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-67517e5e-74b0-4dcf-9a4a-cea59bf73464 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:30.104872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-51dc4351-afa0-4b2c-984f-0133af225f36 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217925 Jul 27 23:11:30.105942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1151/2478] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:29 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:30.109782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-67517e5e-74b0-4dcf-9a4a-cea59bf73464 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.220671 Jul 27 23:11:30.110501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1328/2479] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:29 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:30.110689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-358a5b38-1146-409d-a7b1-0f169fef9255 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:30.111252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-358a5b38-1146-409d-a7b1-0f169fef9255 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:30.114801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c9b0daf8-126e-4ed8-bfe2-3a44184def5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:30.115403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c9b0daf8-126e-4ed8-bfe2-3a44184def5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:30.122784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9b0daf8-126e-4ed8-bfe2-3a44184def5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:30.123241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9b0daf8-126e-4ed8-bfe2-3a44184def5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:30.124000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9b0daf8-126e-4ed8-bfe2-3a44184def5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:30.124289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-358a5b38-1146-409d-a7b1-0f169fef9255 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:30.124437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9b0daf8-126e-4ed8-bfe2-3a44184def5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:30.124804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-358a5b38-1146-409d-a7b1-0f169fef9255 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:30.125558 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-358a5b38-1146-409d-a7b1-0f169fef9255 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:30.125988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-358a5b38-1146-409d-a7b1-0f169fef9255 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:30.212492 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-358a5b38-1146-409d-a7b1-0f169fef9255 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:30.220881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-358a5b38-1146-409d-a7b1-0f169fef9255 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:30.222371 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-358a5b38-1146-409d-a7b1-0f169fef9255 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:30.223533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-358a5b38-1146-409d-a7b1-0f169fef9255 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.116675 Jul 27 23:11:30.224272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1152/2480] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:30 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:30.273993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c9b0daf8-126e-4ed8-bfe2-3a44184def5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:30.281870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c9b0daf8-126e-4ed8-bfe2-3a44184def5c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.170555 Jul 27 23:11:30.282430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1329/2481] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:30 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:31.130329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f107e57a-0adb-4a9e-8fe3-3187bc426204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:31.130939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f107e57a-0adb-4a9e-8fe3-3187bc426204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:31.131107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e3cc22e7-1ef9-4707-a024-71d1cb0cb127 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:31.131602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e3cc22e7-1ef9-4707-a024-71d1cb0cb127 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:31.138356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3cc22e7-1ef9-4707-a024-71d1cb0cb127 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:31.138553 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f107e57a-0adb-4a9e-8fe3-3187bc426204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:31.138810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3cc22e7-1ef9-4707-a024-71d1cb0cb127 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:31.138935 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f107e57a-0adb-4a9e-8fe3-3187bc426204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:31.139577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3cc22e7-1ef9-4707-a024-71d1cb0cb127 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:31.139697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f107e57a-0adb-4a9e-8fe3-3187bc426204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:31.140010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e3cc22e7-1ef9-4707-a024-71d1cb0cb127 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:31.140128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f107e57a-0adb-4a9e-8fe3-3187bc426204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:31.519972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f107e57a-0adb-4a9e-8fe3-3187bc426204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:31.528114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f107e57a-0adb-4a9e-8fe3-3187bc426204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.401575 Jul 27 23:11:31.528675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1153/2482] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:31 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:31.530547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e3cc22e7-1ef9-4707-a024-71d1cb0cb127 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:31.533136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a03cbcf3-b86c-499d-a799-c74b7cc2b78c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:31.533844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a03cbcf3-b86c-499d-a799-c74b7cc2b78c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:31.538951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e3cc22e7-1ef9-4707-a024-71d1cb0cb127 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.411647 Jul 27 23:11:31.539743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a03cbcf3-b86c-499d-a799-c74b7cc2b78c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:31.539862 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1330/2483] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:31 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:31.539970 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a03cbcf3-b86c-499d-a799-c74b7cc2b78c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:31.540761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a03cbcf3-b86c-499d-a799-c74b7cc2b78c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:31.541199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a03cbcf3-b86c-499d-a799-c74b7cc2b78c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:31.547921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5352b8ec-5e98-41e3-92ff-f2084560b0db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:31.548527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5352b8ec-5e98-41e3-92ff-f2084560b0db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:31.554268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5352b8ec-5e98-41e3-92ff-f2084560b0db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:31.554724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5352b8ec-5e98-41e3-92ff-f2084560b0db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:31.555476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5352b8ec-5e98-41e3-92ff-f2084560b0db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:31.555905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5352b8ec-5e98-41e3-92ff-f2084560b0db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:31.603890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a03cbcf3-b86c-499d-a799-c74b7cc2b78c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:31.613439 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a03cbcf3-b86c-499d-a799-c74b7cc2b78c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:31.614936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a03cbcf3-b86c-499d-a799-c74b7cc2b78c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:31.616083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a03cbcf3-b86c-499d-a799-c74b7cc2b78c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.086493 Jul 27 23:11:31.616746 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1154/2484] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:31 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:31.699048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5352b8ec-5e98-41e3-92ff-f2084560b0db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:31.706944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5352b8ec-5e98-41e3-92ff-f2084560b0db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.162527 Jul 27 23:11:31.707503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1331/2485] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:31 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:32.549931 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-da67d258-c0ff-4bcf-a69d-619d7bafd72c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:32.550568 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-da67d258-c0ff-4bcf-a69d-619d7bafd72c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:32.557325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-da67d258-c0ff-4bcf-a69d-619d7bafd72c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:32.557820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-da67d258-c0ff-4bcf-a69d-619d7bafd72c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:32.558571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-da67d258-c0ff-4bcf-a69d-619d7bafd72c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:32.559575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-da67d258-c0ff-4bcf-a69d-619d7bafd72c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:32.561579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e22e0be8-b706-49de-90a0-55220d46b52f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:32.562194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e22e0be8-b706-49de-90a0-55220d46b52f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:32.568603 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e22e0be8-b706-49de-90a0-55220d46b52f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:32.569053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e22e0be8-b706-49de-90a0-55220d46b52f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:32.569809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e22e0be8-b706-49de-90a0-55220d46b52f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:32.570240 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e22e0be8-b706-49de-90a0-55220d46b52f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:32.753873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-da67d258-c0ff-4bcf-a69d-619d7bafd72c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:32.756872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e22e0be8-b706-49de-90a0-55220d46b52f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:32.762000 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-da67d258-c0ff-4bcf-a69d-619d7bafd72c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.215857 Jul 27 23:11:32.762892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1155/2486] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:32 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:32.765036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e22e0be8-b706-49de-90a0-55220d46b52f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.207885 Jul 27 23:11:32.767115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1332/2487] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:32 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:32.767388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-81bb11e2-4dd2-4030-af4d-9b2ec2f4425d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:32.767993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-81bb11e2-4dd2-4030-af4d-9b2ec2f4425d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:32.771402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a0017a43-9599-4d37-b49c-7d401f3ddaaf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:32.772110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a0017a43-9599-4d37-b49c-7d401f3ddaaf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:32.777368 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-81bb11e2-4dd2-4030-af4d-9b2ec2f4425d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:32.778347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-81bb11e2-4dd2-4030-af4d-9b2ec2f4425d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:32.778634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0017a43-9599-4d37-b49c-7d401f3ddaaf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:32.779085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0017a43-9599-4d37-b49c-7d401f3ddaaf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:32.779216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-81bb11e2-4dd2-4030-af4d-9b2ec2f4425d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:32.779523 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-81bb11e2-4dd2-4030-af4d-9b2ec2f4425d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:32.779842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0017a43-9599-4d37-b49c-7d401f3ddaaf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:32.780279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0017a43-9599-4d37-b49c-7d401f3ddaaf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:32.865001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-81bb11e2-4dd2-4030-af4d-9b2ec2f4425d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:32.873376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-81bb11e2-4dd2-4030-af4d-9b2ec2f4425d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:32.874884 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-81bb11e2-4dd2-4030-af4d-9b2ec2f4425d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:32.876017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-81bb11e2-4dd2-4030-af4d-9b2ec2f4425d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.112208 Jul 27 23:11:32.876588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1156/2488] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:32 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:32.928243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a0017a43-9599-4d37-b49c-7d401f3ddaaf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:32.936310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a0017a43-9599-4d37-b49c-7d401f3ddaaf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.169426 Jul 27 23:11:32.936906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1333/2489] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:32 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:33.783175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-733aff98-131d-4761-8fe9-820ceaf0d518 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:33.783821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-733aff98-131d-4761-8fe9-820ceaf0d518 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:33.786403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-750ea99c-ff6f-40e2-94d1-8f7990137567 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:33.787045 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-750ea99c-ff6f-40e2-94d1-8f7990137567 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:33.790385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-733aff98-131d-4761-8fe9-820ceaf0d518 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:33.790833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-733aff98-131d-4761-8fe9-820ceaf0d518 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:33.791598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-733aff98-131d-4761-8fe9-820ceaf0d518 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:33.792107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-733aff98-131d-4761-8fe9-820ceaf0d518 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:33.793916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-750ea99c-ff6f-40e2-94d1-8f7990137567 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:33.794370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-750ea99c-ff6f-40e2-94d1-8f7990137567 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:33.795131 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-750ea99c-ff6f-40e2-94d1-8f7990137567 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:33.795566 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-750ea99c-ff6f-40e2-94d1-8f7990137567 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:33.982957 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-733aff98-131d-4761-8fe9-820ceaf0d518 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:33.989919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-750ea99c-ff6f-40e2-94d1-8f7990137567 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:33.991289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-733aff98-131d-4761-8fe9-820ceaf0d518 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.211970 Jul 27 23:11:33.991864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1157/2490] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:33 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:33.996643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6c4d7735-d521-480d-8f48-05befe37950a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:33.997254 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6c4d7735-d521-480d-8f48-05befe37950a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:33.998199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-750ea99c-ff6f-40e2-94d1-8f7990137567 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215642 Jul 27 23:11:34.000351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1334/2491] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:33 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:34.003768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-42f9e877-264b-4ccc-826b-41deb34bfbed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:34.004041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c4d7735-d521-480d-8f48-05befe37950a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:34.004375 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-42f9e877-264b-4ccc-826b-41deb34bfbed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:34.005246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c4d7735-d521-480d-8f48-05befe37950a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:34.006027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c4d7735-d521-480d-8f48-05befe37950a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:34.006471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c4d7735-d521-480d-8f48-05befe37950a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:34.011412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42f9e877-264b-4ccc-826b-41deb34bfbed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:34.011412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42f9e877-264b-4ccc-826b-41deb34bfbed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:34.012350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42f9e877-264b-4ccc-826b-41deb34bfbed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:34.012804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-42f9e877-264b-4ccc-826b-41deb34bfbed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:34.094176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6c4d7735-d521-480d-8f48-05befe37950a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:34.102562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6c4d7735-d521-480d-8f48-05befe37950a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:34.104067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6c4d7735-d521-480d-8f48-05befe37950a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:34.105245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6c4d7735-d521-480d-8f48-05befe37950a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.112470 Jul 27 23:11:34.105807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1158/2492] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:33 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:34.160507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-42f9e877-264b-4ccc-826b-41deb34bfbed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:34.162748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:34.169565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-42f9e877-264b-4ccc-826b-41deb34bfbed tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.169430 Jul 27 23:11:34.170129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1335/2493] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:33 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:35.012218 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e8450f0e-7938-4021-8c10-b0f950b74784 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:35.012854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e8450f0e-7938-4021-8c10-b0f950b74784 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:35.019269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4c20cce8-59f4-4a20-bf73-3677bb674bd9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:35.019752 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8450f0e-7938-4021-8c10-b0f950b74784 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:35.019881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4c20cce8-59f4-4a20-bf73-3677bb674bd9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:35.020052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8450f0e-7938-4021-8c10-b0f950b74784 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:35.020838 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8450f0e-7938-4021-8c10-b0f950b74784 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:35.021280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e8450f0e-7938-4021-8c10-b0f950b74784 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:35.026249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c20cce8-59f4-4a20-bf73-3677bb674bd9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:35.026683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c20cce8-59f4-4a20-bf73-3677bb674bd9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:35.027943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c20cce8-59f4-4a20-bf73-3677bb674bd9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:35.028367 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c20cce8-59f4-4a20-bf73-3677bb674bd9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:35.220681 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e8450f0e-7938-4021-8c10-b0f950b74784 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:35.224643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4c20cce8-59f4-4a20-bf73-3677bb674bd9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:35.228923 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e8450f0e-7938-4021-8c10-b0f950b74784 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.220451 Jul 27 23:11:35.229652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1159/2494] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:35 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:35.233163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4c20cce8-59f4-4a20-bf73-3677bb674bd9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.217840 Jul 27 23:11:35.237759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1336/2495] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:35 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:35.237922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cd70a947-fd94-4f55-9dd0-d1e18a472c4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:35.237922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cd70a947-fd94-4f55-9dd0-d1e18a472c4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:35.238383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-94ec4c34-98ca-41c6-8623-38e6ac09ac64 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:35.238900 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-94ec4c34-98ca-41c6-8623-38e6ac09ac64 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:35.243450 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd70a947-fd94-4f55-9dd0-d1e18a472c4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:35.244153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd70a947-fd94-4f55-9dd0-d1e18a472c4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:35.244753 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-94ec4c34-98ca-41c6-8623-38e6ac09ac64 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:35.245255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-94ec4c34-98ca-41c6-8623-38e6ac09ac64 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:35.245374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd70a947-fd94-4f55-9dd0-d1e18a472c4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:35.245715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd70a947-fd94-4f55-9dd0-d1e18a472c4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:35.246058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-94ec4c34-98ca-41c6-8623-38e6ac09ac64 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:35.246563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-94ec4c34-98ca-41c6-8623-38e6ac09ac64 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:35.327682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cd70a947-fd94-4f55-9dd0-d1e18a472c4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:35.336156 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cd70a947-fd94-4f55-9dd0-d1e18a472c4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:35.337831 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cd70a947-fd94-4f55-9dd0-d1e18a472c4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:35.338980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cd70a947-fd94-4f55-9dd0-d1e18a472c4b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.108353 Jul 27 23:11:35.339548 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1160/2496] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:35 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:35.394868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-94ec4c34-98ca-41c6-8623-38e6ac09ac64 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:35.402716 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-94ec4c34-98ca-41c6-8623-38e6ac09ac64 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.167802 Jul 27 23:11:35.403821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1337/2497] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:35 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:36.252071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9c5ce53a-c26b-44b2-9991-31d0e5c82ea1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:36.252699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9c5ce53a-c26b-44b2-9991-31d0e5c82ea1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:36.254514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-68d82a7c-7717-4e7b-aa97-edfbad2bbc07 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:36.255133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-68d82a7c-7717-4e7b-aa97-edfbad2bbc07 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:36.259249 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c5ce53a-c26b-44b2-9991-31d0e5c82ea1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:36.259684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c5ce53a-c26b-44b2-9991-31d0e5c82ea1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:36.260433 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c5ce53a-c26b-44b2-9991-31d0e5c82ea1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:36.260892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c5ce53a-c26b-44b2-9991-31d0e5c82ea1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:36.261613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68d82a7c-7717-4e7b-aa97-edfbad2bbc07 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:36.262574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68d82a7c-7717-4e7b-aa97-edfbad2bbc07 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:36.263361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68d82a7c-7717-4e7b-aa97-edfbad2bbc07 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:36.263798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-68d82a7c-7717-4e7b-aa97-edfbad2bbc07 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:36.455228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9c5ce53a-c26b-44b2-9991-31d0e5c82ea1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:36.459384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-68d82a7c-7717-4e7b-aa97-edfbad2bbc07 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:36.463240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9c5ce53a-c26b-44b2-9991-31d0e5c82ea1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.215000 Jul 27 23:11:36.463802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1161/2498] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:36 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:36.468093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-68d82a7c-7717-4e7b-aa97-edfbad2bbc07 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.217405 Jul 27 23:11:36.478761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1338/2499] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:36 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:36.478930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fc2a7ff4-27d5-4b63-99ab-5685d1894c0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:36.478930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fc2a7ff4-27d5-4b63-99ab-5685d1894c0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:36.478930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc2a7ff4-27d5-4b63-99ab-5685d1894c0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:36.479191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7dcda5be-37e1-4c5b-b8fd-443a2397ab50 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:36.479275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc2a7ff4-27d5-4b63-99ab-5685d1894c0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:36.479363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7dcda5be-37e1-4c5b-b8fd-443a2397ab50 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:36.479452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc2a7ff4-27d5-4b63-99ab-5685d1894c0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:36.479452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc2a7ff4-27d5-4b63-99ab-5685d1894c0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:36.482191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7dcda5be-37e1-4c5b-b8fd-443a2397ab50 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:36.482633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7dcda5be-37e1-4c5b-b8fd-443a2397ab50 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:36.483388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7dcda5be-37e1-4c5b-b8fd-443a2397ab50 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:36.484076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7dcda5be-37e1-4c5b-b8fd-443a2397ab50 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:36.493621 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:36.565578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fc2a7ff4-27d5-4b63-99ab-5685d1894c0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:36.574091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fc2a7ff4-27d5-4b63-99ab-5685d1894c0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:36.576182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fc2a7ff4-27d5-4b63-99ab-5685d1894c0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:36.577381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fc2a7ff4-27d5-4b63-99ab-5685d1894c0c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.112632 Jul 27 23:11:36.577946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1162/2500] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:36 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:36.632505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7dcda5be-37e1-4c5b-b8fd-443a2397ab50 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:36.640973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7dcda5be-37e1-4c5b-b8fd-443a2397ab50 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.171352 Jul 27 23:11:36.641520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1339/2501] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:36 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:37.486052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-44b93562-12e4-4f49-83b5-6501f32e607d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:37.486795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-44b93562-12e4-4f49-83b5-6501f32e607d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:37.490275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0a331eda-2ed7-4574-84b7-51de71f925a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:37.490888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0a331eda-2ed7-4574-84b7-51de71f925a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:37.493377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-44b93562-12e4-4f49-83b5-6501f32e607d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:37.493815 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-44b93562-12e4-4f49-83b5-6501f32e607d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:37.494578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-44b93562-12e4-4f49-83b5-6501f32e607d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:37.495033 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-44b93562-12e4-4f49-83b5-6501f32e607d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:37.497482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a331eda-2ed7-4574-84b7-51de71f925a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:37.497932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a331eda-2ed7-4574-84b7-51de71f925a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:37.498687 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a331eda-2ed7-4574-84b7-51de71f925a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:37.499122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0a331eda-2ed7-4574-84b7-51de71f925a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:37.690280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-44b93562-12e4-4f49-83b5-6501f32e607d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:37.694254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0a331eda-2ed7-4574-84b7-51de71f925a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:37.698247 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-44b93562-12e4-4f49-83b5-6501f32e607d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217011 Jul 27 23:11:37.698815 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1163/2502] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:37 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:37.702671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0a331eda-2ed7-4574-84b7-51de71f925a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216229 Jul 27 23:11:37.712590 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1340/2503] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:37 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:37.712786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-090694b0-2829-4286-b646-14d6b0648040 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:37.712786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-090694b0-2829-4286-b646-14d6b0648040 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:37.712973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-69368cd0-a6cc-4550-90f5-647057725f70 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:37.712973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-69368cd0-a6cc-4550-90f5-647057725f70 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:37.713134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-090694b0-2829-4286-b646-14d6b0648040 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:37.713134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-090694b0-2829-4286-b646-14d6b0648040 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:37.713134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-090694b0-2829-4286-b646-14d6b0648040 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:37.713134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-090694b0-2829-4286-b646-14d6b0648040 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:37.713798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-69368cd0-a6cc-4550-90f5-647057725f70 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:37.714244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-69368cd0-a6cc-4550-90f5-647057725f70 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:37.715625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-69368cd0-a6cc-4550-90f5-647057725f70 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:37.716060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-69368cd0-a6cc-4550-90f5-647057725f70 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:37.781699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-090694b0-2829-4286-b646-14d6b0648040 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:37.790119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-090694b0-2829-4286-b646-14d6b0648040 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:37.791648 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-090694b0-2829-4286-b646-14d6b0648040 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:37.792804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-090694b0-2829-4286-b646-14d6b0648040 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.092556 Jul 27 23:11:37.793360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1164/2504] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:37 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:37.862124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-69368cd0-a6cc-4550-90f5-647057725f70 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:37.870190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-69368cd0-a6cc-4550-90f5-647057725f70 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.166004 Jul 27 23:11:37.870763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1341/2505] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:37 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:38.720626 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9976b885-6884-49a1-af79-2e00302213ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:38.721473 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9976b885-6884-49a1-af79-2e00302213ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:38.725920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4312f158-0e15-4b90-98f2-03fc25810720 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:38.726589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4312f158-0e15-4b90-98f2-03fc25810720 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:38.728643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9976b885-6884-49a1-af79-2e00302213ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:38.729087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9976b885-6884-49a1-af79-2e00302213ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:38.729845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9976b885-6884-49a1-af79-2e00302213ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:38.730275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9976b885-6884-49a1-af79-2e00302213ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:38.733614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4312f158-0e15-4b90-98f2-03fc25810720 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:38.734315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4312f158-0e15-4b90-98f2-03fc25810720 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:38.735073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4312f158-0e15-4b90-98f2-03fc25810720 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:38.735507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4312f158-0e15-4b90-98f2-03fc25810720 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:38.923080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9976b885-6884-49a1-af79-2e00302213ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:38.929801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4312f158-0e15-4b90-98f2-03fc25810720 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:38.931303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9976b885-6884-49a1-af79-2e00302213ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.214501 Jul 27 23:11:38.931878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1165/2506] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:38 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:38.936322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fe4f9382-2714-4c46-bbe7-014a9d7eb1dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:38.936960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fe4f9382-2714-4c46-bbe7-014a9d7eb1dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:38.938621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4312f158-0e15-4b90-98f2-03fc25810720 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216379 Jul 27 23:11:38.942706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fe4f9382-2714-4c46-bbe7-014a9d7eb1dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:38.943151 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fe4f9382-2714-4c46-bbe7-014a9d7eb1dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:38.943908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fe4f9382-2714-4c46-bbe7-014a9d7eb1dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:38.944343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fe4f9382-2714-4c46-bbe7-014a9d7eb1dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:38.946956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1342/2507] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:38 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:38.951412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-75523ecd-eb1e-4e47-978b-6d74ee5719ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:38.952092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-75523ecd-eb1e-4e47-978b-6d74ee5719ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:38.957925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75523ecd-eb1e-4e47-978b-6d74ee5719ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:38.958379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75523ecd-eb1e-4e47-978b-6d74ee5719ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:38.959132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75523ecd-eb1e-4e47-978b-6d74ee5719ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:38.959570 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-75523ecd-eb1e-4e47-978b-6d74ee5719ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:39.009146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fe4f9382-2714-4c46-bbe7-014a9d7eb1dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:39.017720 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fe4f9382-2714-4c46-bbe7-014a9d7eb1dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:39.019234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fe4f9382-2714-4c46-bbe7-014a9d7eb1dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:39.020379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fe4f9382-2714-4c46-bbe7-014a9d7eb1dd tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087590 Jul 27 23:11:39.020986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1166/2508] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:38 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:39.107534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-75523ecd-eb1e-4e47-978b-6d74ee5719ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:39.115673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-75523ecd-eb1e-4e47-978b-6d74ee5719ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.167797 Jul 27 23:11:39.116233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1343/2509] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:38 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:39.952659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dbf1012b-f773-417f-8511-eceb72ab8dcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:39.953200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dbf1012b-f773-417f-8511-eceb72ab8dcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:39.959364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5bccf4f8-a425-4a92-aa89-f495eab874d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:39.959839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dbf1012b-f773-417f-8511-eceb72ab8dcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:39.960000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5bccf4f8-a425-4a92-aa89-f495eab874d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:39.960120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dbf1012b-f773-417f-8511-eceb72ab8dcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:39.960826 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dbf1012b-f773-417f-8511-eceb72ab8dcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:39.961256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dbf1012b-f773-417f-8511-eceb72ab8dcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:39.966427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bccf4f8-a425-4a92-aa89-f495eab874d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:39.966872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bccf4f8-a425-4a92-aa89-f495eab874d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:39.967624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bccf4f8-a425-4a92-aa89-f495eab874d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:39.968059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5bccf4f8-a425-4a92-aa89-f495eab874d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:40.151004 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-dbf1012b-f773-417f-8511-eceb72ab8dcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:40.158130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5bccf4f8-a425-4a92-aa89-f495eab874d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:40.159468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dbf1012b-f773-417f-8511-eceb72ab8dcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.210741 Jul 27 23:11:40.160051 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1167/2510] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:39 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:40.164466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cce1e678-9286-48cc-9945-27cb7e64db56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:40.165725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cce1e678-9286-48cc-9945-27cb7e64db56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:40.166297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5bccf4f8-a425-4a92-aa89-f495eab874d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.210722 Jul 27 23:11:40.167024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1344/2511] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:39 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:40.172278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cce1e678-9286-48cc-9945-27cb7e64db56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:40.172766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cce1e678-9286-48cc-9945-27cb7e64db56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:40.173514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cce1e678-9286-48cc-9945-27cb7e64db56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:40.173946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cce1e678-9286-48cc-9945-27cb7e64db56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:40.179825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-66aa6c25-93e3-4386-bce4-7fea7fd79328 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:40.180499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-66aa6c25-93e3-4386-bce4-7fea7fd79328 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:40.186953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66aa6c25-93e3-4386-bce4-7fea7fd79328 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:40.187393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66aa6c25-93e3-4386-bce4-7fea7fd79328 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:40.188139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66aa6c25-93e3-4386-bce4-7fea7fd79328 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:40.188581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66aa6c25-93e3-4386-bce4-7fea7fd79328 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:40.237107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cce1e678-9286-48cc-9945-27cb7e64db56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:40.245756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cce1e678-9286-48cc-9945-27cb7e64db56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:40.247308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cce1e678-9286-48cc-9945-27cb7e64db56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:40.248527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cce1e678-9286-48cc-9945-27cb7e64db56 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087492 Jul 27 23:11:40.249119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1168/2512] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:40 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:40.327498 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-66aa6c25-93e3-4386-bce4-7fea7fd79328 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:40.335423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-66aa6c25-93e3-4386-bce4-7fea7fd79328 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.163591 Jul 27 23:11:40.336002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1345/2513] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:40 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:41.181105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e901490d-dc4e-4a81-98c3-d9534eb93da6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:41.181724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e901490d-dc4e-4a81-98c3-d9534eb93da6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:41.187557 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d75f2a82-065e-4ae8-8a50-09822b4be78c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:41.188159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d75f2a82-065e-4ae8-8a50-09822b4be78c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:41.188789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e901490d-dc4e-4a81-98c3-d9534eb93da6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:41.189243 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e901490d-dc4e-4a81-98c3-d9534eb93da6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:41.190009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e901490d-dc4e-4a81-98c3-d9534eb93da6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:41.190447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e901490d-dc4e-4a81-98c3-d9534eb93da6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:41.194515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d75f2a82-065e-4ae8-8a50-09822b4be78c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:41.194956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d75f2a82-065e-4ae8-8a50-09822b4be78c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:41.195699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d75f2a82-065e-4ae8-8a50-09822b4be78c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:41.196124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d75f2a82-065e-4ae8-8a50-09822b4be78c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:41.386194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d75f2a82-065e-4ae8-8a50-09822b4be78c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:41.389286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e901490d-dc4e-4a81-98c3-d9534eb93da6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:41.394329 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d75f2a82-065e-4ae8-8a50-09822b4be78c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.211027 Jul 27 23:11:41.394899 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1346/2514] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:41 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:41.397227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e901490d-dc4e-4a81-98c3-d9534eb93da6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.219923 Jul 27 23:11:41.408643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1169/2515] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:41 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:41.408816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-59461caa-097c-46b5-b3c4-d1ba602eeab2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:41.408816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-59461caa-097c-46b5-b3c4-d1ba602eeab2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:41.409012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bf214153-1642-41c6-83da-8a046585412e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:41.409012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bf214153-1642-41c6-83da-8a046585412e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:41.409175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-59461caa-097c-46b5-b3c4-d1ba602eeab2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:41.409175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-59461caa-097c-46b5-b3c4-d1ba602eeab2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:41.409175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-59461caa-097c-46b5-b3c4-d1ba602eeab2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:41.409175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-59461caa-097c-46b5-b3c4-d1ba602eeab2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:41.411292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf214153-1642-41c6-83da-8a046585412e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:41.411742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf214153-1642-41c6-83da-8a046585412e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:41.412504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf214153-1642-41c6-83da-8a046585412e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:41.412971 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf214153-1642-41c6-83da-8a046585412e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:41.493766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-59461caa-097c-46b5-b3c4-d1ba602eeab2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:41.502575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-59461caa-097c-46b5-b3c4-d1ba602eeab2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:41.504052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-59461caa-097c-46b5-b3c4-d1ba602eeab2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:41.505222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-59461caa-097c-46b5-b3c4-d1ba602eeab2 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.109422 Jul 27 23:11:41.505770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1347/2516] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:41 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:41.562590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bf214153-1642-41c6-83da-8a046585412e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:41.570451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bf214153-1642-41c6-83da-8a046585412e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.171442 Jul 27 23:11:41.571008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1170/2517] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:41 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:42.415290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f69b1443-e2a9-438e-b258-92b893efa68d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:42.415843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f69b1443-e2a9-438e-b258-92b893efa68d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:42.419934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d5ec5e5f-2c39-432d-b17f-c2e31f6ed8db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:42.420537 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d5ec5e5f-2c39-432d-b17f-c2e31f6ed8db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:42.422640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f69b1443-e2a9-438e-b258-92b893efa68d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:42.423089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f69b1443-e2a9-438e-b258-92b893efa68d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:42.423844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f69b1443-e2a9-438e-b258-92b893efa68d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:42.424275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f69b1443-e2a9-438e-b258-92b893efa68d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:42.426843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d5ec5e5f-2c39-432d-b17f-c2e31f6ed8db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:42.427286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d5ec5e5f-2c39-432d-b17f-c2e31f6ed8db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:42.428028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d5ec5e5f-2c39-432d-b17f-c2e31f6ed8db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:42.428457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d5ec5e5f-2c39-432d-b17f-c2e31f6ed8db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:42.613773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f69b1443-e2a9-438e-b258-92b893efa68d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:42.617682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d5ec5e5f-2c39-432d-b17f-c2e31f6ed8db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:42.621916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f69b1443-e2a9-438e-b258-92b893efa68d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.210695 Jul 27 23:11:42.622490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1348/2518] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:42 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:42.625579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d5ec5e5f-2c39-432d-b17f-c2e31f6ed8db tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.209865 Jul 27 23:11:42.639166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1171/2519] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:42 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:42.639352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-835c65cb-3c7e-412c-896d-8d154c887e01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:42.639352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-835c65cb-3c7e-412c-896d-8d154c887e01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:42.639533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5a9de99a-0f66-4ad5-bd4b-777fabb7b47d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:42.639533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5a9de99a-0f66-4ad5-bd4b-777fabb7b47d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:42.639710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-835c65cb-3c7e-412c-896d-8d154c887e01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:42.639710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-835c65cb-3c7e-412c-896d-8d154c887e01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:42.639710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-835c65cb-3c7e-412c-896d-8d154c887e01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:42.639710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-835c65cb-3c7e-412c-896d-8d154c887e01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:42.640009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a9de99a-0f66-4ad5-bd4b-777fabb7b47d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:42.640009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a9de99a-0f66-4ad5-bd4b-777fabb7b47d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:42.640009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a9de99a-0f66-4ad5-bd4b-777fabb7b47d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:42.640009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a9de99a-0f66-4ad5-bd4b-777fabb7b47d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:42.717519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-835c65cb-3c7e-412c-896d-8d154c887e01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:42.726029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-835c65cb-3c7e-412c-896d-8d154c887e01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:42.727550 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-835c65cb-3c7e-412c-896d-8d154c887e01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:42.728731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-835c65cb-3c7e-412c-896d-8d154c887e01 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.105296 Jul 27 23:11:42.729290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1349/2520] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:42 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:42.783028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5a9de99a-0f66-4ad5-bd4b-777fabb7b47d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:42.790946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5a9de99a-0f66-4ad5-bd4b-777fabb7b47d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.163902 Jul 27 23:11:42.791506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1172/2521] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:42 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:43.642910 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-84410149-bdbf-4600-aa87-99ae75c76df5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:43.643529 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-84410149-bdbf-4600-aa87-99ae75c76df5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:43.646394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-40ebbc34-1fcd-4019-a372-0b9d349bd21b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:43.647011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-40ebbc34-1fcd-4019-a372-0b9d349bd21b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:43.650135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-84410149-bdbf-4600-aa87-99ae75c76df5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:43.650583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-84410149-bdbf-4600-aa87-99ae75c76df5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:43.651336 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-84410149-bdbf-4600-aa87-99ae75c76df5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:43.651767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-84410149-bdbf-4600-aa87-99ae75c76df5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:43.653966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-40ebbc34-1fcd-4019-a372-0b9d349bd21b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:43.654414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-40ebbc34-1fcd-4019-a372-0b9d349bd21b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:43.655174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-40ebbc34-1fcd-4019-a372-0b9d349bd21b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:43.655613 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-40ebbc34-1fcd-4019-a372-0b9d349bd21b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:43.838989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-84410149-bdbf-4600-aa87-99ae75c76df5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:43.847448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-84410149-bdbf-4600-aa87-99ae75c76df5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.208423 Jul 27 23:11:43.848035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1350/2522] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:43 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:43.850718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-40ebbc34-1fcd-4019-a372-0b9d349bd21b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:43.853385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b0c616bf-23d6-4527-b712-c2a7635d1a90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:43.854252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b0c616bf-23d6-4527-b712-c2a7635d1a90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:43.859486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-40ebbc34-1fcd-4019-a372-0b9d349bd21b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.216738 Jul 27 23:11:43.861971 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1173/2523] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:43 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:43.862117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0c616bf-23d6-4527-b712-c2a7635d1a90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:43.862117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0c616bf-23d6-4527-b712-c2a7635d1a90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:43.862117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0c616bf-23d6-4527-b712-c2a7635d1a90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:43.862531 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0c616bf-23d6-4527-b712-c2a7635d1a90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:43.864398 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a025d769-165d-444a-829b-3ef83bb3ae84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:43.865037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a025d769-165d-444a-829b-3ef83bb3ae84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:43.870966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a025d769-165d-444a-829b-3ef83bb3ae84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:43.871412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a025d769-165d-444a-829b-3ef83bb3ae84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:43.872207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a025d769-165d-444a-829b-3ef83bb3ae84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:43.872705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a025d769-165d-444a-829b-3ef83bb3ae84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:43.936613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b0c616bf-23d6-4527-b712-c2a7635d1a90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:43.945055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b0c616bf-23d6-4527-b712-c2a7635d1a90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:43.946553 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b0c616bf-23d6-4527-b712-c2a7635d1a90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:43.947685 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b0c616bf-23d6-4527-b712-c2a7635d1a90 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.098753 Jul 27 23:11:43.948245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1351/2524] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:43 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:44.017876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a025d769-165d-444a-829b-3ef83bb3ae84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:44.025885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a025d769-165d-444a-829b-3ef83bb3ae84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.164920 Jul 27 23:11:44.026439 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1174/2525] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:43 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:44.869261 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f2f9e781-637f-47be-8a02-02827726698a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:44.869870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f2f9e781-637f-47be-8a02-02827726698a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:44.876948 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f2f9e781-637f-47be-8a02-02827726698a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:44.877388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f2f9e781-637f-47be-8a02-02827726698a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:44.878142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f2f9e781-637f-47be-8a02-02827726698a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:44.878570 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f2f9e781-637f-47be-8a02-02827726698a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:44.882787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0a6eba49-772f-4b7f-aa55-5620c85250fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:44.883405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0a6eba49-772f-4b7f-aa55-5620c85250fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:44.889945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a6eba49-772f-4b7f-aa55-5620c85250fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:44.890402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a6eba49-772f-4b7f-aa55-5620c85250fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:44.891177 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a6eba49-772f-4b7f-aa55-5620c85250fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:44.891615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a6eba49-772f-4b7f-aa55-5620c85250fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:44.893516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:45.076980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f2f9e781-637f-47be-8a02-02827726698a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:45.080052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0a6eba49-772f-4b7f-aa55-5620c85250fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:45.085083 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f2f9e781-637f-47be-8a02-02827726698a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.219634 Jul 27 23:11:45.085650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1352/2526] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:44 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:45.088258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0a6eba49-772f-4b7f-aa55-5620c85250fa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.209326 Jul 27 23:11:45.089075 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1175/2527] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:44 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:45.094330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c7a7f82d-ba4d-44b6-8938-0f4a56318696 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:45.094941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c7a7f82d-ba4d-44b6-8938-0f4a56318696 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:45.100852 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c7a7f82d-ba4d-44b6-8938-0f4a56318696 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:45.101303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c7a7f82d-ba4d-44b6-8938-0f4a56318696 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:45.101932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ffc38311-6aa1-4ab9-a64e-e6648ac30634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:45.102087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c7a7f82d-ba4d-44b6-8938-0f4a56318696 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:45.102519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c7a7f82d-ba4d-44b6-8938-0f4a56318696 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:45.102641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ffc38311-6aa1-4ab9-a64e-e6648ac30634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:45.112388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffc38311-6aa1-4ab9-a64e-e6648ac30634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:45.113224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffc38311-6aa1-4ab9-a64e-e6648ac30634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:45.114566 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffc38311-6aa1-4ab9-a64e-e6648ac30634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:45.115342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ffc38311-6aa1-4ab9-a64e-e6648ac30634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:45.201209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ffc38311-6aa1-4ab9-a64e-e6648ac30634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:45.209577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ffc38311-6aa1-4ab9-a64e-e6648ac30634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:45.211078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ffc38311-6aa1-4ab9-a64e-e6648ac30634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:45.212207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ffc38311-6aa1-4ab9-a64e-e6648ac30634 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.125662 Jul 27 23:11:45.212814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1353/2528] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:45 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:45.257943 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c7a7f82d-ba4d-44b6-8938-0f4a56318696 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:45.265862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c7a7f82d-ba4d-44b6-8938-0f4a56318696 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.176091 Jul 27 23:11:45.266417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1176/2529] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:45 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:46.107219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c7129a2a-2c66-4e98-9dcb-a8ff08a04d3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:46.107905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c7129a2a-2c66-4e98-9dcb-a8ff08a04d3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:46.113858 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f8de7ccc-59a4-4b4e-ae4a-20f3cf881121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:46.114463 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f8de7ccc-59a4-4b4e-ae4a-20f3cf881121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:46.114671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7129a2a-2c66-4e98-9dcb-a8ff08a04d3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:46.115119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7129a2a-2c66-4e98-9dcb-a8ff08a04d3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:46.115876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7129a2a-2c66-4e98-9dcb-a8ff08a04d3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:46.116306 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c7129a2a-2c66-4e98-9dcb-a8ff08a04d3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:46.120816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f8de7ccc-59a4-4b4e-ae4a-20f3cf881121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:46.121256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f8de7ccc-59a4-4b4e-ae4a-20f3cf881121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:46.122005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f8de7ccc-59a4-4b4e-ae4a-20f3cf881121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:46.122432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f8de7ccc-59a4-4b4e-ae4a-20f3cf881121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:46.307003 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c7129a2a-2c66-4e98-9dcb-a8ff08a04d3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:46.311470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f8de7ccc-59a4-4b4e-ae4a-20f3cf881121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:46.315544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c7129a2a-2c66-4e98-9dcb-a8ff08a04d3a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.212180 Jul 27 23:11:46.316121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1354/2530] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:46 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:46.319423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f8de7ccc-59a4-4b4e-ae4a-20f3cf881121 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.209315 Jul 27 23:11:46.320128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1177/2531] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:46 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:46.320511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5b008647-f0cf-4532-ac99-1e92a6d33da8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:46.321163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5b008647-f0cf-4532-ac99-1e92a6d33da8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:46.324247 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7e200e58-f9b5-45c5-815d-0626374fc839 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:46.324871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7e200e58-f9b5-45c5-815d-0626374fc839 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:46.326884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b008647-f0cf-4532-ac99-1e92a6d33da8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:46.327331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b008647-f0cf-4532-ac99-1e92a6d33da8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:46.328092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b008647-f0cf-4532-ac99-1e92a6d33da8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:46.328522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5b008647-f0cf-4532-ac99-1e92a6d33da8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:46.330687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7e200e58-f9b5-45c5-815d-0626374fc839 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:46.331140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7e200e58-f9b5-45c5-815d-0626374fc839 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:46.331877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7e200e58-f9b5-45c5-815d-0626374fc839 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:46.332305 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7e200e58-f9b5-45c5-815d-0626374fc839 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:46.411742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5b008647-f0cf-4532-ac99-1e92a6d33da8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:46.420802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5b008647-f0cf-4532-ac99-1e92a6d33da8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:46.422422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5b008647-f0cf-4532-ac99-1e92a6d33da8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:46.423633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5b008647-f0cf-4532-ac99-1e92a6d33da8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.106583 Jul 27 23:11:46.424194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1355/2532] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:46 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:46.476752 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7e200e58-f9b5-45c5-815d-0626374fc839 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:46.485447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7e200e58-f9b5-45c5-815d-0626374fc839 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.164560 Jul 27 23:11:46.486003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1178/2533] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:46 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:47.347203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a0c0cbc6-8017-4b52-b48b-5e42600be45b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:47.347803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a0c0cbc6-8017-4b52-b48b-5e42600be45b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:47.349322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c8074a1a-82e4-41e2-8ceb-0c15f0abfee3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:47.349934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c8074a1a-82e4-41e2-8ceb-0c15f0abfee3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:47.354337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0c0cbc6-8017-4b52-b48b-5e42600be45b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:47.354785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0c0cbc6-8017-4b52-b48b-5e42600be45b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:47.355535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0c0cbc6-8017-4b52-b48b-5e42600be45b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:47.355960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0c0cbc6-8017-4b52-b48b-5e42600be45b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:47.356266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8074a1a-82e4-41e2-8ceb-0c15f0abfee3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:47.356760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8074a1a-82e4-41e2-8ceb-0c15f0abfee3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:47.357521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8074a1a-82e4-41e2-8ceb-0c15f0abfee3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:47.357955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8074a1a-82e4-41e2-8ceb-0c15f0abfee3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:47.362133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:47.548419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c8074a1a-82e4-41e2-8ceb-0c15f0abfee3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:47.551475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a0c0cbc6-8017-4b52-b48b-5e42600be45b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:47.556979 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c8074a1a-82e4-41e2-8ceb-0c15f0abfee3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.211433 Jul 27 23:11:47.557539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1179/2534] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:47 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:47.562640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c0d3c7c6-6eb3-43e4-8114-4fc61ae8a4df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:47.563235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c0d3c7c6-6eb3-43e4-8114-4fc61ae8a4df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:47.566601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a0c0cbc6-8017-4b52-b48b-5e42600be45b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.223140 Jul 27 23:11:47.571401 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1356/2535] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:47 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:47.571770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c44066f7-cb74-437b-b316-d06dd36294e8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:47.572373 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c44066f7-cb74-437b-b316-d06dd36294e8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:47.573187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c0d3c7c6-6eb3-43e4-8114-4fc61ae8a4df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:47.573629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c0d3c7c6-6eb3-43e4-8114-4fc61ae8a4df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:47.574384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c0d3c7c6-6eb3-43e4-8114-4fc61ae8a4df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:47.575141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c0d3c7c6-6eb3-43e4-8114-4fc61ae8a4df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:47.578782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c44066f7-cb74-437b-b316-d06dd36294e8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:47.579279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c44066f7-cb74-437b-b316-d06dd36294e8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:47.580037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c44066f7-cb74-437b-b316-d06dd36294e8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:47.580467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c44066f7-cb74-437b-b316-d06dd36294e8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:47.662859 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c0d3c7c6-6eb3-43e4-8114-4fc61ae8a4df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:47.671245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c0d3c7c6-6eb3-43e4-8114-4fc61ae8a4df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:47.672789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c0d3c7c6-6eb3-43e4-8114-4fc61ae8a4df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:47.673931 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c0d3c7c6-6eb3-43e4-8114-4fc61ae8a4df tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.115487 Jul 27 23:11:47.674486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1180/2536] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:47 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:47.729961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c44066f7-cb74-437b-b316-d06dd36294e8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:47.738751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c44066f7-cb74-437b-b316-d06dd36294e8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.170543 Jul 27 23:11:47.739324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1357/2537] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:47 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:48.579164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-df350a82-5831-4136-b4a4-91af548b09a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:48.579766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-df350a82-5831-4136-b4a4-91af548b09a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:48.581800 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=98 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:48.587232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df350a82-5831-4136-b4a4-91af548b09a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:48.587672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df350a82-5831-4136-b4a4-91af548b09a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:48.588349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6299d5c1-613f-481f-be55-7603896f1331 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:48.588821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df350a82-5831-4136-b4a4-91af548b09a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:48.588926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-df350a82-5831-4136-b4a4-91af548b09a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:48.589020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6299d5c1-613f-481f-be55-7603896f1331 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:48.595964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6299d5c1-613f-481f-be55-7603896f1331 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:48.596414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6299d5c1-613f-481f-be55-7603896f1331 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:48.597210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6299d5c1-613f-481f-be55-7603896f1331 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:48.597648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6299d5c1-613f-481f-be55-7603896f1331 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:48.781137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-df350a82-5831-4136-b4a4-91af548b09a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:48.787855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6299d5c1-613f-481f-be55-7603896f1331 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:48.789428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-df350a82-5831-4136-b4a4-91af548b09a1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.214524 Jul 27 23:11:48.790048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1181/2538] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:48 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:48.794611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c8c2b03d-7dae-4486-a873-4fd988598f4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:48.795204 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c8c2b03d-7dae-4486-a873-4fd988598f4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:48.795770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6299d5c1-613f-481f-be55-7603896f1331 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.211391 Jul 27 23:11:48.796504 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1358/2539] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:48 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:48.801131 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8c2b03d-7dae-4486-a873-4fd988598f4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:48.801580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8c2b03d-7dae-4486-a873-4fd988598f4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:48.802330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8c2b03d-7dae-4486-a873-4fd988598f4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:48.802757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8c2b03d-7dae-4486-a873-4fd988598f4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:48.811428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d53de2ab-a542-49db-a443-a05d8aa7ccf1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:48.812027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d53de2ab-a542-49db-a443-a05d8aa7ccf1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:48.817814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d53de2ab-a542-49db-a443-a05d8aa7ccf1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:48.818257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d53de2ab-a542-49db-a443-a05d8aa7ccf1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:48.819035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d53de2ab-a542-49db-a443-a05d8aa7ccf1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:48.819464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d53de2ab-a542-49db-a443-a05d8aa7ccf1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:48.868431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c8c2b03d-7dae-4486-a873-4fd988598f4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:48.877670 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c8c2b03d-7dae-4486-a873-4fd988598f4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:48.879205 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c8c2b03d-7dae-4486-a873-4fd988598f4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:48.880350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c8c2b03d-7dae-4486-a873-4fd988598f4f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.089275 Jul 27 23:11:48.880938 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1182/2540] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:48 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:48.960376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d53de2ab-a542-49db-a443-a05d8aa7ccf1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:48.968194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d53de2ab-a542-49db-a443-a05d8aa7ccf1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.160880 Jul 27 23:11:48.968779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1359/2541] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:48 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:49.811072 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8f0f92de-4337-4460-80cd-15cb2b2dd487 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:49.811706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8f0f92de-4337-4460-80cd-15cb2b2dd487 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:49.816586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-52404147-60fb-44fb-9cec-010b48209d8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:49.817223 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-52404147-60fb-44fb-9cec-010b48209d8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:49.818153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f0f92de-4337-4460-80cd-15cb2b2dd487 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:49.818595 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f0f92de-4337-4460-80cd-15cb2b2dd487 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:49.819394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f0f92de-4337-4460-80cd-15cb2b2dd487 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:49.819775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f0f92de-4337-4460-80cd-15cb2b2dd487 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:49.820584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=98 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:49.824252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52404147-60fb-44fb-9cec-010b48209d8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:49.824726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52404147-60fb-44fb-9cec-010b48209d8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:49.825489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52404147-60fb-44fb-9cec-010b48209d8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:49.825918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52404147-60fb-44fb-9cec-010b48209d8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:50.018855 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8f0f92de-4337-4460-80cd-15cb2b2dd487 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:50.023706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-52404147-60fb-44fb-9cec-010b48209d8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:50.027578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8f0f92de-4337-4460-80cd-15cb2b2dd487 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.220386 Jul 27 23:11:50.028266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1183/2542] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:49 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:50.033481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4ea9aa5e-a5aa-4918-b47d-48f554216c1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:50.034158 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4ea9aa5e-a5aa-4918-b47d-48f554216c1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:50.035436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-52404147-60fb-44fb-9cec-010b48209d8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.222562 Jul 27 23:11:50.040147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4ea9aa5e-a5aa-4918-b47d-48f554216c1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:50.040713 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4ea9aa5e-a5aa-4918-b47d-48f554216c1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:50.041551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4ea9aa5e-a5aa-4918-b47d-48f554216c1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:50.042232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4ea9aa5e-a5aa-4918-b47d-48f554216c1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:50.046098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1360/2543] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:49 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:50.051140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-82d680f0-f14c-45dc-9b5e-af8cdc5124cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:50.052334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-82d680f0-f14c-45dc-9b5e-af8cdc5124cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:50.059036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82d680f0-f14c-45dc-9b5e-af8cdc5124cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:50.059483 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82d680f0-f14c-45dc-9b5e-af8cdc5124cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:50.060282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82d680f0-f14c-45dc-9b5e-af8cdc5124cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:50.060779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82d680f0-f14c-45dc-9b5e-af8cdc5124cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:50.107730 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4ea9aa5e-a5aa-4918-b47d-48f554216c1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:50.116520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4ea9aa5e-a5aa-4918-b47d-48f554216c1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:50.118207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4ea9aa5e-a5aa-4918-b47d-48f554216c1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:50.119364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4ea9aa5e-a5aa-4918-b47d-48f554216c1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.090016 Jul 27 23:11:50.119913 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1184/2544] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:50 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:50.203547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-82d680f0-f14c-45dc-9b5e-af8cdc5124cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:50.211446 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-82d680f0-f14c-45dc-9b5e-af8cdc5124cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.164180 Jul 27 23:11:50.212008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1361/2545] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:51.049624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-eb3b61a5-0f98-453e-a124-f00f25ff2aa9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:51.050232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-eb3b61a5-0f98-453e-a124-f00f25ff2aa9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:51.056853 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb3b61a5-0f98-453e-a124-f00f25ff2aa9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:51.057296 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb3b61a5-0f98-453e-a124-f00f25ff2aa9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:51.058053 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb3b61a5-0f98-453e-a124-f00f25ff2aa9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:51.058604 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb3b61a5-0f98-453e-a124-f00f25ff2aa9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:51.058992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f82bee75-c0df-467c-90e6-549dda06df11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:51.059599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f82bee75-c0df-467c-90e6-549dda06df11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:51.066526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f82bee75-c0df-467c-90e6-549dda06df11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:51.066968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f82bee75-c0df-467c-90e6-549dda06df11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:51.067727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f82bee75-c0df-467c-90e6-549dda06df11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:51.068161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f82bee75-c0df-467c-90e6-549dda06df11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:51.251698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eb3b61a5-0f98-453e-a124-f00f25ff2aa9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:51.255741 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f82bee75-c0df-467c-90e6-549dda06df11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:51.259743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-eb3b61a5-0f98-453e-a124-f00f25ff2aa9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.213972 Jul 27 23:11:51.260301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1185/2546] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:51 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:51.265394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b04cab27-92ff-4401-9f09-6a1bcebe1120 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:51.265989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b04cab27-92ff-4401-9f09-6a1bcebe1120 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:51.266906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f82bee75-c0df-467c-90e6-549dda06df11 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.211692 Jul 27 23:11:51.269159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1362/2547] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:51 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:51.271723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b04cab27-92ff-4401-9f09-6a1bcebe1120 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:51.272167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b04cab27-92ff-4401-9f09-6a1bcebe1120 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:51.272945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b04cab27-92ff-4401-9f09-6a1bcebe1120 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:51.273259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fb956a11-7742-4993-8c3b-ebcb377f4c47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:51.273379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b04cab27-92ff-4401-9f09-6a1bcebe1120 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:51.274099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fb956a11-7742-4993-8c3b-ebcb377f4c47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:51.281503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb956a11-7742-4993-8c3b-ebcb377f4c47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:51.281955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb956a11-7742-4993-8c3b-ebcb377f4c47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:51.282714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb956a11-7742-4993-8c3b-ebcb377f4c47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:51.283148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb956a11-7742-4993-8c3b-ebcb377f4c47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:51.356340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b04cab27-92ff-4401-9f09-6a1bcebe1120 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:51.365569 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b04cab27-92ff-4401-9f09-6a1bcebe1120 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:51.367064 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b04cab27-92ff-4401-9f09-6a1bcebe1120 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:51.368195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b04cab27-92ff-4401-9f09-6a1bcebe1120 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.106863 Jul 27 23:11:51.368780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1186/2548] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:51 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:51.422287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fb956a11-7742-4993-8c3b-ebcb377f4c47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:51.430110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fb956a11-7742-4993-8c3b-ebcb377f4c47 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.161372 Jul 27 23:11:51.430672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1363/2549] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:51 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:52.281617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-660eb0af-e0b2-4640-a1d7-e0187fec0ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:52.282224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-660eb0af-e0b2-4640-a1d7-e0187fec0ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:52.287482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f480fde4-8cd9-4dcc-ad1b-c1233bcd9586 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:52.288090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f480fde4-8cd9-4dcc-ad1b-c1233bcd9586 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:52.288783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-660eb0af-e0b2-4640-a1d7-e0187fec0ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:52.289227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-660eb0af-e0b2-4640-a1d7-e0187fec0ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:52.289984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-660eb0af-e0b2-4640-a1d7-e0187fec0ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:52.290415 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-660eb0af-e0b2-4640-a1d7-e0187fec0ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:52.295071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f480fde4-8cd9-4dcc-ad1b-c1233bcd9586 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:52.295629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f480fde4-8cd9-4dcc-ad1b-c1233bcd9586 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:52.296375 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f480fde4-8cd9-4dcc-ad1b-c1233bcd9586 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:52.296827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f480fde4-8cd9-4dcc-ad1b-c1233bcd9586 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:52.483203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-660eb0af-e0b2-4640-a1d7-e0187fec0ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:52.486800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f480fde4-8cd9-4dcc-ad1b-c1233bcd9586 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:52.491569 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-660eb0af-e0b2-4640-a1d7-e0187fec0ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.213783 Jul 27 23:11:52.492159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1187/2550] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:52 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:52.496570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f4de8350-c7fa-42ee-aa5a-591a4c205d1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:52.497175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f4de8350-c7fa-42ee-aa5a-591a4c205d1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:52.500458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f480fde4-8cd9-4dcc-ad1b-c1233bcd9586 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216334 Jul 27 23:11:52.504717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1364/2551] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:52 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:52.504862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4de8350-c7fa-42ee-aa5a-591a4c205d1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:52.504862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4de8350-c7fa-42ee-aa5a-591a4c205d1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:52.504862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4de8350-c7fa-42ee-aa5a-591a4c205d1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:52.505111 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4de8350-c7fa-42ee-aa5a-591a4c205d1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:52.508779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-78010e55-fe76-4b90-847b-a715affdf8a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:52.509605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-78010e55-fe76-4b90-847b-a715affdf8a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:52.515580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78010e55-fe76-4b90-847b-a715affdf8a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:52.516025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78010e55-fe76-4b90-847b-a715affdf8a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:52.516819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78010e55-fe76-4b90-847b-a715affdf8a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:52.517254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78010e55-fe76-4b90-847b-a715affdf8a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:52.573801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f4de8350-c7fa-42ee-aa5a-591a4c205d1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:52.582284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f4de8350-c7fa-42ee-aa5a-591a4c205d1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:52.583785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f4de8350-c7fa-42ee-aa5a-591a4c205d1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:52.584937 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f4de8350-c7fa-42ee-aa5a-591a4c205d1b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.091823 Jul 27 23:11:52.585677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1188/2552] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:52 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:52.657648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-78010e55-fe76-4b90-847b-a715affdf8a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:52.665519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-78010e55-fe76-4b90-847b-a715affdf8a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.163599 Jul 27 23:11:52.666101 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1365/2553] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:52 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:53.512782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-492d09c2-a199-46aa-9c9e-2f7e5d11493c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:53.514076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-492d09c2-a199-46aa-9c9e-2f7e5d11493c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:53.520727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-492d09c2-a199-46aa-9c9e-2f7e5d11493c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:53.521166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-492d09c2-a199-46aa-9c9e-2f7e5d11493c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:53.521540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9f388cc5-762f-4bf0-a2a9-a76c78786e12 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:53.521946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-492d09c2-a199-46aa-9c9e-2f7e5d11493c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:53.522148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9f388cc5-762f-4bf0-a2a9-a76c78786e12 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:53.522327 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-492d09c2-a199-46aa-9c9e-2f7e5d11493c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:53.528502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f388cc5-762f-4bf0-a2a9-a76c78786e12 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:53.528995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f388cc5-762f-4bf0-a2a9-a76c78786e12 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:53.529740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f388cc5-762f-4bf0-a2a9-a76c78786e12 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:53.530162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f388cc5-762f-4bf0-a2a9-a76c78786e12 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:53.714385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-492d09c2-a199-46aa-9c9e-2f7e5d11493c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:53.717541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9f388cc5-762f-4bf0-a2a9-a76c78786e12 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:53.722594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-492d09c2-a199-46aa-9c9e-2f7e5d11493c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.213669 Jul 27 23:11:53.723161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1189/2554] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:53 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:53.725957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9f388cc5-762f-4bf0-a2a9-a76c78786e12 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.208167 Jul 27 23:11:53.726661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1366/2555] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:53 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:53.737760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1ea11a00-9e7e-4ccc-b14b-d644cd6c1a3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:53.737760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1ea11a00-9e7e-4ccc-b14b-d644cd6c1a3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:53.738038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-774cc70e-f027-46be-959d-46e1a342d22d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:53.738038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-774cc70e-f027-46be-959d-46e1a342d22d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:53.738202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ea11a00-9e7e-4ccc-b14b-d644cd6c1a3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:53.738202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ea11a00-9e7e-4ccc-b14b-d644cd6c1a3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:53.738202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ea11a00-9e7e-4ccc-b14b-d644cd6c1a3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:53.738202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ea11a00-9e7e-4ccc-b14b-d644cd6c1a3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:53.742271 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-774cc70e-f027-46be-959d-46e1a342d22d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:53.742720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-774cc70e-f027-46be-959d-46e1a342d22d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:53.743514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-774cc70e-f027-46be-959d-46e1a342d22d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:53.743942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-774cc70e-f027-46be-959d-46e1a342d22d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:53.825931 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1ea11a00-9e7e-4ccc-b14b-d644cd6c1a3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:53.834319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1ea11a00-9e7e-4ccc-b14b-d644cd6c1a3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:53.835844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1ea11a00-9e7e-4ccc-b14b-d644cd6c1a3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:53.837018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1ea11a00-9e7e-4ccc-b14b-d644cd6c1a3a tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.112949 Jul 27 23:11:53.837777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1190/2556] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:53 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:53.894876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-774cc70e-f027-46be-959d-46e1a342d22d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:53.902696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-774cc70e-f027-46be-959d-46e1a342d22d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.175281 Jul 27 23:11:53.903259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1367/2557] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:53 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:54.745970 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a2f7184f-17fb-4b9b-a293-56ec8c923dde tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:54.746723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a2f7184f-17fb-4b9b-a293-56ec8c923dde tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:54.749479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c54a13cf-6471-462b-8133-5c9bf09c1b77 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:54.750091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c54a13cf-6471-462b-8133-5c9bf09c1b77 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:54.754057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a2f7184f-17fb-4b9b-a293-56ec8c923dde tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:54.754500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a2f7184f-17fb-4b9b-a293-56ec8c923dde tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:54.755286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a2f7184f-17fb-4b9b-a293-56ec8c923dde tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:54.755711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a2f7184f-17fb-4b9b-a293-56ec8c923dde tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:54.756445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c54a13cf-6471-462b-8133-5c9bf09c1b77 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:54.756919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c54a13cf-6471-462b-8133-5c9bf09c1b77 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:54.757670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c54a13cf-6471-462b-8133-5c9bf09c1b77 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:54.758105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c54a13cf-6471-462b-8133-5c9bf09c1b77 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:54.941017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a2f7184f-17fb-4b9b-a293-56ec8c923dde tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:54.948908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a2f7184f-17fb-4b9b-a293-56ec8c923dde tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.206862 Jul 27 23:11:54.949474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1191/2558] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:54 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:54.951935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c54a13cf-6471-462b-8133-5c9bf09c1b77 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:54.953877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d3467efc-1364-4a7e-bb45-bd345d2fd863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:54.954474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d3467efc-1364-4a7e-bb45-bd345d2fd863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:54.960157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3467efc-1364-4a7e-bb45-bd345d2fd863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:54.960484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c54a13cf-6471-462b-8133-5c9bf09c1b77 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215484 Jul 27 23:11:54.960752 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3467efc-1364-4a7e-bb45-bd345d2fd863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:54.964758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1368/2559] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:54 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:54.964918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3467efc-1364-4a7e-bb45-bd345d2fd863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:54.964918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d3467efc-1364-4a7e-bb45-bd345d2fd863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:54.965704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-265333e2-c7f8-4a92-b03c-2f5677873c7a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:54.966815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-265333e2-c7f8-4a92-b03c-2f5677873c7a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:54.973495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-265333e2-c7f8-4a92-b03c-2f5677873c7a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:54.973942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-265333e2-c7f8-4a92-b03c-2f5677873c7a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:54.974700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-265333e2-c7f8-4a92-b03c-2f5677873c7a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:54.975243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-265333e2-c7f8-4a92-b03c-2f5677873c7a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:54.979142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:55.033182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d3467efc-1364-4a7e-bb45-bd345d2fd863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:55.041897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d3467efc-1364-4a7e-bb45-bd345d2fd863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:55.043410 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d3467efc-1364-4a7e-bb45-bd345d2fd863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:55.045555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d3467efc-1364-4a7e-bb45-bd345d2fd863 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.094308 Jul 27 23:11:55.046340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1192/2560] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:54 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:55.315911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-265333e2-c7f8-4a92-b03c-2f5677873c7a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:55.323720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-265333e2-c7f8-4a92-b03c-2f5677873c7a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.361742 Jul 27 23:11:55.324290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1369/2561] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:54 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:55.971084 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-52bfdf41-d866-4206-9aff-623397ccd1c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:55.971820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-52bfdf41-d866-4206-9aff-623397ccd1c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:55.978385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52bfdf41-d866-4206-9aff-623397ccd1c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:55.978829 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52bfdf41-d866-4206-9aff-623397ccd1c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:55.979586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52bfdf41-d866-4206-9aff-623397ccd1c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:55.980014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52bfdf41-d866-4206-9aff-623397ccd1c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:55.981980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-977f95c4-1250-4d9c-ac98-ce9ed55df47e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:55.982616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-977f95c4-1250-4d9c-ac98-ce9ed55df47e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:55.988973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-977f95c4-1250-4d9c-ac98-ce9ed55df47e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:55.989446 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-977f95c4-1250-4d9c-ac98-ce9ed55df47e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:55.990222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-977f95c4-1250-4d9c-ac98-ce9ed55df47e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:55.990648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-977f95c4-1250-4d9c-ac98-ce9ed55df47e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:56.178184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-52bfdf41-d866-4206-9aff-623397ccd1c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:56.182274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-977f95c4-1250-4d9c-ac98-ce9ed55df47e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:56.186135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-52bfdf41-d866-4206-9aff-623397ccd1c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.219637 Jul 27 23:11:56.186704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1193/2562] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:55 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:56.190523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-977f95c4-1250-4d9c-ac98-ce9ed55df47e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.212321 Jul 27 23:11:56.191150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1370/2563] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:55 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:56.191820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f1017463-5429-416d-b7f2-da98a40c29a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:56.192421 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f1017463-5429-416d-b7f2-da98a40c29a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:56.198297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1017463-5429-416d-b7f2-da98a40c29a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:56.198738 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1017463-5429-416d-b7f2-da98a40c29a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:56.199494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1017463-5429-416d-b7f2-da98a40c29a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:56.199920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1017463-5429-416d-b7f2-da98a40c29a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:56.260326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f1017463-5429-416d-b7f2-da98a40c29a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:56.269228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f1017463-5429-416d-b7f2-da98a40c29a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:56.270734 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f1017463-5429-416d-b7f2-da98a40c29a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:56.271868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f1017463-5429-416d-b7f2-da98a40c29a5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.083560 Jul 27 23:11:56.272422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1194/2564] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:56 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:56.344973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-06c04500-0bb9-4810-847a-227e4e0eda08 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:56.345577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-06c04500-0bb9-4810-847a-227e4e0eda08 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:56.351554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06c04500-0bb9-4810-847a-227e4e0eda08 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:56.351993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06c04500-0bb9-4810-847a-227e4e0eda08 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:56.352770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06c04500-0bb9-4810-847a-227e4e0eda08 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:56.353196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-06c04500-0bb9-4810-847a-227e4e0eda08 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:56.485541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-06c04500-0bb9-4810-847a-227e4e0eda08 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:56.493326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-06c04500-0bb9-4810-847a-227e4e0eda08 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.152301 Jul 27 23:11:56.493884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1371/2565] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:56 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:57.207673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e40efef3-ddc2-4677-82c8-ba6d9b70c330 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:57.208277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e40efef3-ddc2-4677-82c8-ba6d9b70c330 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:57.211767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4d72b700-9d26-4baf-ac10-905d9ccacc96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:57.212494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4d72b700-9d26-4baf-ac10-905d9ccacc96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:57.214758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e40efef3-ddc2-4677-82c8-ba6d9b70c330 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:57.215192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e40efef3-ddc2-4677-82c8-ba6d9b70c330 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:57.215940 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e40efef3-ddc2-4677-82c8-ba6d9b70c330 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:57.216907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e40efef3-ddc2-4677-82c8-ba6d9b70c330 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:57.219094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d72b700-9d26-4baf-ac10-905d9ccacc96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:57.219544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d72b700-9d26-4baf-ac10-905d9ccacc96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:57.220297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d72b700-9d26-4baf-ac10-905d9ccacc96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:57.220757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d72b700-9d26-4baf-ac10-905d9ccacc96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:57.410300 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e40efef3-ddc2-4677-82c8-ba6d9b70c330 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:57.412605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:11:57.413069 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4d72b700-9d26-4baf-ac10-905d9ccacc96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:57.420098 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e40efef3-ddc2-4677-82c8-ba6d9b70c330 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.215720 Jul 27 23:11:57.420701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1195/2566] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:57 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:57.422391 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4d72b700-9d26-4baf-ac10-905d9ccacc96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214311 Jul 27 23:11:57.423128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1372/2567] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:57 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:57.425637 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-120c0de8-9000-416f-a947-ec68a661180d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:57.426232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-120c0de8-9000-416f-a947-ec68a661180d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:57.432422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-120c0de8-9000-416f-a947-ec68a661180d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:57.432907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-120c0de8-9000-416f-a947-ec68a661180d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:57.433653 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-120c0de8-9000-416f-a947-ec68a661180d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:57.434082 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-120c0de8-9000-416f-a947-ec68a661180d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:57.493659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-120c0de8-9000-416f-a947-ec68a661180d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:57.501888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-120c0de8-9000-416f-a947-ec68a661180d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:57.503371 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-120c0de8-9000-416f-a947-ec68a661180d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:57.504487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-120c0de8-9000-416f-a947-ec68a661180d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.082891 Jul 27 23:11:57.505061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1196/2568] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:57 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:57.515320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4d18696d-67e7-4918-9681-58d45ebf6d57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:57.515931 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4d18696d-67e7-4918-9681-58d45ebf6d57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:57.521875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d18696d-67e7-4918-9681-58d45ebf6d57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:57.522318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d18696d-67e7-4918-9681-58d45ebf6d57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:57.523067 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d18696d-67e7-4918-9681-58d45ebf6d57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:57.523506 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d18696d-67e7-4918-9681-58d45ebf6d57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:57.646561 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4d18696d-67e7-4918-9681-58d45ebf6d57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:57.654969 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4d18696d-67e7-4918-9681-58d45ebf6d57 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.143957 Jul 27 23:11:57.655526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1373/2569] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:57 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:58.442226 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f15463b0-cec4-45a4-884b-945b18503fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:58.442771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f15463b0-cec4-45a4-884b-945b18503fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:58.443070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-961c1eb0-5298-445b-8539-f71860524d98 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:58.443707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-961c1eb0-5298-445b-8539-f71860524d98 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:58.449430 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f15463b0-cec4-45a4-884b-945b18503fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:58.449883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f15463b0-cec4-45a4-884b-945b18503fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:58.450050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-961c1eb0-5298-445b-8539-f71860524d98 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:58.450493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-961c1eb0-5298-445b-8539-f71860524d98 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:58.450650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f15463b0-cec4-45a4-884b-945b18503fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:58.451085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f15463b0-cec4-45a4-884b-945b18503fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:58.454891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-961c1eb0-5298-445b-8539-f71860524d98 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:58.455342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-961c1eb0-5298-445b-8539-f71860524d98 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:58.652543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-961c1eb0-5298-445b-8539-f71860524d98 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:58.656524 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f15463b0-cec4-45a4-884b-945b18503fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:58.661294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-961c1eb0-5298-445b-8539-f71860524d98 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.221971 Jul 27 23:11:58.661865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1374/2570] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:58 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:58.666214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-02403276-45d2-45d3-a533-ba1676ecf5b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:58.666807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-02403276-45d2-45d3-a533-ba1676ecf5b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:58.674685 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-02403276-45d2-45d3-a533-ba1676ecf5b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:58.675133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-02403276-45d2-45d3-a533-ba1676ecf5b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:58.675878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-02403276-45d2-45d3-a533-ba1676ecf5b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:58.676307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-02403276-45d2-45d3-a533-ba1676ecf5b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:58.678817 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f15463b0-cec4-45a4-884b-945b18503fab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.240450 Jul 27 23:11:58.679394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1197/2571] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:58 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:58.684041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-84e191b8-3b60-4c0a-af26-c0b4811c340c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:58.684646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-84e191b8-3b60-4c0a-af26-c0b4811c340c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:58.690796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-84e191b8-3b60-4c0a-af26-c0b4811c340c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:58.691247 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-84e191b8-3b60-4c0a-af26-c0b4811c340c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:58.692010 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-84e191b8-3b60-4c0a-af26-c0b4811c340c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:58.692511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-84e191b8-3b60-4c0a-af26-c0b4811c340c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:58.770511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-02403276-45d2-45d3-a533-ba1676ecf5b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:58.779461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-02403276-45d2-45d3-a533-ba1676ecf5b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:58.780990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-02403276-45d2-45d3-a533-ba1676ecf5b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:58.782149 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-02403276-45d2-45d3-a533-ba1676ecf5b8 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.119362 Jul 27 23:11:58.782701 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1375/2572] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:58 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:11:58.848882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-84e191b8-3b60-4c0a-af26-c0b4811c340c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:58.857459 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-84e191b8-3b60-4c0a-af26-c0b4811c340c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.176410 Jul 27 23:11:58.858030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1198/2573] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:58 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:59.683749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3b534cda-370a-4254-aefc-bdf0f0da2cc0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:59.684379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3b534cda-370a-4254-aefc-bdf0f0da2cc0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:59.691344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b534cda-370a-4254-aefc-bdf0f0da2cc0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:59.691783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b534cda-370a-4254-aefc-bdf0f0da2cc0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:59.692525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b534cda-370a-4254-aefc-bdf0f0da2cc0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:59.692976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3b534cda-370a-4254-aefc-bdf0f0da2cc0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:59.699027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ebe385bf-0e45-4ba2-9e63-c3eed6dff376 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:59.699632 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ebe385bf-0e45-4ba2-9e63-c3eed6dff376 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:59.706800 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebe385bf-0e45-4ba2-9e63-c3eed6dff376 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:59.707251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebe385bf-0e45-4ba2-9e63-c3eed6dff376 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:59.708023 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebe385bf-0e45-4ba2-9e63-c3eed6dff376 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:59.708451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebe385bf-0e45-4ba2-9e63-c3eed6dff376 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:59.893282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3b534cda-370a-4254-aefc-bdf0f0da2cc0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:59.897311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ebe385bf-0e45-4ba2-9e63-c3eed6dff376 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:11:59.901330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3b534cda-370a-4254-aefc-bdf0f0da2cc0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.221406 Jul 27 23:11:59.901896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1376/2574] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:59 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:11:59.905608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ebe385bf-0e45-4ba2-9e63-c3eed6dff376 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.210346 Jul 27 23:11:59.915525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1199/2575] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:59 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:11:59.915719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7acf3432-ac05-4424-b120-656333cfbe3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:59.915719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7acf3432-ac05-4424-b120-656333cfbe3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:59.915894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ae2de77c-53a4-460b-8047-5e827781fd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:11:59.915894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ae2de77c-53a4-460b-8047-5e827781fd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:11:59.916150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7acf3432-ac05-4424-b120-656333cfbe3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:59.916150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7acf3432-ac05-4424-b120-656333cfbe3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:59.916150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7acf3432-ac05-4424-b120-656333cfbe3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:59.916150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7acf3432-ac05-4424-b120-656333cfbe3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:59.916826 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ae2de77c-53a4-460b-8047-5e827781fd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:59.917271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ae2de77c-53a4-460b-8047-5e827781fd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:11:59.918014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ae2de77c-53a4-460b-8047-5e827781fd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:11:59.920267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ae2de77c-53a4-460b-8047-5e827781fd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:00.001130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7acf3432-ac05-4424-b120-656333cfbe3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:00.009309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7acf3432-ac05-4424-b120-656333cfbe3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:00.010792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7acf3432-ac05-4424-b120-656333cfbe3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:00.011920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7acf3432-ac05-4424-b120-656333cfbe3f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.109124 Jul 27 23:12:00.017288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1377/2576] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:11:59 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:00.072993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ae2de77c-53a4-460b-8047-5e827781fd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:00.080941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ae2de77c-53a4-460b-8047-5e827781fd60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.173847 Jul 27 23:12:00.081495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1200/2577] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:11:59 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:00.922673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3405d9d0-c093-4296-b79a-b19e6ea05f04 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:00.923292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3405d9d0-c093-4296-b79a-b19e6ea05f04 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:00.926678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a7af38c6-3579-4bff-850e-e745d21d028d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:00.927282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a7af38c6-3579-4bff-850e-e745d21d028d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:00.929841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3405d9d0-c093-4296-b79a-b19e6ea05f04 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:00.930299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3405d9d0-c093-4296-b79a-b19e6ea05f04 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:00.931058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3405d9d0-c093-4296-b79a-b19e6ea05f04 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:00.931488 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3405d9d0-c093-4296-b79a-b19e6ea05f04 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:00.933810 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a7af38c6-3579-4bff-850e-e745d21d028d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:00.934252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a7af38c6-3579-4bff-850e-e745d21d028d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:00.935510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a7af38c6-3579-4bff-850e-e745d21d028d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:00.935933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a7af38c6-3579-4bff-850e-e745d21d028d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:01.118534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3405d9d0-c093-4296-b79a-b19e6ea05f04 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:01.125777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a7af38c6-3579-4bff-850e-e745d21d028d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:01.127081 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3405d9d0-c093-4296-b79a-b19e6ea05f04 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.208296 Jul 27 23:12:01.127662 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1378/2578] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:00 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:01.132262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f30ecf44-c418-4c9e-a88f-6269c1a67759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:01.132915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f30ecf44-c418-4c9e-a88f-6269c1a67759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:01.135594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a7af38c6-3579-4bff-850e-e745d21d028d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.212555 Jul 27 23:12:01.136778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1201/2579] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:00 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:01.140675 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f30ecf44-c418-4c9e-a88f-6269c1a67759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:01.140675 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f30ecf44-c418-4c9e-a88f-6269c1a67759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:01.141475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f30ecf44-c418-4c9e-a88f-6269c1a67759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:01.141921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f30ecf44-c418-4c9e-a88f-6269c1a67759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:01.145056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c230e883-f7ad-48cc-afdb-d47087ef9fcd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:01.145668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c230e883-f7ad-48cc-afdb-d47087ef9fcd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:01.152375 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c230e883-f7ad-48cc-afdb-d47087ef9fcd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:01.153255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c230e883-f7ad-48cc-afdb-d47087ef9fcd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:01.155723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c230e883-f7ad-48cc-afdb-d47087ef9fcd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:01.156161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c230e883-f7ad-48cc-afdb-d47087ef9fcd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:01.217975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f30ecf44-c418-4c9e-a88f-6269c1a67759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:01.226856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f30ecf44-c418-4c9e-a88f-6269c1a67759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:01.228491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f30ecf44-c418-4c9e-a88f-6269c1a67759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:01.229664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f30ecf44-c418-4c9e-a88f-6269c1a67759 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.101098 Jul 27 23:12:01.230224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1379/2580] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:01 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:01.299456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c230e883-f7ad-48cc-afdb-d47087ef9fcd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:01.307289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c230e883-f7ad-48cc-afdb-d47087ef9fcd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.169350 Jul 27 23:12:01.307849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1202/2581] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:01 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:02.148814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2010dd7f-1192-4cd1-8e47-df1c0714a99e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:02.149426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2010dd7f-1192-4cd1-8e47-df1c0714a99e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:02.158266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e26c03e8-87e1-43b0-ae1b-f2d0c0fb9f6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:02.158820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2010dd7f-1192-4cd1-8e47-df1c0714a99e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:02.158941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e26c03e8-87e1-43b0-ae1b-f2d0c0fb9f6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:02.159265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2010dd7f-1192-4cd1-8e47-df1c0714a99e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:02.160024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2010dd7f-1192-4cd1-8e47-df1c0714a99e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:02.160450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2010dd7f-1192-4cd1-8e47-df1c0714a99e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:02.165300 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e26c03e8-87e1-43b0-ae1b-f2d0c0fb9f6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:02.165773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e26c03e8-87e1-43b0-ae1b-f2d0c0fb9f6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:02.166527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e26c03e8-87e1-43b0-ae1b-f2d0c0fb9f6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:02.166959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e26c03e8-87e1-43b0-ae1b-f2d0c0fb9f6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:02.347450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2010dd7f-1192-4cd1-8e47-df1c0714a99e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:02.354083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e26c03e8-87e1-43b0-ae1b-f2d0c0fb9f6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:02.355419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2010dd7f-1192-4cd1-8e47-df1c0714a99e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.210472 Jul 27 23:12:02.356334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1380/2582] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:02 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:02.360838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1141f424-3c0e-4506-9a8d-d661965fa465 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:02.361443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1141f424-3c0e-4506-9a8d-d661965fa465 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:02.362414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e26c03e8-87e1-43b0-ae1b-f2d0c0fb9f6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.208547 Jul 27 23:12:02.362976 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1203/2583] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:02 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:02.373217 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1141f424-3c0e-4506-9a8d-d661965fa465 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:02.373394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ce81adc3-a8b0-4dea-abd3-f4740e5cddde tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:02.373514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1141f424-3c0e-4506-9a8d-d661965fa465 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:02.373608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ce81adc3-a8b0-4dea-abd3-f4740e5cddde tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:02.373706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1141f424-3c0e-4506-9a8d-d661965fa465 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:02.373706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1141f424-3c0e-4506-9a8d-d661965fa465 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:02.374492 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce81adc3-a8b0-4dea-abd3-f4740e5cddde tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:02.374947 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce81adc3-a8b0-4dea-abd3-f4740e5cddde tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:02.375713 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce81adc3-a8b0-4dea-abd3-f4740e5cddde tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:02.376149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce81adc3-a8b0-4dea-abd3-f4740e5cddde tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:02.451299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1141f424-3c0e-4506-9a8d-d661965fa465 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:02.459760 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1141f424-3c0e-4506-9a8d-d661965fa465 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:02.461295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1141f424-3c0e-4506-9a8d-d661965fa465 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:02.462415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1141f424-3c0e-4506-9a8d-d661965fa465 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.105324 Jul 27 23:12:02.462968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1381/2584] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:02 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:02.521171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ce81adc3-a8b0-4dea-abd3-f4740e5cddde tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:02.529100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ce81adc3-a8b0-4dea-abd3-f4740e5cddde tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.165202 Jul 27 23:12:02.529671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1204/2585] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:02 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:03.376970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7201e38f-46df-43a1-ad60-4322e3edf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:03.377586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7201e38f-46df-43a1-ad60-4322e3edf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:03.384054 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7201e38f-46df-43a1-ad60-4322e3edf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:03.384228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2539adda-e0a3-4e48-ad67-953251f85b7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:03.384651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7201e38f-46df-43a1-ad60-4322e3edf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:03.384771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2539adda-e0a3-4e48-ad67-953251f85b7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:03.385280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7201e38f-46df-43a1-ad60-4322e3edf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:03.385717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7201e38f-46df-43a1-ad60-4322e3edf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:03.391153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2539adda-e0a3-4e48-ad67-953251f85b7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:03.391635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2539adda-e0a3-4e48-ad67-953251f85b7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:03.392394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2539adda-e0a3-4e48-ad67-953251f85b7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:03.392849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2539adda-e0a3-4e48-ad67-953251f85b7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:03.571541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7201e38f-46df-43a1-ad60-4322e3edf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:03.578959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2539adda-e0a3-4e48-ad67-953251f85b7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:03.580032 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7201e38f-46df-43a1-ad60-4322e3edf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.206908 Jul 27 23:12:03.580623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1382/2586] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:03 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:03.585051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-447a6e96-4acf-4e24-819c-63d1a0e3964b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:03.585654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-447a6e96-4acf-4e24-819c-63d1a0e3964b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:03.587282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2539adda-e0a3-4e48-ad67-953251f85b7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.206890 Jul 27 23:12:03.588005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1205/2587] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:03 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:03.592142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-447a6e96-4acf-4e24-819c-63d1a0e3964b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:03.592617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-447a6e96-4acf-4e24-819c-63d1a0e3964b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:03.592945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-60b145a6-48bd-40c8-9b70-136458982ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:03.593385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-447a6e96-4acf-4e24-819c-63d1a0e3964b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:03.593577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-60b145a6-48bd-40c8-9b70-136458982ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:03.593825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-447a6e96-4acf-4e24-819c-63d1a0e3964b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:03.599310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60b145a6-48bd-40c8-9b70-136458982ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:03.599850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60b145a6-48bd-40c8-9b70-136458982ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:03.600633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60b145a6-48bd-40c8-9b70-136458982ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:03.601069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60b145a6-48bd-40c8-9b70-136458982ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:03.678961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-447a6e96-4acf-4e24-819c-63d1a0e3964b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:03.687277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-447a6e96-4acf-4e24-819c-63d1a0e3964b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:03.688809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-447a6e96-4acf-4e24-819c-63d1a0e3964b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:03.689942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-447a6e96-4acf-4e24-819c-63d1a0e3964b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.108412 Jul 27 23:12:03.690501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1383/2588] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:03 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:03.744505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-60b145a6-48bd-40c8-9b70-136458982ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:03.752384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-60b145a6-48bd-40c8-9b70-136458982ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.163629 Jul 27 23:12:03.752999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1206/2589] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:03 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:04.610752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-59829a3b-842e-4766-bbb2-a0e8543b4391 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:04.611439 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-59829a3b-842e-4766-bbb2-a0e8543b4391 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:04.615164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3c1ee970-3e0a-48f7-a0a1-dbcabcc0ae61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:04.615771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3c1ee970-3e0a-48f7-a0a1-dbcabcc0ae61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:04.617909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-59829a3b-842e-4766-bbb2-a0e8543b4391 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:04.618351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-59829a3b-842e-4766-bbb2-a0e8543b4391 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:04.619098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-59829a3b-842e-4766-bbb2-a0e8543b4391 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:04.619525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-59829a3b-842e-4766-bbb2-a0e8543b4391 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:04.622126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c1ee970-3e0a-48f7-a0a1-dbcabcc0ae61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:04.622592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c1ee970-3e0a-48f7-a0a1-dbcabcc0ae61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:04.623356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c1ee970-3e0a-48f7-a0a1-dbcabcc0ae61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:04.623789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c1ee970-3e0a-48f7-a0a1-dbcabcc0ae61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:04.808955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-59829a3b-842e-4766-bbb2-a0e8543b4391 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:04.813074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3c1ee970-3e0a-48f7-a0a1-dbcabcc0ae61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:04.816772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-59829a3b-842e-4766-bbb2-a0e8543b4391 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.210669 Jul 27 23:12:04.817337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1384/2590] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:04 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:04.820951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3c1ee970-3e0a-48f7-a0a1-dbcabcc0ae61 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.209591 Jul 27 23:12:04.821655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1207/2591] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:04 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:04.821854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f88018a1-7beb-4d6a-ae20-9c1b55a202e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:04.822707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f88018a1-7beb-4d6a-ae20-9c1b55a202e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:04.828534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f88018a1-7beb-4d6a-ae20-9c1b55a202e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:04.829001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f88018a1-7beb-4d6a-ae20-9c1b55a202e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:04.829746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f88018a1-7beb-4d6a-ae20-9c1b55a202e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:04.830177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f88018a1-7beb-4d6a-ae20-9c1b55a202e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:04.837137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c8a09808-a9aa-41ef-970f-bf20fda93429 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:04.837740 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c8a09808-a9aa-41ef-970f-bf20fda93429 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:04.844069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8a09808-a9aa-41ef-970f-bf20fda93429 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:04.844514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8a09808-a9aa-41ef-970f-bf20fda93429 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:04.845320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8a09808-a9aa-41ef-970f-bf20fda93429 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:04.845781 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8a09808-a9aa-41ef-970f-bf20fda93429 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:04.892728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f88018a1-7beb-4d6a-ae20-9c1b55a202e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:04.894861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:04.902673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f88018a1-7beb-4d6a-ae20-9c1b55a202e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:04.904720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f88018a1-7beb-4d6a-ae20-9c1b55a202e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:04.905895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f88018a1-7beb-4d6a-ae20-9c1b55a202e0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.087655 Jul 27 23:12:04.906448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1385/2592] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:04 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:04.987495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c8a09808-a9aa-41ef-970f-bf20fda93429 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:04.995315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c8a09808-a9aa-41ef-970f-bf20fda93429 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.161757 Jul 27 23:12:04.995875 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1208/2593] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:04 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:05.837897 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-52c3b01b-a6c0-49b6-a67e-e26261d3e45a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:05.838550 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-52c3b01b-a6c0-49b6-a67e-e26261d3e45a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:05.843357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0e61b154-25b8-4163-a7b3-9319ae2e67e0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:05.843993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0e61b154-25b8-4163-a7b3-9319ae2e67e0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:05.845279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52c3b01b-a6c0-49b6-a67e-e26261d3e45a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:05.845717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52c3b01b-a6c0-49b6-a67e-e26261d3e45a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:05.846497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52c3b01b-a6c0-49b6-a67e-e26261d3e45a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:05.846931 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52c3b01b-a6c0-49b6-a67e-e26261d3e45a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:05.850533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e61b154-25b8-4163-a7b3-9319ae2e67e0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:05.850980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e61b154-25b8-4163-a7b3-9319ae2e67e0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:05.851734 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e61b154-25b8-4163-a7b3-9319ae2e67e0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:05.852161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e61b154-25b8-4163-a7b3-9319ae2e67e0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:06.045507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-52c3b01b-a6c0-49b6-a67e-e26261d3e45a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:06.049222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0e61b154-25b8-4163-a7b3-9319ae2e67e0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:06.053373 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-52c3b01b-a6c0-49b6-a67e-e26261d3e45a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.219243 Jul 27 23:12:06.053929 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1386/2594] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:05 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:06.057267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0e61b154-25b8-4163-a7b3-9319ae2e67e0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217748 Jul 27 23:12:06.057951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1209/2595] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:05 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:06.058277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a4ff7aee-46b9-4599-8974-e2c44915820b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:06.058870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a4ff7aee-46b9-4599-8974-e2c44915820b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:06.066412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-60690e6b-dd40-4f65-96c0-7a3e6468aef6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:06.067008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-60690e6b-dd40-4f65-96c0-7a3e6468aef6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:06.070886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4ff7aee-46b9-4599-8974-e2c44915820b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:06.071335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4ff7aee-46b9-4599-8974-e2c44915820b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:06.072096 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4ff7aee-46b9-4599-8974-e2c44915820b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:06.072525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4ff7aee-46b9-4599-8974-e2c44915820b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:06.072664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60690e6b-dd40-4f65-96c0-7a3e6468aef6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:06.073107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60690e6b-dd40-4f65-96c0-7a3e6468aef6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:06.073853 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60690e6b-dd40-4f65-96c0-7a3e6468aef6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:06.074284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60690e6b-dd40-4f65-96c0-7a3e6468aef6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:06.139995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a4ff7aee-46b9-4599-8974-e2c44915820b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:06.148360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a4ff7aee-46b9-4599-8974-e2c44915820b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:06.149892 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a4ff7aee-46b9-4599-8974-e2c44915820b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:06.151024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a4ff7aee-46b9-4599-8974-e2c44915820b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.096199 Jul 27 23:12:06.151772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1387/2596] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:06 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:06.222010 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-60690e6b-dd40-4f65-96c0-7a3e6468aef6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:06.229870 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-60690e6b-dd40-4f65-96c0-7a3e6468aef6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.166955 Jul 27 23:12:06.230428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1210/2597] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:06 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:07.075336 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-037705da-0cbf-46e3-8b96-cf632bc65777 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:07.076530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-037705da-0cbf-46e3-8b96-cf632bc65777 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:07.079208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b7c4b9fd-2173-4bba-ac0a-71b090600504 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:07.079824 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b7c4b9fd-2173-4bba-ac0a-71b090600504 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:07.083023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-037705da-0cbf-46e3-8b96-cf632bc65777 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:07.083447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-037705da-0cbf-46e3-8b96-cf632bc65777 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:07.084210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-037705da-0cbf-46e3-8b96-cf632bc65777 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:07.084643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-037705da-0cbf-46e3-8b96-cf632bc65777 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:07.086403 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7c4b9fd-2173-4bba-ac0a-71b090600504 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:07.086859 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7c4b9fd-2173-4bba-ac0a-71b090600504 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:07.087611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7c4b9fd-2173-4bba-ac0a-71b090600504 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:07.088046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7c4b9fd-2173-4bba-ac0a-71b090600504 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:07.275231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-037705da-0cbf-46e3-8b96-cf632bc65777 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:07.279315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b7c4b9fd-2173-4bba-ac0a-71b090600504 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:07.283211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-037705da-0cbf-46e3-8b96-cf632bc65777 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.211817 Jul 27 23:12:07.283788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1388/2598] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:07 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:07.287693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b7c4b9fd-2173-4bba-ac0a-71b090600504 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.212844 Jul 27 23:12:07.288204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-995ddf38-d5e9-4436-8c4d-82cb1a1c6312 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:07.297443 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1211/2599] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:07 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:07.297642 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-995ddf38-d5e9-4436-8c4d-82cb1a1c6312 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:07.297736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cd4216da-f586-4589-9ed5-d823bf42b468 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:07.297736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cd4216da-f586-4589-9ed5-d823bf42b468 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:07.297905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-995ddf38-d5e9-4436-8c4d-82cb1a1c6312 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:07.297905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-995ddf38-d5e9-4436-8c4d-82cb1a1c6312 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:07.297905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-995ddf38-d5e9-4436-8c4d-82cb1a1c6312 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:07.297905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-995ddf38-d5e9-4436-8c4d-82cb1a1c6312 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:07.300782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd4216da-f586-4589-9ed5-d823bf42b468 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:07.301303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd4216da-f586-4589-9ed5-d823bf42b468 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:07.302148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd4216da-f586-4589-9ed5-d823bf42b468 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:07.302591 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd4216da-f586-4589-9ed5-d823bf42b468 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:07.317942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:07.365831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-995ddf38-d5e9-4436-8c4d-82cb1a1c6312 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:07.374759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-995ddf38-d5e9-4436-8c4d-82cb1a1c6312 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:07.376270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-995ddf38-d5e9-4436-8c4d-82cb1a1c6312 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:07.377440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-995ddf38-d5e9-4436-8c4d-82cb1a1c6312 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.092757 Jul 27 23:12:07.377999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1389/2600] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:07 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:07.450282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cd4216da-f586-4589-9ed5-d823bf42b468 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:07.458155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cd4216da-f586-4589-9ed5-d823bf42b468 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.168559 Jul 27 23:12:07.458717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1212/2601] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:07 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:08.304974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-122de08e-336b-4322-9e46-aeda4c727f03 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:08.305577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-122de08e-336b-4322-9e46-aeda4c727f03 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:08.309127 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-54372a99-410f-4e0b-ae27-ddd706c40fb4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:08.310385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-54372a99-410f-4e0b-ae27-ddd706c40fb4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:08.312603 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-122de08e-336b-4322-9e46-aeda4c727f03 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:08.313049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-122de08e-336b-4322-9e46-aeda4c727f03 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:08.313800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-122de08e-336b-4322-9e46-aeda4c727f03 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:08.314224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-122de08e-336b-4322-9e46-aeda4c727f03 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:08.316911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54372a99-410f-4e0b-ae27-ddd706c40fb4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:08.317373 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54372a99-410f-4e0b-ae27-ddd706c40fb4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:08.318137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54372a99-410f-4e0b-ae27-ddd706c40fb4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:08.318571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54372a99-410f-4e0b-ae27-ddd706c40fb4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:08.510787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-122de08e-336b-4322-9e46-aeda4c727f03 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:08.514674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-54372a99-410f-4e0b-ae27-ddd706c40fb4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:08.519569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-122de08e-336b-4322-9e46-aeda4c727f03 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.218365 Jul 27 23:12:08.520148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1390/2602] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:08 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:08.522780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-54372a99-410f-4e0b-ae27-ddd706c40fb4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217171 Jul 27 23:12:08.523486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1213/2603] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:08 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:08.534406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-14b2a04f-1f64-4f00-9b54-d87631462b97 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:08.534406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-14b2a04f-1f64-4f00-9b54-d87631462b97 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:08.534690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-22f77a19-bdc7-4801-8a67-f506e505b14f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:08.534690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-22f77a19-bdc7-4801-8a67-f506e505b14f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:08.534859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14b2a04f-1f64-4f00-9b54-d87631462b97 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:08.534859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14b2a04f-1f64-4f00-9b54-d87631462b97 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:08.534859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14b2a04f-1f64-4f00-9b54-d87631462b97 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:08.534859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-14b2a04f-1f64-4f00-9b54-d87631462b97 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:08.535163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-22f77a19-bdc7-4801-8a67-f506e505b14f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:08.535163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-22f77a19-bdc7-4801-8a67-f506e505b14f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:08.535163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-22f77a19-bdc7-4801-8a67-f506e505b14f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:08.535393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-22f77a19-bdc7-4801-8a67-f506e505b14f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:08.614267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-14b2a04f-1f64-4f00-9b54-d87631462b97 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:08.623117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-14b2a04f-1f64-4f00-9b54-d87631462b97 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:08.624647 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-14b2a04f-1f64-4f00-9b54-d87631462b97 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:08.625780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-14b2a04f-1f64-4f00-9b54-d87631462b97 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.104701 Jul 27 23:12:08.626341 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1391/2604] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:08 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:08.682069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-22f77a19-bdc7-4801-8a67-f506e505b14f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:08.690572 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-22f77a19-bdc7-4801-8a67-f506e505b14f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.166326 Jul 27 23:12:08.691136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1214/2605] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:08 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:09.541620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-add1824e-1f30-454b-a5d5-adc4c2e0ebaa tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:09.542235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-add1824e-1f30-454b-a5d5-adc4c2e0ebaa tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:09.543179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-19da93c2-a0be-4529-bb37-c63d861d2556 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:09.543790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-19da93c2-a0be-4529-bb37-c63d861d2556 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:09.549290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-add1824e-1f30-454b-a5d5-adc4c2e0ebaa tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:09.549739 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-add1824e-1f30-454b-a5d5-adc4c2e0ebaa tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:09.550498 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-add1824e-1f30-454b-a5d5-adc4c2e0ebaa tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:09.550781 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19da93c2-a0be-4529-bb37-c63d861d2556 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:09.550915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-add1824e-1f30-454b-a5d5-adc4c2e0ebaa tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:09.551225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19da93c2-a0be-4529-bb37-c63d861d2556 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:09.551983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19da93c2-a0be-4529-bb37-c63d861d2556 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:09.552418 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19da93c2-a0be-4529-bb37-c63d861d2556 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:09.744293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-add1824e-1f30-454b-a5d5-adc4c2e0ebaa tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:09.747564 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-19da93c2-a0be-4529-bb37-c63d861d2556 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:09.753068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-add1824e-1f30-454b-a5d5-adc4c2e0ebaa tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215312 Jul 27 23:12:09.753732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1392/2606] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:09 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:09.757354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-19da93c2-a0be-4529-bb37-c63d861d2556 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217870 Jul 27 23:12:09.758074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1215/2607] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:09 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:09.759627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1522ca1d-9546-434d-b0b0-614301106703 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:09.760229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1522ca1d-9546-434d-b0b0-614301106703 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:09.764037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f6292cc8-6c52-40ac-9785-2e677aa9e90a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:09.764682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f6292cc8-6c52-40ac-9785-2e677aa9e90a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:09.766946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1522ca1d-9546-434d-b0b0-614301106703 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:09.767754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1522ca1d-9546-434d-b0b0-614301106703 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:09.769236 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1522ca1d-9546-434d-b0b0-614301106703 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:09.769729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1522ca1d-9546-434d-b0b0-614301106703 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:09.770742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6292cc8-6c52-40ac-9785-2e677aa9e90a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:09.771197 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6292cc8-6c52-40ac-9785-2e677aa9e90a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:09.771969 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6292cc8-6c52-40ac-9785-2e677aa9e90a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:09.772402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6292cc8-6c52-40ac-9785-2e677aa9e90a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:09.856065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1522ca1d-9546-434d-b0b0-614301106703 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:09.865623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1522ca1d-9546-434d-b0b0-614301106703 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:09.867143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1522ca1d-9546-434d-b0b0-614301106703 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:09.868284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1522ca1d-9546-434d-b0b0-614301106703 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.113646 Jul 27 23:12:09.868876 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1393/2608] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:09 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:09.923226 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f6292cc8-6c52-40ac-9785-2e677aa9e90a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:09.931095 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f6292cc8-6c52-40ac-9785-2e677aa9e90a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.172246 Jul 27 23:12:09.931660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1216/2609] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:09 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:10.783554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b7a06a5b-bc5e-468a-82db-714336fbb9a1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:10.784195 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b7a06a5b-bc5e-468a-82db-714336fbb9a1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:10.789413 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8f8ec26f-45bf-470e-86fc-702c2262df63 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:10.790013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8f8ec26f-45bf-470e-86fc-702c2262df63 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:10.790841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7a06a5b-bc5e-468a-82db-714336fbb9a1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:10.791287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7a06a5b-bc5e-468a-82db-714336fbb9a1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:10.792042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7a06a5b-bc5e-468a-82db-714336fbb9a1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:10.792474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7a06a5b-bc5e-468a-82db-714336fbb9a1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:10.796446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f8ec26f-45bf-470e-86fc-702c2262df63 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:10.796911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f8ec26f-45bf-470e-86fc-702c2262df63 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:10.797677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f8ec26f-45bf-470e-86fc-702c2262df63 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:10.798115 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8f8ec26f-45bf-470e-86fc-702c2262df63 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:10.982243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b7a06a5b-bc5e-468a-82db-714336fbb9a1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:10.987052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8f8ec26f-45bf-470e-86fc-702c2262df63 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:10.990403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b7a06a5b-bc5e-468a-82db-714336fbb9a1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.210692 Jul 27 23:12:10.990969 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1394/2610] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:10 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:10.995520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b4355067-a432-4a3d-862f-9cbfa79db95b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:10.995948 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8f8ec26f-45bf-470e-86fc-702c2262df63 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.210225 Jul 27 23:12:10.996137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b4355067-a432-4a3d-862f-9cbfa79db95b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:11.004691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1217/2611] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:10 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:11.004691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-200d5e91-47a6-41b7-954e-38f77ab44435 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:11.004691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-200d5e91-47a6-41b7-954e-38f77ab44435 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:11.005046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b4355067-a432-4a3d-862f-9cbfa79db95b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:11.005046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b4355067-a432-4a3d-862f-9cbfa79db95b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:11.005046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b4355067-a432-4a3d-862f-9cbfa79db95b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:11.005046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b4355067-a432-4a3d-862f-9cbfa79db95b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:11.008405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-200d5e91-47a6-41b7-954e-38f77ab44435 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:11.008935 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-200d5e91-47a6-41b7-954e-38f77ab44435 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:11.009772 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-200d5e91-47a6-41b7-954e-38f77ab44435 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:11.010264 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-200d5e91-47a6-41b7-954e-38f77ab44435 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:11.072518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b4355067-a432-4a3d-862f-9cbfa79db95b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:11.081094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b4355067-a432-4a3d-862f-9cbfa79db95b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:11.082574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b4355067-a432-4a3d-862f-9cbfa79db95b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:11.083700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b4355067-a432-4a3d-862f-9cbfa79db95b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.091841 Jul 27 23:12:11.084248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1395/2612] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:10 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:11.154037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-200d5e91-47a6-41b7-954e-38f77ab44435 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:11.162186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-200d5e91-47a6-41b7-954e-38f77ab44435 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.164396 Jul 27 23:12:11.162760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1218/2613] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:10 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:12.011319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-99aeea3b-139f-4380-898b-79f876ccf513 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:12.011962 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-99aeea3b-139f-4380-898b-79f876ccf513 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:12.018250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-94403239-45ef-4575-a47f-6d1e05b5b404 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:12.018886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-94403239-45ef-4575-a47f-6d1e05b5b404 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:12.019015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99aeea3b-139f-4380-898b-79f876ccf513 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:12.019437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99aeea3b-139f-4380-898b-79f876ccf513 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:12.020224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99aeea3b-139f-4380-898b-79f876ccf513 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:12.020689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99aeea3b-139f-4380-898b-79f876ccf513 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:12.025236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94403239-45ef-4575-a47f-6d1e05b5b404 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:12.025676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94403239-45ef-4575-a47f-6d1e05b5b404 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:12.026424 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94403239-45ef-4575-a47f-6d1e05b5b404 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:12.026850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94403239-45ef-4575-a47f-6d1e05b5b404 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:12.209300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-99aeea3b-139f-4380-898b-79f876ccf513 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:12.215505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-94403239-45ef-4575-a47f-6d1e05b5b404 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:12.217549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-99aeea3b-139f-4380-898b-79f876ccf513 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.210027 Jul 27 23:12:12.218119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1396/2614] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:12 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:12.222511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fd19367c-778b-46bf-8013-e47e08a4c13f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:12.223117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fd19367c-778b-46bf-8013-e47e08a4c13f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:12.223520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-94403239-45ef-4575-a47f-6d1e05b5b404 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.209015 Jul 27 23:12:12.224211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1219/2615] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:12 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:12.228353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-de3a0344-1b96-41ba-beb3-0f2e7c35025b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:12.228968 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-de3a0344-1b96-41ba-beb3-0f2e7c35025b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:12.234846 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de3a0344-1b96-41ba-beb3-0f2e7c35025b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:12.235284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de3a0344-1b96-41ba-beb3-0f2e7c35025b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:12.236026 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de3a0344-1b96-41ba-beb3-0f2e7c35025b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:12.236455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de3a0344-1b96-41ba-beb3-0f2e7c35025b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:12.241632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd19367c-778b-46bf-8013-e47e08a4c13f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:12.242084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd19367c-778b-46bf-8013-e47e08a4c13f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:12.242849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd19367c-778b-46bf-8013-e47e08a4c13f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:12.243286 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd19367c-778b-46bf-8013-e47e08a4c13f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:12.324994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fd19367c-778b-46bf-8013-e47e08a4c13f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:12.333808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fd19367c-778b-46bf-8013-e47e08a4c13f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:12.335300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fd19367c-778b-46bf-8013-e47e08a4c13f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:12.336417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fd19367c-778b-46bf-8013-e47e08a4c13f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 200 len: 1444 microversion: 2.20 time: 0.117404 Jul 27 23:12:12.337188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1397/2616] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:12 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:12.358308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-45728ff8-ccda-4563-b189-6b8dc41318ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '.version_select at 0x7f696e9bd670>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:12.381841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-45728ff8-ccda-4563-b189-6b8dc41318ed tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650605654" status: 204 len: 0 microversion: 2.20 time: 0.027174 Jul 27 23:12:12.385804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1398/2617] 10.222.0.47 () {60 vars in 1262 bytes} [Wed Jul 27 23:12:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650605654 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 27 23:12:12.390358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-de3a0344-1b96-41ba-beb3-0f2e7c35025b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:12.398331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-de3a0344-1b96-41ba-beb3-0f2e7c35025b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.173336 Jul 27 23:12:12.398904 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1220/2618] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:12 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:13.143321 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4d95c276-0ee1-4140-a6ba-4662f41ec44b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Action: 'create', calling method: .version_select at 0x7f696a106c10>, body: {"keypair": {"name": "tempest-keypair-1863141698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFszd72qlw20+wY036DG7mGq5Hi/bwDX4C1w8oxgndo5wUc/2aLeXMgNJ3JZoIhmxiidLhP/jAFikqPSIG83UEfDeNO5tFp0lMHlKzyL671XX/Q/OS+nCmH16nEfIdNEA=="}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:12:13.162826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-4d95c276-0ee1-4140-a6ba-4662f41ec44b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Getting quotas for project 0d65941ddb4346e0b3fdc6b751a6aa07. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 23:12:13.167056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-4d95c276-0ee1-4140-a6ba-4662f41ec44b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Getting quotas for user 51db745daefd448b80630ef1bceca4c4 and project 0d65941ddb4346e0b3fdc6b751a6aa07. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 23:12:13.190468 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4d95c276-0ee1-4140-a6ba-4662f41ec44b tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051032 Jul 27 23:12:13.191284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1399/2619] 10.222.0.47 () {62 vars in 1200 bytes} [Wed Jul 27 23:12:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 27 23:12:13.239361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2dd8d11c-9c36-415e-bae9-b39956c2d36f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:13.239967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2dd8d11c-9c36-415e-bae9-b39956c2d36f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:13.246721 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2dd8d11c-9c36-415e-bae9-b39956c2d36f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:13.247855 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2dd8d11c-9c36-415e-bae9-b39956c2d36f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:13.248143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b39ddcf7-3404-40d2-a9f5-e424ad2f9125 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:13.248653 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2dd8d11c-9c36-415e-bae9-b39956c2d36f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:13.249077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2dd8d11c-9c36-415e-bae9-b39956c2d36f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:13.251227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b39ddcf7-3404-40d2-a9f5-e424ad2f9125 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:13.259543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b39ddcf7-3404-40d2-a9f5-e424ad2f9125 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:13.260139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b39ddcf7-3404-40d2-a9f5-e424ad2f9125 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:13.261337 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b39ddcf7-3404-40d2-a9f5-e424ad2f9125 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:13.262161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b39ddcf7-3404-40d2-a9f5-e424ad2f9125 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:13.681313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b39ddcf7-3404-40d2-a9f5-e424ad2f9125 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:13.686656 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2dd8d11c-9c36-415e-bae9-b39956c2d36f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:13.690908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b39ddcf7-3404-40d2-a9f5-e424ad2f9125 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.449236 Jul 27 23:12:13.704646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1400/2620] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:13 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:13.705227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2dd8d11c-9c36-415e-bae9-b39956c2d36f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.460252 Jul 27 23:12:13.706351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1221/2621] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:13 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:13.709686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-000ebc1a-83b5-4866-b522-4e40b80abbb4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:13.710192 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-000ebc1a-83b5-4866-b522-4e40b80abbb4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:13.716717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4cdb4c1e-a83a-4041-80e6-628f32916266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:13.717505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4cdb4c1e-a83a-4041-80e6-628f32916266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:13.717996 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-000ebc1a-83b5-4866-b522-4e40b80abbb4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:13.718593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-000ebc1a-83b5-4866-b522-4e40b80abbb4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:13.725283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4cdb4c1e-a83a-4041-80e6-628f32916266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:13.725732 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4cdb4c1e-a83a-4041-80e6-628f32916266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:13.726666 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4cdb4c1e-a83a-4041-80e6-628f32916266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:13.726970 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4cdb4c1e-a83a-4041-80e6-628f32916266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:13.733587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-000ebc1a-83b5-4866-b522-4e40b80abbb4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:13.734041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-000ebc1a-83b5-4866-b522-4e40b80abbb4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:13.751369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-000ebc1a-83b5-4866-b522-4e40b80abbb4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] HTTP exception thrown: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-000ebc1a-83b5-4866-b522-4e40b80abbb4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Request method failure captured: Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: DELETE /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 HTTP/1.1 Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cDt2jGYGP9avBKREaegGHX8ZTy2kz44enKKjyjO-15MlSubsYLgwLY9qqYsI5NH_p5bx2zZngNKDjFWu0Fetl0ijXLpmmj1jX_OleBvu1IrRI0woihJrHbEuWy7JlTiK66lBuoyBitOum2D6pploo6gdYnfSGwxZ7CPjAJ7dAswEvg Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:12:13.753422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:12:13.754965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_161af2d8dc8f4aa99d4cc112a89ff674", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:12:13.754965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:12:13.754965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 23:12:13.754965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:12:13.754965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 23:12:13.754965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:12:13.754965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:12:13.754965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 3aa05eaf07f14de6b6ef97f08e6e5123 Jul 27 23:12:13.754965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 23:12:13.754965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:12:13.754965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:12:13.754965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': '8f087841-5ab3-42d6-ace3-9288c1ff0059'} Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:12:13.755824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:12:13.757199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:12:13.759607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-000ebc1a-83b5-4866-b522-4e40b80abbb4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Returning 404 to user: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:12:13.759607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-000ebc1a-83b5-4866-b522-4e40b80abbb4 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 404 len: 111 microversion: 2.1 time: 0.062365 Jul 27 23:12:13.759607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1401/2622] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:12:13 2022] DELETE /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:12:13.764756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-25e35993-9d79-4b51-a53a-372f7b66408c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] Calling method '.version_select at 0x7f696a12fe50>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:13.785626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-25e35993-9d79-4b51-a53a-372f7b66408c tempest-TestVolumeBootPattern-48669183 tempest-TestVolumeBootPattern-48669183-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2067908588" status: 202 len: 0 microversion: 2.1 time: 0.029325 Jul 27 23:12:13.786685 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1402/2623] 10.222.0.47 () {58 vars in 1263 bytes} [Wed Jul 27 23:12:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2067908588 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 23:12:13.795898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4159e20f-06a2-40a8-af7e-1cff3dae7990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:13.797092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4159e20f-06a2-40a8-af7e-1cff3dae7990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: 8f087841-5ab3-42d6-ace3-9288c1ff0059] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:13.799144 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:13.806084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4159e20f-06a2-40a8-af7e-1cff3dae7990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:13.806740 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4159e20f-06a2-40a8-af7e-1cff3dae7990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:13.807688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4159e20f-06a2-40a8-af7e-1cff3dae7990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:13.808323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4159e20f-06a2-40a8-af7e-1cff3dae7990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:13.823754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-4159e20f-06a2-40a8-af7e-1cff3dae7990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] HTTP exception thrown: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4159e20f-06a2-40a8-af7e-1cff3dae7990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Request method failure captured: Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 HTTP/1.1 Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cDt2jGYGP9avBKREaegGHX8ZTy2kz44enKKjyjO-15MlSubsYLgwLY9qqYsI5NH_p5bx2zZngNKDjFWu0Fetl0ijXLpmmj1jX_OleBvu1IrRI0woihJrHbEuWy7JlTiK66lBuoyBitOum2D6pploo6gdYnfSGwxZ7CPjAJ7dAswEvg Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:12:13.825643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:12:13.828304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_161af2d8dc8f4aa99d4cc112a89ff674", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:12:13.828304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:12:13.828304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 23:12:13.828304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:12:13.828304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 23:12:13.828304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:12:13.828304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:12:13.828304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 3aa05eaf07f14de6b6ef97f08e6e5123 Jul 27 23:12:13.828304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 23:12:13.828304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:12:13.828304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:12:13.828304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': '8f087841-5ab3-42d6-ace3-9288c1ff0059'} Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:12:13.831465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. Jul 27 23:12:13.833806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:12:13.837340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4159e20f-06a2-40a8-af7e-1cff3dae7990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Returning 404 to user: Instance 8f087841-5ab3-42d6-ace3-9288c1ff0059 could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:12:13.837340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4159e20f-06a2-40a8-af7e-1cff3dae7990 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059" status: 404 len: 111 microversion: 2.1 time: 0.039402 Jul 27 23:12:13.837340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1403/2624] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:13 2022] GET /compute/v2.1/servers/8f087841-5ab3-42d6-ace3-9288c1ff0059 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:12:13.910644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4cdb4c1e-a83a-4041-80e6-628f32916266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:13.920915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4cdb4c1e-a83a-4041-80e6-628f32916266 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.211926 Jul 27 23:12:13.921216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1222/2625] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:13 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:14.712228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-96281385-a5e8-46a7-acb5-1895641e24b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:14.713078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-96281385-a5e8-46a7-acb5-1895641e24b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:14.718342 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6b2c5833-8b0e-4759-b4aa-0607a9cf2e65 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:14.719556 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6b2c5833-8b0e-4759-b4aa-0607a9cf2e65 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:14.719945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96281385-a5e8-46a7-acb5-1895641e24b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:14.720395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96281385-a5e8-46a7-acb5-1895641e24b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:14.721202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96281385-a5e8-46a7-acb5-1895641e24b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:14.721634 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-96281385-a5e8-46a7-acb5-1895641e24b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:14.726155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b2c5833-8b0e-4759-b4aa-0607a9cf2e65 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:14.726594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b2c5833-8b0e-4759-b4aa-0607a9cf2e65 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:14.727644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b2c5833-8b0e-4759-b4aa-0607a9cf2e65 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:14.728379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b2c5833-8b0e-4759-b4aa-0607a9cf2e65 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:14.917697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-96281385-a5e8-46a7-acb5-1895641e24b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:14.929861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6b2c5833-8b0e-4759-b4aa-0607a9cf2e65 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:14.933875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-96281385-a5e8-46a7-acb5-1895641e24b0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.225541 Jul 27 23:12:14.934455 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1404/2626] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:14 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:14.939238 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6b2c5833-8b0e-4759-b4aa-0607a9cf2e65 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.225194 Jul 27 23:12:14.949079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1223/2627] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:14 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:14.952104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-40306f86-e946-4e0c-b5fe-c19e128230ce tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:14.952762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-40306f86-e946-4e0c-b5fe-c19e128230ce tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:14.958651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-40306f86-e946-4e0c-b5fe-c19e128230ce tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:14.959088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-40306f86-e946-4e0c-b5fe-c19e128230ce tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:14.960053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-40306f86-e946-4e0c-b5fe-c19e128230ce tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:14.960482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-40306f86-e946-4e0c-b5fe-c19e128230ce tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:15.090569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-40306f86-e946-4e0c-b5fe-c19e128230ce tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:15.099471 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-40306f86-e946-4e0c-b5fe-c19e128230ce tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.151292 Jul 27 23:12:15.100032 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1405/2628] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:14 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:15.356359 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-699380763", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e91465a7-4c6d-43c7-ad8f-466fa76b142b"}], "security_groups": [{"name": "tempest-securitygroup--1724177220"}], "key_name": "tempest-keypair-1863141698", "user_data": "}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:12:15.460201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.network.neutron [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] validate_networks() for [('e91465a7-4c6d-43c7-ad8f-466fa76b142b', None, None, None, None, None)] {{(pid=129294) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 23:12:15.928863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Flavor limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 23:12:15.929460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Image limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 23:12:15.929770 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Flavor pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 23:12:15.930174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Image pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 23:12:15.930581 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 23:12:15.940021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:15.940464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:15.941283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:15.941714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:15.956238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d665e15d-7958-4023-a647-1c8bb8d218b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:15.957831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d665e15d-7958-4023-a647-1c8bb8d218b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:15.959472 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Getting quotas for project 0d65941ddb4346e0b3fdc6b751a6aa07. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 23:12:15.963749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Getting quotas for user 51db745daefd448b80630ef1bceca4c4 and project 0d65941ddb4346e0b3fdc6b751a6aa07. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 23:12:15.965070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d665e15d-7958-4023-a647-1c8bb8d218b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:15.965695 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d665e15d-7958-4023-a647-1c8bb8d218b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:15.967170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d665e15d-7958-4023-a647-1c8bb8d218b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:15.967702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d665e15d-7958-4023-a647-1c8bb8d218b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:15.975210 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Going to run 1 instances... {{(pid=129294) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 23:12:15.977756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129294) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 23:12:15.989654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:16.046666 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-224d60d3-99a9-42cc-acb1-d52326e82c2d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.694504 Jul 27 23:12:16.053122 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1224/2629] 10.222.0.47 () {62 vars in 1188 bytes} [Wed Jul 27 23:12:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 23:12:16.057958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f53ee863-b9cb-4a16-908b-111861a59ab7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:16.058577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f53ee863-b9cb-4a16-908b-111861a59ab7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:16.071870 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f53ee863-b9cb-4a16-908b-111861a59ab7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:16.072596 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f53ee863-b9cb-4a16-908b-111861a59ab7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:16.073516 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f53ee863-b9cb-4a16-908b-111861a59ab7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:16.074011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f53ee863-b9cb-4a16-908b-111861a59ab7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:16.264107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d665e15d-7958-4023-a647-1c8bb8d218b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:16.273202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:16.277568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d665e15d-7958-4023-a647-1c8bb8d218b1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.325252 Jul 27 23:12:16.279207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1406/2630] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:16.286558 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-70edb791-9f03-4096-bbc9-e9007f814246 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:16.287328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-70edb791-9f03-4096-bbc9-e9007f814246 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:16.369870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-70edb791-9f03-4096-bbc9-e9007f814246 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:16.378783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-70edb791-9f03-4096-bbc9-e9007f814246 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:16.380305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-70edb791-9f03-4096-bbc9-e9007f814246 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:16.381502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-70edb791-9f03-4096-bbc9-e9007f814246 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 200 len: 1281 microversion: 2.20 time: 0.100969 Jul 27 23:12:16.382262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1407/2631] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:16 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 1281 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:16.384520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f53ee863-b9cb-4a16-908b-111861a59ab7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:16.387422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-53b26f43-486c-4ea7-a796-8d3f7e4199ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:16.388259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-53b26f43-486c-4ea7-a796-8d3f7e4199ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:16.395879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-53b26f43-486c-4ea7-a796-8d3f7e4199ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:16.397018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-53b26f43-486c-4ea7-a796-8d3f7e4199ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:16.398049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-53b26f43-486c-4ea7-a796-8d3f7e4199ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:16.398726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-53b26f43-486c-4ea7-a796-8d3f7e4199ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:16.403817 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f53ee863-b9cb-4a16-908b-111861a59ab7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.349582 Jul 27 23:12:16.416576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1225/2632] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:16 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:16.569853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-53b26f43-486c-4ea7-a796-8d3f7e4199ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:16.579743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-53b26f43-486c-4ea7-a796-8d3f7e4199ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.196276 Jul 27 23:12:16.593502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1408/2633] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:16 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:17.299258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-30e0e050-5e0b-42bd-9582-ff26606d3f46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:17.299916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-30e0e050-5e0b-42bd-9582-ff26606d3f46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:17.314003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-30e0e050-5e0b-42bd-9582-ff26606d3f46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:17.315101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-30e0e050-5e0b-42bd-9582-ff26606d3f46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:17.316275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-30e0e050-5e0b-42bd-9582-ff26606d3f46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:17.317101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-30e0e050-5e0b-42bd-9582-ff26606d3f46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:17.404962 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-25844fe1-2c9f-4f05-aa01-0fa830a2c927 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:17.406362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-25844fe1-2c9f-4f05-aa01-0fa830a2c927 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:17.421786 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25844fe1-2c9f-4f05-aa01-0fa830a2c927 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:17.422501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25844fe1-2c9f-4f05-aa01-0fa830a2c927 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:17.424003 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25844fe1-2c9f-4f05-aa01-0fa830a2c927 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:17.430000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-25844fe1-2c9f-4f05-aa01-0fa830a2c927 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:17.534042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-25844fe1-2c9f-4f05-aa01-0fa830a2c927 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:17.545498 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-25844fe1-2c9f-4f05-aa01-0fa830a2c927 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:17.553824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-25844fe1-2c9f-4f05-aa01-0fa830a2c927 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:17.554021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-30e0e050-5e0b-42bd-9582-ff26606d3f46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:17.557583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-25844fe1-2c9f-4f05-aa01-0fa830a2c927 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 200 len: 1351 microversion: 2.20 time: 0.156265 Jul 27 23:12:17.561266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1409/2634] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:17 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 1351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:17.578034 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d2ed4757-717b-4060-93ca-c312311bbdb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:17.578605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d2ed4757-717b-4060-93ca-c312311bbdb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:17.580977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-30e0e050-5e0b-42bd-9582-ff26606d3f46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.277129 Jul 27 23:12:17.595568 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1226/2635] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:17 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:17.595809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2ed4757-717b-4060-93ca-c312311bbdb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:17.595809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2ed4757-717b-4060-93ca-c312311bbdb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:17.595809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2ed4757-717b-4060-93ca-c312311bbdb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:17.595809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2ed4757-717b-4060-93ca-c312311bbdb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:17.605339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7f03e6eb-25dc-4fe4-845f-89f6f3acf035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:17.606330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7f03e6eb-25dc-4fe4-845f-89f6f3acf035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:17.617432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f03e6eb-25dc-4fe4-845f-89f6f3acf035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:17.618404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f03e6eb-25dc-4fe4-845f-89f6f3acf035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:17.620184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f03e6eb-25dc-4fe4-845f-89f6f3acf035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:17.621151 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f03e6eb-25dc-4fe4-845f-89f6f3acf035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:17.812931 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d2ed4757-717b-4060-93ca-c312311bbdb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:17.827089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d2ed4757-717b-4060-93ca-c312311bbdb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.262599 Jul 27 23:12:17.840579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1410/2636] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:17 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:17.867572 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7f03e6eb-25dc-4fe4-845f-89f6f3acf035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:17.876251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7f03e6eb-25dc-4fe4-845f-89f6f3acf035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.277991 Jul 27 23:12:17.878009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1227/2637] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:17 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:18.583520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ce0512c6-34b4-4d1e-8d9f-bd99fd09676f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:18.585376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ce0512c6-34b4-4d1e-8d9f-bd99fd09676f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:18.592901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce0512c6-34b4-4d1e-8d9f-bd99fd09676f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:18.593345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce0512c6-34b4-4d1e-8d9f-bd99fd09676f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:18.594289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce0512c6-34b4-4d1e-8d9f-bd99fd09676f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:18.595527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ce0512c6-34b4-4d1e-8d9f-bd99fd09676f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:18.604582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0258a978-700d-43bc-bd74-2be5c5d1b790 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:18.605761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0258a978-700d-43bc-bd74-2be5c5d1b790 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:18.615822 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0258a978-700d-43bc-bd74-2be5c5d1b790 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:18.616317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0258a978-700d-43bc-bd74-2be5c5d1b790 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:18.618754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0258a978-700d-43bc-bd74-2be5c5d1b790 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:18.619690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0258a978-700d-43bc-bd74-2be5c5d1b790 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:18.739430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ce0512c6-34b4-4d1e-8d9f-bd99fd09676f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:18.748078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ce0512c6-34b4-4d1e-8d9f-bd99fd09676f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:18.749955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ce0512c6-34b4-4d1e-8d9f-bd99fd09676f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:18.751503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ce0512c6-34b4-4d1e-8d9f-bd99fd09676f tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 200 len: 1339 microversion: 2.20 time: 0.173241 Jul 27 23:12:18.752746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1411/2638] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:18 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 1339 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:18.862010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4eb92390-5448-413c-85a1-e569f90181f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:18.862951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4eb92390-5448-413c-85a1-e569f90181f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:18.869063 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4eb92390-5448-413c-85a1-e569f90181f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:18.869919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4eb92390-5448-413c-85a1-e569f90181f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:18.870917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4eb92390-5448-413c-85a1-e569f90181f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:18.871423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4eb92390-5448-413c-85a1-e569f90181f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:18.922012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0258a978-700d-43bc-bd74-2be5c5d1b790 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:18.932727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0258a978-700d-43bc-bd74-2be5c5d1b790 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.332877 Jul 27 23:12:18.934306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1228/2639] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:18 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:18.939788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0bb6dbb5-4acd-4fb2-87fe-577fe45c75a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:18.940390 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0bb6dbb5-4acd-4fb2-87fe-577fe45c75a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:18.946875 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bb6dbb5-4acd-4fb2-87fe-577fe45c75a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:18.948270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bb6dbb5-4acd-4fb2-87fe-577fe45c75a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:18.953085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bb6dbb5-4acd-4fb2-87fe-577fe45c75a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:18.953908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bb6dbb5-4acd-4fb2-87fe-577fe45c75a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:19.251627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4eb92390-5448-413c-85a1-e569f90181f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:19.259821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4eb92390-5448-413c-85a1-e569f90181f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.412499 Jul 27 23:12:19.260672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1412/2640] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:18 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:19.296215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0bb6dbb5-4acd-4fb2-87fe-577fe45c75a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:19.298460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:19.306126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0bb6dbb5-4acd-4fb2-87fe-577fe45c75a2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.370145 Jul 27 23:12:19.309266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1229/2641] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:18 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:19.694877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-5df8d9ca-107a-48e1-8d00-a540f84bedf4 req-04881783-ab46-4375-ac8c-2a65132dad74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e14c602-f2a6-42c9-a947-98efffc174fa", "tag": "cda98f4f-a5d7-411b-8d2f-4f739e8e8af3"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:12:19.706956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-5df8d9ca-107a-48e1-8d00-a540f84bedf4 req-04881783-ab46-4375-ac8c-2a65132dad74 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:19.707757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-5df8d9ca-107a-48e1-8d00-a540f84bedf4 req-04881783-ab46-4375-ac8c-2a65132dad74 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:19.722386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-5df8d9ca-107a-48e1-8d00-a540f84bedf4 req-04881783-ab46-4375-ac8c-2a65132dad74 service nova] Creating event network-changed:cda98f4f-a5d7-411b-8d2f-4f739e8e8af3 for instance 3e14c602-f2a6-42c9-a947-98efffc174fa on hv-cinder-85124 Jul 27 23:12:19.728496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-5df8d9ca-107a-48e1-8d00-a540f84bedf4 req-04881783-ab46-4375-ac8c-2a65132dad74 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130290 Jul 27 23:12:19.729464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1413/2642] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:12:19.775500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3c2758ea-98de-4c29-b4c5-a4349a32e2ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:19.776317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3c2758ea-98de-4c29-b4c5-a4349a32e2ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:19.784135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c2758ea-98de-4c29-b4c5-a4349a32e2ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:19.785125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c2758ea-98de-4c29-b4c5-a4349a32e2ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:19.786299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c2758ea-98de-4c29-b4c5-a4349a32e2ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:19.786935 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3c2758ea-98de-4c29-b4c5-a4349a32e2ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:19.958926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6b0c127b-5f1d-419b-b494-c4f010c79a4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:19.960250 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6b0c127b-5f1d-419b-b494-c4f010c79a4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:19.969948 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b0c127b-5f1d-419b-b494-c4f010c79a4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:19.970671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b0c127b-5f1d-419b-b494-c4f010c79a4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:19.972384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b0c127b-5f1d-419b-b494-c4f010c79a4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:19.973043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6b0c127b-5f1d-419b-b494-c4f010c79a4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:20.289815 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3c2758ea-98de-4c29-b4c5-a4349a32e2ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:20.298431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3c2758ea-98de-4c29-b4c5-a4349a32e2ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:20.299940 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3c2758ea-98de-4c29-b4c5-a4349a32e2ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:20.301097 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3c2758ea-98de-4c29-b4c5-a4349a32e2ff tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 200 len: 1407 microversion: 2.20 time: 0.529750 Jul 27 23:12:20.301708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1230/2643] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:19 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 1407 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:20.306001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e5bb83d3-1374-4ae3-8f99-0272a9ca3b97 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:20.306595 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e5bb83d3-1374-4ae3-8f99-0272a9ca3b97 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:20.312915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5bb83d3-1374-4ae3-8f99-0272a9ca3b97 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:20.313361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5bb83d3-1374-4ae3-8f99-0272a9ca3b97 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:20.314121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5bb83d3-1374-4ae3-8f99-0272a9ca3b97 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:20.314559 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5bb83d3-1374-4ae3-8f99-0272a9ca3b97 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:20.370603 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6b0c127b-5f1d-419b-b494-c4f010c79a4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:20.379124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6b0c127b-5f1d-419b-b494-c4f010c79a4f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.427472 Jul 27 23:12:20.379681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1414/2644] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:19 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:20.384146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cdee22fe-af87-4e32-94e6-e9c2e985de84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:20.384981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cdee22fe-af87-4e32-94e6-e9c2e985de84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:20.391729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cdee22fe-af87-4e32-94e6-e9c2e985de84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:20.392170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cdee22fe-af87-4e32-94e6-e9c2e985de84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:20.393269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cdee22fe-af87-4e32-94e6-e9c2e985de84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:20.393397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cdee22fe-af87-4e32-94e6-e9c2e985de84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:20.579919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e5bb83d3-1374-4ae3-8f99-0272a9ca3b97 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:20.588052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e5bb83d3-1374-4ae3-8f99-0272a9ca3b97 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.285427 Jul 27 23:12:20.588764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1231/2645] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:20 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:20.670883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cdee22fe-af87-4e32-94e6-e9c2e985de84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:20.678850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cdee22fe-af87-4e32-94e6-e9c2e985de84 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.298216 Jul 27 23:12:20.679418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1415/2646] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:20 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:21.324413 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5a7c3857-747a-4d50-a5ef-434148f238ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:21.325102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5a7c3857-747a-4d50-a5ef-434148f238ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:21.332413 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a7c3857-747a-4d50-a5ef-434148f238ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:21.333175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a7c3857-747a-4d50-a5ef-434148f238ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:21.334132 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a7c3857-747a-4d50-a5ef-434148f238ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:21.334725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a7c3857-747a-4d50-a5ef-434148f238ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:21.400454 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ba380a40-b099-4fc9-a039-d4347b378707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:21.401781 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ba380a40-b099-4fc9-a039-d4347b378707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:21.408833 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba380a40-b099-4fc9-a039-d4347b378707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:21.409285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba380a40-b099-4fc9-a039-d4347b378707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:21.410052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba380a40-b099-4fc9-a039-d4347b378707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:21.410483 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba380a40-b099-4fc9-a039-d4347b378707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:21.691031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5a7c3857-747a-4d50-a5ef-434148f238ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:21.700662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5a7c3857-747a-4d50-a5ef-434148f238ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:21.702435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5a7c3857-747a-4d50-a5ef-434148f238ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:21.703946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5a7c3857-747a-4d50-a5ef-434148f238ae tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 200 len: 1407 microversion: 2.20 time: 0.383363 Jul 27 23:12:21.704987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1232/2647] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:21 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:12:21.724782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-46d9d1f3-5730-4735-9039-4cf087aa1d24 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:21.725984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-46d9d1f3-5730-4735-9039-4cf087aa1d24 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:21.732591 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-46d9d1f3-5730-4735-9039-4cf087aa1d24 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:21.733079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-46d9d1f3-5730-4735-9039-4cf087aa1d24 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:21.733906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-46d9d1f3-5730-4735-9039-4cf087aa1d24 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:21.734597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-46d9d1f3-5730-4735-9039-4cf087aa1d24 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:21.740696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ba380a40-b099-4fc9-a039-d4347b378707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:21.749269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ba380a40-b099-4fc9-a039-d4347b378707 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.352607 Jul 27 23:12:21.750420 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1416/2648] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:21 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:21.755054 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6278d416-c130-4d35-a1a0-56130b64cdda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:21.763788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6278d416-c130-4d35-a1a0-56130b64cdda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:21.771934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6278d416-c130-4d35-a1a0-56130b64cdda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:21.772373 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6278d416-c130-4d35-a1a0-56130b64cdda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:21.773328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6278d416-c130-4d35-a1a0-56130b64cdda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:21.773591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6278d416-c130-4d35-a1a0-56130b64cdda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:22.003297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-46d9d1f3-5730-4735-9039-4cf087aa1d24 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:22.007710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6278d416-c130-4d35-a1a0-56130b64cdda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:22.012475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-46d9d1f3-5730-4735-9039-4cf087aa1d24 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.293215 Jul 27 23:12:22.023960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1233/2649] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:21 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:22.024231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6278d416-c130-4d35-a1a0-56130b64cdda tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.265094 Jul 27 23:12:22.024231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1417/2650] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:21 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:22.729843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-42a33c4a-dc0b-4b1c-bcac-a763950e9fca tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:22.730459 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-42a33c4a-dc0b-4b1c-bcac-a763950e9fca tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:22.749790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42a33c4a-dc0b-4b1c-bcac-a763950e9fca tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:22.750244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42a33c4a-dc0b-4b1c-bcac-a763950e9fca tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:22.751031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42a33c4a-dc0b-4b1c-bcac-a763950e9fca tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:22.751469 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42a33c4a-dc0b-4b1c-bcac-a763950e9fca tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:22.771474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-815934c9-ce3f-4665-a90f-ca2a27893a43 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:22.772727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-815934c9-ce3f-4665-a90f-ca2a27893a43 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:22.781095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-815934c9-ce3f-4665-a90f-ca2a27893a43 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:22.781814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-815934c9-ce3f-4665-a90f-ca2a27893a43 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:22.782761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-815934c9-ce3f-4665-a90f-ca2a27893a43 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:22.783354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-815934c9-ce3f-4665-a90f-ca2a27893a43 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:22.971365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-42a33c4a-dc0b-4b1c-bcac-a763950e9fca tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:22.979716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-42a33c4a-dc0b-4b1c-bcac-a763950e9fca tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:22.981286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-42a33c4a-dc0b-4b1c-bcac-a763950e9fca tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:22.982597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-42a33c4a-dc0b-4b1c-bcac-a763950e9fca tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 200 len: 1407 microversion: 2.20 time: 0.258173 Jul 27 23:12:22.983519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1234/2651] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:22 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:23.003891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-815934c9-ce3f-4665-a90f-ca2a27893a43 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:23.011941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-815934c9-ce3f-4665-a90f-ca2a27893a43 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.244249 Jul 27 23:12:23.013275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1418/2652] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:22 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:23.039133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c6b45960-3c04-4e9e-a464-667cf2198c9c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:23.039955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c6b45960-3c04-4e9e-a464-667cf2198c9c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:23.047129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-190c2fbe-4ae0-47ff-ad94-ea4de0740169 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:23.047493 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c6b45960-3c04-4e9e-a464-667cf2198c9c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:23.047791 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-190c2fbe-4ae0-47ff-ad94-ea4de0740169 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:23.048099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c6b45960-3c04-4e9e-a464-667cf2198c9c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:23.049182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c6b45960-3c04-4e9e-a464-667cf2198c9c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:23.049766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c6b45960-3c04-4e9e-a464-667cf2198c9c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:23.054060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-190c2fbe-4ae0-47ff-ad94-ea4de0740169 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:23.054607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-190c2fbe-4ae0-47ff-ad94-ea4de0740169 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:23.055257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-190c2fbe-4ae0-47ff-ad94-ea4de0740169 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:23.055685 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-190c2fbe-4ae0-47ff-ad94-ea4de0740169 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:23.483018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-190c2fbe-4ae0-47ff-ad94-ea4de0740169 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:23.485361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c6b45960-3c04-4e9e-a464-667cf2198c9c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:23.493647 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-190c2fbe-4ae0-47ff-ad94-ea4de0740169 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.450236 Jul 27 23:12:23.494225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1419/2653] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:23 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:23.496605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c6b45960-3c04-4e9e-a464-667cf2198c9c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.461136 Jul 27 23:12:23.498347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1235/2654] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:23 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:24.004942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1d9b6fd3-b8e6-45fa-882b-775f94a4cdf7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:24.005467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1d9b6fd3-b8e6-45fa-882b-775f94a4cdf7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:24.012292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d9b6fd3-b8e6-45fa-882b-775f94a4cdf7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:24.012783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d9b6fd3-b8e6-45fa-882b-775f94a4cdf7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:24.013572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d9b6fd3-b8e6-45fa-882b-775f94a4cdf7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:24.014007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1d9b6fd3-b8e6-45fa-882b-775f94a4cdf7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:24.034021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f201c4d6-1841-40ff-b98d-9ea02fa9f07b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:24.034618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f201c4d6-1841-40ff-b98d-9ea02fa9f07b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:24.040991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f201c4d6-1841-40ff-b98d-9ea02fa9f07b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:24.041425 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f201c4d6-1841-40ff-b98d-9ea02fa9f07b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:24.042188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f201c4d6-1841-40ff-b98d-9ea02fa9f07b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:24.042639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f201c4d6-1841-40ff-b98d-9ea02fa9f07b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:24.235955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1d9b6fd3-b8e6-45fa-882b-775f94a4cdf7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:24.242612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f201c4d6-1841-40ff-b98d-9ea02fa9f07b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:24.244244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1d9b6fd3-b8e6-45fa-882b-775f94a4cdf7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:24.245844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1d9b6fd3-b8e6-45fa-882b-775f94a4cdf7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:24.246946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1d9b6fd3-b8e6-45fa-882b-775f94a4cdf7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 200 len: 1407 microversion: 2.20 time: 0.246089 Jul 27 23:12:24.247491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1420/2655] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:23 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:24.250438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f201c4d6-1841-40ff-b98d-9ea02fa9f07b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.220281 Jul 27 23:12:24.250983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1236/2656] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:24 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:24.516281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e48deb33-8ebe-4242-af12-a21e385b4b34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:24.516931 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e48deb33-8ebe-4242-af12-a21e385b4b34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:24.519267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ba3d84d6-fcc6-44dc-9d28-b4cd414af031 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:24.519874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ba3d84d6-fcc6-44dc-9d28-b4cd414af031 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:24.522990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e48deb33-8ebe-4242-af12-a21e385b4b34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:24.523447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e48deb33-8ebe-4242-af12-a21e385b4b34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:24.524241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e48deb33-8ebe-4242-af12-a21e385b4b34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:24.524697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e48deb33-8ebe-4242-af12-a21e385b4b34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:24.525842 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba3d84d6-fcc6-44dc-9d28-b4cd414af031 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:24.526285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba3d84d6-fcc6-44dc-9d28-b4cd414af031 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:24.527029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba3d84d6-fcc6-44dc-9d28-b4cd414af031 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:24.527470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba3d84d6-fcc6-44dc-9d28-b4cd414af031 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:24.722235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e48deb33-8ebe-4242-af12-a21e385b4b34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:24.727031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ba3d84d6-fcc6-44dc-9d28-b4cd414af031 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:24.731586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e48deb33-8ebe-4242-af12-a21e385b4b34 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.219777 Jul 27 23:12:24.732443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1421/2657] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:24 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:24.739988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ba3d84d6-fcc6-44dc-9d28-b4cd414af031 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.224233 Jul 27 23:12:24.747576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1237/2658] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:24 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:25.130580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-c4894e21-9b57-4936-bbba-cb6ae7546d94 req-1a688ed2-fbc8-4a27-8776-70f4088d5668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e14c602-f2a6-42c9-a947-98efffc174fa", "name": "network-vif-plugged", "status": "completed", "tag": "cda98f4f-a5d7-411b-8d2f-4f739e8e8af3"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:12:25.140879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-c4894e21-9b57-4936-bbba-cb6ae7546d94 req-1a688ed2-fbc8-4a27-8776-70f4088d5668 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:25.141318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-c4894e21-9b57-4936-bbba-cb6ae7546d94 req-1a688ed2-fbc8-4a27-8776-70f4088d5668 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:25.154475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-c4894e21-9b57-4936-bbba-cb6ae7546d94 req-1a688ed2-fbc8-4a27-8776-70f4088d5668 service nova] Creating event network-vif-plugged:cda98f4f-a5d7-411b-8d2f-4f739e8e8af3 for instance 3e14c602-f2a6-42c9-a947-98efffc174fa on hv-cinder-85124 Jul 27 23:12:25.161023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-c4894e21-9b57-4936-bbba-cb6ae7546d94 req-1a688ed2-fbc8-4a27-8776-70f4088d5668 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170176 Jul 27 23:12:25.161622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1422/2659] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:12:25.270407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b6e9635d-ca81-4713-bc65-7c43034a442c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:25.271472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-444e7b0a-dc36-4fe2-85fd-b3152c2f5175 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:25.271650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b6e9635d-ca81-4713-bc65-7c43034a442c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:25.272570 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-444e7b0a-dc36-4fe2-85fd-b3152c2f5175 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:25.278678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b6e9635d-ca81-4713-bc65-7c43034a442c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:25.279353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b6e9635d-ca81-4713-bc65-7c43034a442c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:25.279925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-444e7b0a-dc36-4fe2-85fd-b3152c2f5175 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:25.280303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b6e9635d-ca81-4713-bc65-7c43034a442c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:25.280420 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-444e7b0a-dc36-4fe2-85fd-b3152c2f5175 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:25.280776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b6e9635d-ca81-4713-bc65-7c43034a442c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:25.281217 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-444e7b0a-dc36-4fe2-85fd-b3152c2f5175 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:25.281658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-444e7b0a-dc36-4fe2-85fd-b3152c2f5175 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:25.488918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b6e9635d-ca81-4713-bc65-7c43034a442c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:25.490436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-444e7b0a-dc36-4fe2-85fd-b3152c2f5175 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:25.498691 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b6e9635d-ca81-4713-bc65-7c43034a442c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:25.499030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-444e7b0a-dc36-4fe2-85fd-b3152c2f5175 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.231700 Jul 27 23:12:25.499613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1423/2660] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:25 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:25.500175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b6e9635d-ca81-4713-bc65-7c43034a442c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:25.501563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b6e9635d-ca81-4713-bc65-7c43034a442c tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 200 len: 1407 microversion: 2.20 time: 0.235976 Jul 27 23:12:25.502121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1238/2661] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:25 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:12:25.753844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8386e399-e611-4ecf-ac67-bbf305b8262a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:25.754379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8386e399-e611-4ecf-ac67-bbf305b8262a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:25.760573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8386e399-e611-4ecf-ac67-bbf305b8262a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:25.761029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8386e399-e611-4ecf-ac67-bbf305b8262a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:25.761785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8386e399-e611-4ecf-ac67-bbf305b8262a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:25.761893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-66958bd5-dab7-480d-a25c-a97aadd9ef6f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:25.762220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8386e399-e611-4ecf-ac67-bbf305b8262a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:25.762466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-66958bd5-dab7-480d-a25c-a97aadd9ef6f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:25.768308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-66958bd5-dab7-480d-a25c-a97aadd9ef6f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:25.768788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-66958bd5-dab7-480d-a25c-a97aadd9ef6f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:25.769530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-66958bd5-dab7-480d-a25c-a97aadd9ef6f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:25.769954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-66958bd5-dab7-480d-a25c-a97aadd9ef6f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:25.949550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=2 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:25.954047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8386e399-e611-4ecf-ac67-bbf305b8262a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:25.957221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-66958bd5-dab7-480d-a25c-a97aadd9ef6f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:25.962049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8386e399-e611-4ecf-ac67-bbf305b8262a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.212065 Jul 27 23:12:25.962981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1424/2662] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:25.966310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-66958bd5-dab7-480d-a25c-a97aadd9ef6f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.207725 Jul 27 23:12:25.966949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1239/2663] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:25 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:26.520418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-621605d4-216c-4908-97d2-a793846ab75f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:26.521073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-621605d4-216c-4908-97d2-a793846ab75f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:26.522989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f4f614ef-d68d-4e43-800c-cad085997442 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:26.523516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=6 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:26.523660 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f4f614ef-d68d-4e43-800c-cad085997442 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:26.526105 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=6 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:26.529122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-621605d4-216c-4908-97d2-a793846ab75f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:26.529574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-621605d4-216c-4908-97d2-a793846ab75f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:26.530347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-621605d4-216c-4908-97d2-a793846ab75f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:26.530783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-621605d4-216c-4908-97d2-a793846ab75f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:26.533659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4f614ef-d68d-4e43-800c-cad085997442 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:26.534110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4f614ef-d68d-4e43-800c-cad085997442 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:26.534877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4f614ef-d68d-4e43-800c-cad085997442 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:26.535315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f4f614ef-d68d-4e43-800c-cad085997442 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:26.716780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-621605d4-216c-4908-97d2-a793846ab75f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:26.718970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:26.723438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f4f614ef-d68d-4e43-800c-cad085997442 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:26.726176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-621605d4-216c-4908-97d2-a793846ab75f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.209898 Jul 27 23:12:26.726747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1425/2664] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:26 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:26.736453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f4f614ef-d68d-4e43-800c-cad085997442 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:26.738052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f4f614ef-d68d-4e43-800c-cad085997442 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:26.739221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f4f614ef-d68d-4e43-800c-cad085997442 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 200 len: 1407 microversion: 2.20 time: 0.220110 Jul 27 23:12:26.739850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1240/2665] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:26 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:12:26.983985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6ecb6d70-22a5-431e-83e8-e4b451229cac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:26.984882 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6ecb6d70-22a5-431e-83e8-e4b451229cac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:26.987889 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-98f32e67-3837-4c9e-994e-17be88fb0fae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:26.988495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-98f32e67-3837-4c9e-994e-17be88fb0fae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:26.991955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6ecb6d70-22a5-431e-83e8-e4b451229cac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:26.992443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6ecb6d70-22a5-431e-83e8-e4b451229cac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:26.993331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6ecb6d70-22a5-431e-83e8-e4b451229cac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:26.993765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6ecb6d70-22a5-431e-83e8-e4b451229cac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:26.994496 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-98f32e67-3837-4c9e-994e-17be88fb0fae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:26.994944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-98f32e67-3837-4c9e-994e-17be88fb0fae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:26.995698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-98f32e67-3837-4c9e-994e-17be88fb0fae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:26.996119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-98f32e67-3837-4c9e-994e-17be88fb0fae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:27.190573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6ecb6d70-22a5-431e-83e8-e4b451229cac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:27.197992 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-98f32e67-3837-4c9e-994e-17be88fb0fae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:27.198459 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6ecb6d70-22a5-431e-83e8-e4b451229cac tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.219004 Jul 27 23:12:27.199035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1426/2666] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:26 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:27.207585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-98f32e67-3837-4c9e-994e-17be88fb0fae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.223752 Jul 27 23:12:27.208158 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1241/2667] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:26 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:27.747880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-109d503e-7b8c-457f-a7f3-66f16852cae5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:27.748485 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-109d503e-7b8c-457f-a7f3-66f16852cae5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:27.754935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-109d503e-7b8c-457f-a7f3-66f16852cae5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:27.755372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-109d503e-7b8c-457f-a7f3-66f16852cae5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:27.756119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-109d503e-7b8c-457f-a7f3-66f16852cae5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:27.756546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-109d503e-7b8c-457f-a7f3-66f16852cae5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:27.762168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6b0ec7ef-2493-453a-a9ae-e2eb2197508d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:27.763299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6b0ec7ef-2493-453a-a9ae-e2eb2197508d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:27.769790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b0ec7ef-2493-453a-a9ae-e2eb2197508d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:27.770167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b0ec7ef-2493-453a-a9ae-e2eb2197508d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:27.770909 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b0ec7ef-2493-453a-a9ae-e2eb2197508d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:27.771841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b0ec7ef-2493-453a-a9ae-e2eb2197508d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:27.958220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-109d503e-7b8c-457f-a7f3-66f16852cae5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:27.961227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6b0ec7ef-2493-453a-a9ae-e2eb2197508d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:27.966128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-109d503e-7b8c-457f-a7f3-66f16852cae5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.222071 Jul 27 23:12:27.966717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1427/2668] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:27 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:27.969563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6b0ec7ef-2493-453a-a9ae-e2eb2197508d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:27.971075 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6b0ec7ef-2493-453a-a9ae-e2eb2197508d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:27.972222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6b0ec7ef-2493-453a-a9ae-e2eb2197508d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 200 len: 1599 microversion: 2.20 time: 0.213911 Jul 27 23:12:27.972975 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1242/2669] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:12:27 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 23:12:27.993985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e9ad08a4-0122-40bc-8fdb-e2bfeca1ed8d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:27.994475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e9ad08a4-0122-40bc-8fdb-e2bfeca1ed8d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:28.001235 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9ad08a4-0122-40bc-8fdb-e2bfeca1ed8d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:28.001677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9ad08a4-0122-40bc-8fdb-e2bfeca1ed8d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:28.002427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9ad08a4-0122-40bc-8fdb-e2bfeca1ed8d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:28.002859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9ad08a4-0122-40bc-8fdb-e2bfeca1ed8d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:28.079385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e9ad08a4-0122-40bc-8fdb-e2bfeca1ed8d tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089060 Jul 27 23:12:28.080011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1428/2670] 10.222.0.47 () {60 vars in 1316 bytes} [Wed Jul 27 23:12:27 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 23:12:28.219159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c8df0328-a846-4cad-8e08-fb8adafd2b82 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:28.219765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c8df0328-a846-4cad-8e08-fb8adafd2b82 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:28.226110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8df0328-a846-4cad-8e08-fb8adafd2b82 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:28.226776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8df0328-a846-4cad-8e08-fb8adafd2b82 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:28.227565 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8df0328-a846-4cad-8e08-fb8adafd2b82 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:28.227998 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8df0328-a846-4cad-8e08-fb8adafd2b82 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:28.229621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cbc0ce73-1062-43a1-9324-82b12c8540a5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:28.230649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cbc0ce73-1062-43a1-9324-82b12c8540a5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:28.237411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cbc0ce73-1062-43a1-9324-82b12c8540a5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:28.237938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cbc0ce73-1062-43a1-9324-82b12c8540a5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:28.238919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cbc0ce73-1062-43a1-9324-82b12c8540a5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:28.239306 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cbc0ce73-1062-43a1-9324-82b12c8540a5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:28.423717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c8df0328-a846-4cad-8e08-fb8adafd2b82 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:28.431436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cbc0ce73-1062-43a1-9324-82b12c8540a5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:28.432330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c8df0328-a846-4cad-8e08-fb8adafd2b82 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.216954 Jul 27 23:12:28.433234 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1243/2671] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:28 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:28.440087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cbc0ce73-1062-43a1-9324-82b12c8540a5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214497 Jul 27 23:12:28.445844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1429/2672] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:28 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:28.988839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f757e748-2c4a-42a9-8706-4ca902d7f055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:28.989294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f757e748-2c4a-42a9-8706-4ca902d7f055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:28.996588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-48fb9d84-cd54-462c-a595-d1c8dda888dd req-1329ca82-8b92-4f64-b43a-fc201a93759d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e14c602-f2a6-42c9-a947-98efffc174fa", "tag": "cda98f4f-a5d7-411b-8d2f-4f739e8e8af3"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:12:28.997711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f757e748-2c4a-42a9-8706-4ca902d7f055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:28.998059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f757e748-2c4a-42a9-8706-4ca902d7f055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:28.998895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f757e748-2c4a-42a9-8706-4ca902d7f055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:28.999324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f757e748-2c4a-42a9-8706-4ca902d7f055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:29.007523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-48fb9d84-cd54-462c-a595-d1c8dda888dd req-1329ca82-8b92-4f64-b43a-fc201a93759d service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:29.008035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-48fb9d84-cd54-462c-a595-d1c8dda888dd req-1329ca82-8b92-4f64-b43a-fc201a93759d service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:29.021362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-48fb9d84-cd54-462c-a595-d1c8dda888dd req-1329ca82-8b92-4f64-b43a-fc201a93759d service nova] Creating event network-changed:cda98f4f-a5d7-411b-8d2f-4f739e8e8af3 for instance 3e14c602-f2a6-42c9-a947-98efffc174fa on hv-cinder-85124 Jul 27 23:12:29.027424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-48fb9d84-cd54-462c-a595-d1c8dda888dd req-1329ca82-8b92-4f64-b43a-fc201a93759d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034579 Jul 27 23:12:29.028609 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1430/2673] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 23:12:29.139285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f757e748-2c4a-42a9-8706-4ca902d7f055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:29.152140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f757e748-2c4a-42a9-8706-4ca902d7f055 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.164162 Jul 27 23:12:29.152140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1244/2674] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:28 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:29.454759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ea557c9d-ac99-47a6-afa4-d42d1508dcb9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:29.455479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ea557c9d-ac99-47a6-afa4-d42d1508dcb9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:29.462354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ea557c9d-ac99-47a6-afa4-d42d1508dcb9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:29.462836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ea557c9d-ac99-47a6-afa4-d42d1508dcb9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:29.463608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ea557c9d-ac99-47a6-afa4-d42d1508dcb9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:29.464042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ea557c9d-ac99-47a6-afa4-d42d1508dcb9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:29.465203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2f94e601-2580-4b0a-b03f-9534ae54770f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:29.466968 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2f94e601-2580-4b0a-b03f-9534ae54770f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:29.473988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f94e601-2580-4b0a-b03f-9534ae54770f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:29.474481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f94e601-2580-4b0a-b03f-9534ae54770f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:29.475504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f94e601-2580-4b0a-b03f-9534ae54770f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:29.476038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f94e601-2580-4b0a-b03f-9534ae54770f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:29.676873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ea557c9d-ac99-47a6-afa4-d42d1508dcb9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:29.685822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ea557c9d-ac99-47a6-afa4-d42d1508dcb9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.235431 Jul 27 23:12:29.701646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1431/2675] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:29 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:29.708224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2f94e601-2580-4b0a-b03f-9534ae54770f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:29.717299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2f94e601-2580-4b0a-b03f-9534ae54770f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.258383 Jul 27 23:12:29.717870 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1245/2676] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:29 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:30.168964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-73963d05-53bb-4d0a-ba45-599ad080e0e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:30.169579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-73963d05-53bb-4d0a-ba45-599ad080e0e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:30.176624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73963d05-53bb-4d0a-ba45-599ad080e0e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:30.177358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73963d05-53bb-4d0a-ba45-599ad080e0e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:30.178231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73963d05-53bb-4d0a-ba45-599ad080e0e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:30.178737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-73963d05-53bb-4d0a-ba45-599ad080e0e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:30.312826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-73963d05-53bb-4d0a-ba45-599ad080e0e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:30.320898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-73963d05-53bb-4d0a-ba45-599ad080e0e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.155718 Jul 27 23:12:30.332571 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1432/2677] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:30 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:30.707848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-463cc93b-77c7-4cdd-aad1-35f0afed7e06 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:30.708459 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-463cc93b-77c7-4cdd-aad1-35f0afed7e06 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:30.715015 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-463cc93b-77c7-4cdd-aad1-35f0afed7e06 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:30.715463 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-463cc93b-77c7-4cdd-aad1-35f0afed7e06 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:30.716220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-463cc93b-77c7-4cdd-aad1-35f0afed7e06 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:30.716687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-463cc93b-77c7-4cdd-aad1-35f0afed7e06 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:30.731711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:30.738882 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c83fd359-8aab-458f-ae39-bba203bc48f1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:30.739485 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c83fd359-8aab-458f-ae39-bba203bc48f1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:30.745354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c83fd359-8aab-458f-ae39-bba203bc48f1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:30.745792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c83fd359-8aab-458f-ae39-bba203bc48f1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:30.746536 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c83fd359-8aab-458f-ae39-bba203bc48f1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:30.747620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c83fd359-8aab-458f-ae39-bba203bc48f1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:30.915095 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-463cc93b-77c7-4cdd-aad1-35f0afed7e06 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:30.918268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c83fd359-8aab-458f-ae39-bba203bc48f1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:30.923925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-463cc93b-77c7-4cdd-aad1-35f0afed7e06 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.219902 Jul 27 23:12:30.924528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1246/2678] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:30 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:30.929745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c83fd359-8aab-458f-ae39-bba203bc48f1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.194454 Jul 27 23:12:30.930320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1433/2679] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:30 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:31.343497 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f1e35edb-0313-40e5-a94c-5ac60319174c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:31.344041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f1e35edb-0313-40e5-a94c-5ac60319174c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:31.350117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1e35edb-0313-40e5-a94c-5ac60319174c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:31.350555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1e35edb-0313-40e5-a94c-5ac60319174c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:31.351302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1e35edb-0313-40e5-a94c-5ac60319174c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:31.351727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1e35edb-0313-40e5-a94c-5ac60319174c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:31.481035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f1e35edb-0313-40e5-a94c-5ac60319174c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:31.489155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f1e35edb-0313-40e5-a94c-5ac60319174c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.150129 Jul 27 23:12:31.489750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1247/2680] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:31 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:31.945307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-51ee7baf-c267-492f-84b2-807b86fd132a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:31.945910 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-51ee7baf-c267-492f-84b2-807b86fd132a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:31.953105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51ee7baf-c267-492f-84b2-807b86fd132a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:31.953545 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51ee7baf-c267-492f-84b2-807b86fd132a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:31.954292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51ee7baf-c267-492f-84b2-807b86fd132a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:31.954725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-51ee7baf-c267-492f-84b2-807b86fd132a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:31.958780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d2429300-9f16-4eb2-ad86-757fe7ba6401 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:31.959399 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d2429300-9f16-4eb2-ad86-757fe7ba6401 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:31.965978 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d2429300-9f16-4eb2-ad86-757fe7ba6401 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:31.966426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d2429300-9f16-4eb2-ad86-757fe7ba6401 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:31.967185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d2429300-9f16-4eb2-ad86-757fe7ba6401 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:31.967618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d2429300-9f16-4eb2-ad86-757fe7ba6401 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:32.152942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-51ee7baf-c267-492f-84b2-807b86fd132a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:32.160522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d2429300-9f16-4eb2-ad86-757fe7ba6401 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:32.166549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-51ee7baf-c267-492f-84b2-807b86fd132a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.224736 Jul 27 23:12:32.167532 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1434/2681] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:31 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:32.174125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d2429300-9f16-4eb2-ad86-757fe7ba6401 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.218802 Jul 27 23:12:32.175146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1248/2682] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:31 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:32.510203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-45fcc2ed-e48a-4f2d-aa37-708d752ba43b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:32.510815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-45fcc2ed-e48a-4f2d-aa37-708d752ba43b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:32.517456 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45fcc2ed-e48a-4f2d-aa37-708d752ba43b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:32.517902 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45fcc2ed-e48a-4f2d-aa37-708d752ba43b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:32.518653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45fcc2ed-e48a-4f2d-aa37-708d752ba43b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:32.519088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45fcc2ed-e48a-4f2d-aa37-708d752ba43b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:32.645531 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-45fcc2ed-e48a-4f2d-aa37-708d752ba43b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:32.653338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-45fcc2ed-e48a-4f2d-aa37-708d752ba43b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.146949 Jul 27 23:12:32.653900 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1435/2683] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:32 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:33.190940 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f5d1df2a-b6ff-49d6-b587-06068466c985 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:33.191545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f5d1df2a-b6ff-49d6-b587-06068466c985 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:33.194930 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1c3a1f0a-433b-45f8-9a51-0086256e11c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:33.195544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1c3a1f0a-433b-45f8-9a51-0086256e11c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:33.198071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5d1df2a-b6ff-49d6-b587-06068466c985 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:33.198510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5d1df2a-b6ff-49d6-b587-06068466c985 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:33.199259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5d1df2a-b6ff-49d6-b587-06068466c985 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:33.199686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5d1df2a-b6ff-49d6-b587-06068466c985 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:33.201909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c3a1f0a-433b-45f8-9a51-0086256e11c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:33.202356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c3a1f0a-433b-45f8-9a51-0086256e11c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:33.203107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c3a1f0a-433b-45f8-9a51-0086256e11c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:33.203551 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1c3a1f0a-433b-45f8-9a51-0086256e11c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:33.395410 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f5d1df2a-b6ff-49d6-b587-06068466c985 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:33.398729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1c3a1f0a-433b-45f8-9a51-0086256e11c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:33.403862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f5d1df2a-b6ff-49d6-b587-06068466c985 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.216237 Jul 27 23:12:33.404429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1249/2684] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:33 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:33.407544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1c3a1f0a-433b-45f8-9a51-0086256e11c3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216322 Jul 27 23:12:33.408118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1436/2685] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:33 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:33.674240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c4667362-df5b-4762-b2f6-ec5228d245aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:33.674796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c4667362-df5b-4762-b2f6-ec5228d245aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:33.680811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4667362-df5b-4762-b2f6-ec5228d245aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:33.681258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4667362-df5b-4762-b2f6-ec5228d245aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:33.682010 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4667362-df5b-4762-b2f6-ec5228d245aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:33.682440 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4667362-df5b-4762-b2f6-ec5228d245aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:33.812398 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c4667362-df5b-4762-b2f6-ec5228d245aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:33.820183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c4667362-df5b-4762-b2f6-ec5228d245aa tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.149939 Jul 27 23:12:33.820771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1250/2686] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:33 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:34.425770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-98f77dbd-bf6b-40cf-a621-5855695d9365 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:34.426302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-98f77dbd-bf6b-40cf-a621-5855695d9365 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:34.429363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4e4f0539-20ee-4dc0-9e0e-d0304b6eabba tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:34.429967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4e4f0539-20ee-4dc0-9e0e-d0304b6eabba tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:34.432866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98f77dbd-bf6b-40cf-a621-5855695d9365 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:34.433316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98f77dbd-bf6b-40cf-a621-5855695d9365 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:34.434075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98f77dbd-bf6b-40cf-a621-5855695d9365 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:34.435091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98f77dbd-bf6b-40cf-a621-5855695d9365 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:34.436981 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4e4f0539-20ee-4dc0-9e0e-d0304b6eabba tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:34.437421 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4e4f0539-20ee-4dc0-9e0e-d0304b6eabba tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:34.438170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4e4f0539-20ee-4dc0-9e0e-d0304b6eabba tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:34.438595 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4e4f0539-20ee-4dc0-9e0e-d0304b6eabba tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:34.624010 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4e4f0539-20ee-4dc0-9e0e-d0304b6eabba tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:34.627241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-98f77dbd-bf6b-40cf-a621-5855695d9365 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:34.632086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4e4f0539-20ee-4dc0-9e0e-d0304b6eabba tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.206459 Jul 27 23:12:34.632671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1251/2687] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:34 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:34.635058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-98f77dbd-bf6b-40cf-a621-5855695d9365 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.213283 Jul 27 23:12:34.635655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1437/2688] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:34 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:34.841658 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-00ace1f0-1485-4283-810f-b4548f2b5a13 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:34.842263 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-00ace1f0-1485-4283-810f-b4548f2b5a13 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:34.848228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-00ace1f0-1485-4283-810f-b4548f2b5a13 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:34.848700 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-00ace1f0-1485-4283-810f-b4548f2b5a13 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:34.849444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-00ace1f0-1485-4283-810f-b4548f2b5a13 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:34.849865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-00ace1f0-1485-4283-810f-b4548f2b5a13 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:34.976744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-00ace1f0-1485-4283-810f-b4548f2b5a13 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:34.984819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-00ace1f0-1485-4283-810f-b4548f2b5a13 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.147206 Jul 27 23:12:34.985368 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1252/2689] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:34 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:35.653861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-21081192-067f-4a27-bf3d-eb3f5e48b7c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:35.654493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-21081192-067f-4a27-bf3d-eb3f5e48b7c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:35.656403 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1b40604f-abad-4263-b0fd-f6cddf629e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:35.657036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1b40604f-abad-4263-b0fd-f6cddf629e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:35.661034 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21081192-067f-4a27-bf3d-eb3f5e48b7c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:35.661474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21081192-067f-4a27-bf3d-eb3f5e48b7c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:35.662225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21081192-067f-4a27-bf3d-eb3f5e48b7c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:35.662650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21081192-067f-4a27-bf3d-eb3f5e48b7c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:35.663317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b40604f-abad-4263-b0fd-f6cddf629e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:35.663764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b40604f-abad-4263-b0fd-f6cddf629e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:35.664520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b40604f-abad-4263-b0fd-f6cddf629e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:35.664977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b40604f-abad-4263-b0fd-f6cddf629e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:35.856269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-21081192-067f-4a27-bf3d-eb3f5e48b7c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:35.859748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1b40604f-abad-4263-b0fd-f6cddf629e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:35.864840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-21081192-067f-4a27-bf3d-eb3f5e48b7c7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215461 Jul 27 23:12:35.865413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1438/2690] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:35 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:35.867517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1b40604f-abad-4263-b0fd-f6cddf629e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.215467 Jul 27 23:12:35.868067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1253/2691] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:35 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:36.005773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-025b077b-6461-4284-a19c-d5f9204ffc7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:36.006297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-025b077b-6461-4284-a19c-d5f9204ffc7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:36.012193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-025b077b-6461-4284-a19c-d5f9204ffc7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:36.013173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-025b077b-6461-4284-a19c-d5f9204ffc7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:36.013912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-025b077b-6461-4284-a19c-d5f9204ffc7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:36.014339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-025b077b-6461-4284-a19c-d5f9204ffc7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:36.142127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-025b077b-6461-4284-a19c-d5f9204ffc7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:36.150145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-025b077b-6461-4284-a19c-d5f9204ffc7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.148251 Jul 27 23:12:36.150705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1439/2692] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:36 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:36.885949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-821f0ef0-8d38-4c71-84eb-202f724d3742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:36.886655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-821f0ef0-8d38-4c71-84eb-202f724d3742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:36.887617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8936199e-bab2-44b8-9aff-ad2fa5feb19b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:36.888230 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8936199e-bab2-44b8-9aff-ad2fa5feb19b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:36.893330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-821f0ef0-8d38-4c71-84eb-202f724d3742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:36.893775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-821f0ef0-8d38-4c71-84eb-202f724d3742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:36.894537 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-821f0ef0-8d38-4c71-84eb-202f724d3742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:36.894713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8936199e-bab2-44b8-9aff-ad2fa5feb19b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:36.894973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-821f0ef0-8d38-4c71-84eb-202f724d3742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:36.895163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8936199e-bab2-44b8-9aff-ad2fa5feb19b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:36.895907 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8936199e-bab2-44b8-9aff-ad2fa5feb19b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:36.896334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8936199e-bab2-44b8-9aff-ad2fa5feb19b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:37.087200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-821f0ef0-8d38-4c71-84eb-202f724d3742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:37.091013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8936199e-bab2-44b8-9aff-ad2fa5feb19b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:37.095903 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-821f0ef0-8d38-4c71-84eb-202f724d3742 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.213748 Jul 27 23:12:37.096608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1254/2693] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:36 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:37.098806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8936199e-bab2-44b8-9aff-ad2fa5feb19b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.214954 Jul 27 23:12:37.099363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1440/2694] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:36 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:37.171736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a6f4ea28-3415-4b47-980d-26d8985110e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:37.172337 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a6f4ea28-3415-4b47-980d-26d8985110e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:37.178331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a6f4ea28-3415-4b47-980d-26d8985110e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:37.178767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a6f4ea28-3415-4b47-980d-26d8985110e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:37.179510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a6f4ea28-3415-4b47-980d-26d8985110e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:37.179938 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a6f4ea28-3415-4b47-980d-26d8985110e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:37.308150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a6f4ea28-3415-4b47-980d-26d8985110e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:37.316064 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a6f4ea28-3415-4b47-980d-26d8985110e7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.148813 Jul 27 23:12:37.316629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1255/2695] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:37 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:38.117938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4f93eb9a-e377-4e8a-820f-4c63fa7b1d36 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:38.118378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4f93eb9a-e377-4e8a-820f-4c63fa7b1d36 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:38.120792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ba95c48f-3a01-4af4-b8bc-03c52dcfb4ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:38.121400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ba95c48f-3a01-4af4-b8bc-03c52dcfb4ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:38.125351 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4f93eb9a-e377-4e8a-820f-4c63fa7b1d36 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:38.125782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4f93eb9a-e377-4e8a-820f-4c63fa7b1d36 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:38.126535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4f93eb9a-e377-4e8a-820f-4c63fa7b1d36 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:38.126963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4f93eb9a-e377-4e8a-820f-4c63fa7b1d36 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:38.128461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba95c48f-3a01-4af4-b8bc-03c52dcfb4ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:38.128935 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba95c48f-3a01-4af4-b8bc-03c52dcfb4ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:38.129676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba95c48f-3a01-4af4-b8bc-03c52dcfb4ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:38.130100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ba95c48f-3a01-4af4-b8bc-03c52dcfb4ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:38.326260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4f93eb9a-e377-4e8a-820f-4c63fa7b1d36 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:38.329522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ba95c48f-3a01-4af4-b8bc-03c52dcfb4ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:38.334406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4f93eb9a-e377-4e8a-820f-4c63fa7b1d36 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.220774 Jul 27 23:12:38.335071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1441/2696] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:38 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:38.339457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-98519b7e-fa6c-4927-bb52-b429b253f574 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:38.340131 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-98519b7e-fa6c-4927-bb52-b429b253f574 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:38.344279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ba95c48f-3a01-4af4-b8bc-03c52dcfb4ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.227686 Jul 27 23:12:38.344870 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1256/2697] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:38 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:38.346599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98519b7e-fa6c-4927-bb52-b429b253f574 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:38.347105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98519b7e-fa6c-4927-bb52-b429b253f574 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:38.347919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98519b7e-fa6c-4927-bb52-b429b253f574 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:38.348410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98519b7e-fa6c-4927-bb52-b429b253f574 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:38.475204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-98519b7e-fa6c-4927-bb52-b429b253f574 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:38.483623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-98519b7e-fa6c-4927-bb52-b429b253f574 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.147567 Jul 27 23:12:38.484762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1442/2698] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:38 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:38.842217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:12:38.842457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:12:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:12:39.356492 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5a4447db-5621-4a1a-91f5-881f55acb354 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:39.357174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5a4447db-5621-4a1a-91f5-881f55acb354 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:39.364393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a4447db-5621-4a1a-91f5-881f55acb354 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:39.364871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a4447db-5621-4a1a-91f5-881f55acb354 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:39.365628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a4447db-5621-4a1a-91f5-881f55acb354 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:39.365837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c6225dfe-9878-499f-9d65-981e390a0888 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:39.366240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a4447db-5621-4a1a-91f5-881f55acb354 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:39.366441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c6225dfe-9878-499f-9d65-981e390a0888 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:39.373260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c6225dfe-9878-499f-9d65-981e390a0888 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:39.373725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c6225dfe-9878-499f-9d65-981e390a0888 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:39.374470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c6225dfe-9878-499f-9d65-981e390a0888 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:39.374893 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c6225dfe-9878-499f-9d65-981e390a0888 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:39.391122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:39.562555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5a4447db-5621-4a1a-91f5-881f55acb354 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:39.566668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c6225dfe-9878-499f-9d65-981e390a0888 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:39.570777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5a4447db-5621-4a1a-91f5-881f55acb354 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.217977 Jul 27 23:12:39.571649 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1257/2699] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:39 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:39.575798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c6225dfe-9878-499f-9d65-981e390a0888 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.213534 Jul 27 23:12:39.575974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-eea5875e-72ea-4e8c-a4a7-b7514245b3c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:39.576657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1443/2700] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:39 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:39.583628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-eea5875e-72ea-4e8c-a4a7-b7514245b3c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:39.590142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eea5875e-72ea-4e8c-a4a7-b7514245b3c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:39.590593 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eea5875e-72ea-4e8c-a4a7-b7514245b3c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:39.591355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eea5875e-72ea-4e8c-a4a7-b7514245b3c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:39.591786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eea5875e-72ea-4e8c-a4a7-b7514245b3c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:39.719206 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eea5875e-72ea-4e8c-a4a7-b7514245b3c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:39.727088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-eea5875e-72ea-4e8c-a4a7-b7514245b3c1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.154532 Jul 27 23:12:39.727587 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1258/2701] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:39 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:40.592898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2af0f1aa-0c36-464a-9791-edabef07257f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:40.593506 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2af0f1aa-0c36-464a-9791-edabef07257f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:40.596401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-24c3a885-395c-46e8-a8fc-8eee66eea035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:40.597031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-24c3a885-395c-46e8-a8fc-8eee66eea035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:40.600287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2af0f1aa-0c36-464a-9791-edabef07257f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:40.600761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2af0f1aa-0c36-464a-9791-edabef07257f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:40.601516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2af0f1aa-0c36-464a-9791-edabef07257f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:40.601943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2af0f1aa-0c36-464a-9791-edabef07257f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:40.603667 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24c3a885-395c-46e8-a8fc-8eee66eea035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:40.604123 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24c3a885-395c-46e8-a8fc-8eee66eea035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:40.604934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24c3a885-395c-46e8-a8fc-8eee66eea035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:40.605367 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-24c3a885-395c-46e8-a8fc-8eee66eea035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:40.795317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2af0f1aa-0c36-464a-9791-edabef07257f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:40.799942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-24c3a885-395c-46e8-a8fc-8eee66eea035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:40.803185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2af0f1aa-0c36-464a-9791-edabef07257f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214199 Jul 27 23:12:40.803746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1444/2702] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:40 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:40.808081 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0750a577-9021-41ac-8937-fda51df5d1e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:40.808239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-24c3a885-395c-46e8-a8fc-8eee66eea035 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.215381 Jul 27 23:12:40.809945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0750a577-9021-41ac-8937-fda51df5d1e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:40.810093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1259/2703] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:40 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:40.814913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0750a577-9021-41ac-8937-fda51df5d1e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:40.815354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0750a577-9021-41ac-8937-fda51df5d1e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:40.816097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0750a577-9021-41ac-8937-fda51df5d1e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:40.816831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0750a577-9021-41ac-8937-fda51df5d1e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:40.949138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0750a577-9021-41ac-8937-fda51df5d1e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:40.957535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0750a577-9021-41ac-8937-fda51df5d1e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.152866 Jul 27 23:12:40.958098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1445/2704] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:40 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:41.825338 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-eb301768-6234-42cc-85d7-0bf5d728b6db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:41.826001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-eb301768-6234-42cc-85d7-0bf5d728b6db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:41.829830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b404f624-04b8-443e-96c3-19da9b811f83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:41.830437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b404f624-04b8-443e-96c3-19da9b811f83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:41.832502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb301768-6234-42cc-85d7-0bf5d728b6db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:41.832980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb301768-6234-42cc-85d7-0bf5d728b6db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:41.833741 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb301768-6234-42cc-85d7-0bf5d728b6db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:41.834176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb301768-6234-42cc-85d7-0bf5d728b6db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:41.837185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b404f624-04b8-443e-96c3-19da9b811f83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:41.837625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b404f624-04b8-443e-96c3-19da9b811f83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:41.838376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b404f624-04b8-443e-96c3-19da9b811f83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:41.838805 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b404f624-04b8-443e-96c3-19da9b811f83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:42.018382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eb301768-6234-42cc-85d7-0bf5d728b6db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:42.026393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-eb301768-6234-42cc-85d7-0bf5d728b6db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.205396 Jul 27 23:12:42.026959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1260/2705] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:41 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:42.031650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-eae5b58b-0b3a-4610-8d07-8e0553a338f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:42.032334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b404f624-04b8-443e-96c3-19da9b811f83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:42.032824 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-eae5b58b-0b3a-4610-8d07-8e0553a338f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:42.038608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eae5b58b-0b3a-4610-8d07-8e0553a338f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:42.039052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eae5b58b-0b3a-4610-8d07-8e0553a338f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:42.039807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eae5b58b-0b3a-4610-8d07-8e0553a338f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:42.040278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b404f624-04b8-443e-96c3-19da9b811f83 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.214266 Jul 27 23:12:42.040409 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eae5b58b-0b3a-4610-8d07-8e0553a338f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:42.040880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1446/2706] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:41 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:42.167636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eae5b58b-0b3a-4610-8d07-8e0553a338f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:42.175503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-eae5b58b-0b3a-4610-8d07-8e0553a338f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.147572 Jul 27 23:12:42.176068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1261/2707] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:42 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:43.047803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c3657586-8e75-4bd8-9436-81fe3129d6f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:43.048412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c3657586-8e75-4bd8-9436-81fe3129d6f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:43.054589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3657586-8e75-4bd8-9436-81fe3129d6f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:43.055034 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3657586-8e75-4bd8-9436-81fe3129d6f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:43.056042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3657586-8e75-4bd8-9436-81fe3129d6f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:43.056288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3657586-8e75-4bd8-9436-81fe3129d6f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:43.060943 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-42eeddcc-66ed-47f7-87de-991268cc722d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:43.061556 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-42eeddcc-66ed-47f7-87de-991268cc722d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:43.067831 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42eeddcc-66ed-47f7-87de-991268cc722d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:43.068274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42eeddcc-66ed-47f7-87de-991268cc722d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:43.069072 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42eeddcc-66ed-47f7-87de-991268cc722d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:43.069498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42eeddcc-66ed-47f7-87de-991268cc722d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:43.253241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c3657586-8e75-4bd8-9436-81fe3129d6f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:43.259047 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-42eeddcc-66ed-47f7-87de-991268cc722d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:43.261528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c3657586-8e75-4bd8-9436-81fe3129d6f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.218009 Jul 27 23:12:43.261994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1447/2708] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:43 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:43.267114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a0241388-2b6e-4625-8456-234e3f823554 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:43.267720 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a0241388-2b6e-4625-8456-234e3f823554 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:43.268478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-42eeddcc-66ed-47f7-87de-991268cc722d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.211235 Jul 27 23:12:43.271108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1262/2709] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:43 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:43.273807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0241388-2b6e-4625-8456-234e3f823554 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:43.274254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0241388-2b6e-4625-8456-234e3f823554 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:43.275014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0241388-2b6e-4625-8456-234e3f823554 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:43.275454 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0241388-2b6e-4625-8456-234e3f823554 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:43.399883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a0241388-2b6e-4625-8456-234e3f823554 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:43.408338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a0241388-2b6e-4625-8456-234e3f823554 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.144922 Jul 27 23:12:43.410490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1448/2710] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:43 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:44.283720 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-656d39e7-674c-4fcf-8a17-3b496492f989 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:44.284332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-656d39e7-674c-4fcf-8a17-3b496492f989 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:44.289636 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-36198aa7-67f5-4382-a8af-24a2ab9e36a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:44.290238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-36198aa7-67f5-4382-a8af-24a2ab9e36a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:44.290787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-656d39e7-674c-4fcf-8a17-3b496492f989 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:44.291226 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-656d39e7-674c-4fcf-8a17-3b496492f989 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:44.291977 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-656d39e7-674c-4fcf-8a17-3b496492f989 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:44.292400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-656d39e7-674c-4fcf-8a17-3b496492f989 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:44.294978 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:44.296707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-36198aa7-67f5-4382-a8af-24a2ab9e36a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:44.297203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-36198aa7-67f5-4382-a8af-24a2ab9e36a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:44.297956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-36198aa7-67f5-4382-a8af-24a2ab9e36a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:44.298380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-36198aa7-67f5-4382-a8af-24a2ab9e36a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:44.483817 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-656d39e7-674c-4fcf-8a17-3b496492f989 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:44.487997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-36198aa7-67f5-4382-a8af-24a2ab9e36a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:44.492018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-656d39e7-674c-4fcf-8a17-3b496492f989 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.212141 Jul 27 23:12:44.492599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1263/2711] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:44 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:44.495869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-36198aa7-67f5-4382-a8af-24a2ab9e36a3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.210000 Jul 27 23:12:44.496834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1449/2712] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:44 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:44.496979 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-72a14aa7-5677-43a3-b716-d03a4fe7fc0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:44.497661 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-72a14aa7-5677-43a3-b716-d03a4fe7fc0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:44.503317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72a14aa7-5677-43a3-b716-d03a4fe7fc0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:44.503769 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72a14aa7-5677-43a3-b716-d03a4fe7fc0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:44.504529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72a14aa7-5677-43a3-b716-d03a4fe7fc0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:44.505000 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72a14aa7-5677-43a3-b716-d03a4fe7fc0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:44.634508 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-72a14aa7-5677-43a3-b716-d03a4fe7fc0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:44.642793 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-72a14aa7-5677-43a3-b716-d03a4fe7fc0f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.149252 Jul 27 23:12:44.643355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1264/2713] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:44 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:45.514525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b0c8eca7-9704-4aa1-8a06-e8c31e3e4b2b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:45.515139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b0c8eca7-9704-4aa1-8a06-e8c31e3e4b2b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:45.516951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9ab3b9b4-0f34-403d-b25b-63da2fc313a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:45.517557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9ab3b9b4-0f34-403d-b25b-63da2fc313a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:45.517829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=96 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:45.523276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0c8eca7-9704-4aa1-8a06-e8c31e3e4b2b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:45.523718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0c8eca7-9704-4aa1-8a06-e8c31e3e4b2b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:45.524076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9ab3b9b4-0f34-403d-b25b-63da2fc313a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:45.524478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0c8eca7-9704-4aa1-8a06-e8c31e3e4b2b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:45.524619 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9ab3b9b4-0f34-403d-b25b-63da2fc313a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:45.524934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0c8eca7-9704-4aa1-8a06-e8c31e3e4b2b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:45.525315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9ab3b9b4-0f34-403d-b25b-63da2fc313a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:45.525746 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9ab3b9b4-0f34-403d-b25b-63da2fc313a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:45.719065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9ab3b9b4-0f34-403d-b25b-63da2fc313a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:45.723982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b0c8eca7-9704-4aa1-8a06-e8c31e3e4b2b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:45.727302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9ab3b9b4-0f34-403d-b25b-63da2fc313a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.214108 Jul 27 23:12:45.727875 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1265/2714] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:45 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:45.732766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6cb46f01-865e-4fe4-8e2c-98d0c8850bfd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:45.732922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b0c8eca7-9704-4aa1-8a06-e8c31e3e4b2b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.222041 Jul 27 23:12:45.733491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1450/2715] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:45 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:45.733711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6cb46f01-865e-4fe4-8e2c-98d0c8850bfd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:45.739764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6cb46f01-865e-4fe4-8e2c-98d0c8850bfd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:45.740207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6cb46f01-865e-4fe4-8e2c-98d0c8850bfd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:45.741051 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6cb46f01-865e-4fe4-8e2c-98d0c8850bfd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:45.741485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6cb46f01-865e-4fe4-8e2c-98d0c8850bfd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:45.870461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6cb46f01-865e-4fe4-8e2c-98d0c8850bfd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:45.878314 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6cb46f01-865e-4fe4-8e2c-98d0c8850bfd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.149516 Jul 27 23:12:45.878877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1266/2716] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:45 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:46.749052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-79e09310-dabf-4020-9698-1e1449951719 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:46.749641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-79e09310-dabf-4020-9698-1e1449951719 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:46.754126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-741df96e-a79a-419e-ab38-928e295bf9ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:46.754728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-741df96e-a79a-419e-ab38-928e295bf9ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:46.756152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79e09310-dabf-4020-9698-1e1449951719 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:46.756629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79e09310-dabf-4020-9698-1e1449951719 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:46.757388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79e09310-dabf-4020-9698-1e1449951719 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:46.757820 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79e09310-dabf-4020-9698-1e1449951719 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:46.758142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=85 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:46.762153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-741df96e-a79a-419e-ab38-928e295bf9ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:46.762593 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-741df96e-a79a-419e-ab38-928e295bf9ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:46.763342 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-741df96e-a79a-419e-ab38-928e295bf9ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:46.763766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-741df96e-a79a-419e-ab38-928e295bf9ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:46.946500 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-79e09310-dabf-4020-9698-1e1449951719 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:46.957138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-79e09310-dabf-4020-9698-1e1449951719 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.212032 Jul 27 23:12:46.957308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-741df96e-a79a-419e-ab38-928e295bf9ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:46.957724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1451/2717] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:46 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:46.962146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-98f78be3-0a56-478a-9fdf-b5b1aa782869 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:46.962824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-98f78be3-0a56-478a-9fdf-b5b1aa782869 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:46.966150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-741df96e-a79a-419e-ab38-928e295bf9ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215202 Jul 27 23:12:46.973250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1267/2718] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:46 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:46.973414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98f78be3-0a56-478a-9fdf-b5b1aa782869 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:46.973414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98f78be3-0a56-478a-9fdf-b5b1aa782869 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:46.973414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98f78be3-0a56-478a-9fdf-b5b1aa782869 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:46.973414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98f78be3-0a56-478a-9fdf-b5b1aa782869 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:47.097461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-98f78be3-0a56-478a-9fdf-b5b1aa782869 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:47.105308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-98f78be3-0a56-478a-9fdf-b5b1aa782869 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.146655 Jul 27 23:12:47.105868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1452/2719] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:46 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:47.978899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3fcba86b-cb33-4491-9623-10c0eebb1bc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:47.979508 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3fcba86b-cb33-4491-9623-10c0eebb1bc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:47.986832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3fcba86b-cb33-4491-9623-10c0eebb1bc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:47.987276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3fcba86b-cb33-4491-9623-10c0eebb1bc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:47.987860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-97703735-2ee2-47f2-b736-9002326e10d5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:47.988267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3fcba86b-cb33-4491-9623-10c0eebb1bc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:47.988444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3fcba86b-cb33-4491-9623-10c0eebb1bc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:47.988636 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-97703735-2ee2-47f2-b736-9002326e10d5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:47.994836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97703735-2ee2-47f2-b736-9002326e10d5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:47.995268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97703735-2ee2-47f2-b736-9002326e10d5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:47.996012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97703735-2ee2-47f2-b736-9002326e10d5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:47.997019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97703735-2ee2-47f2-b736-9002326e10d5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:48.179292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3fcba86b-cb33-4491-9623-10c0eebb1bc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:48.186187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-97703735-2ee2-47f2-b736-9002326e10d5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:48.187665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3fcba86b-cb33-4491-9623-10c0eebb1bc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.212624 Jul 27 23:12:48.188263 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1268/2720] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:47 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:48.192686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-225ce9bd-5e77-49e1-8e0b-3471e3cde938 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:48.193416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-225ce9bd-5e77-49e1-8e0b-3471e3cde938 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:48.199038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-225ce9bd-5e77-49e1-8e0b-3471e3cde938 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:48.199480 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-225ce9bd-5e77-49e1-8e0b-3471e3cde938 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:48.200077 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-97703735-2ee2-47f2-b736-9002326e10d5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216311 Jul 27 23:12:48.200271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-225ce9bd-5e77-49e1-8e0b-3471e3cde938 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:48.200678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-225ce9bd-5e77-49e1-8e0b-3471e3cde938 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:48.207186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1453/2721] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:47 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:48.333414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-225ce9bd-5e77-49e1-8e0b-3471e3cde938 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:48.341774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-225ce9bd-5e77-49e1-8e0b-3471e3cde938 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.152083 Jul 27 23:12:48.342331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1269/2722] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:48 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:49.208473 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-147e0fe4-ecb3-4bda-aaad-e5738c93a00e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:49.209120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-147e0fe4-ecb3-4bda-aaad-e5738c93a00e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:49.215637 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-147e0fe4-ecb3-4bda-aaad-e5738c93a00e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:49.216061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-147e0fe4-ecb3-4bda-aaad-e5738c93a00e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:49.216839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-147e0fe4-ecb3-4bda-aaad-e5738c93a00e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:49.217271 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-147e0fe4-ecb3-4bda-aaad-e5738c93a00e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:49.220579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ceaeac63-0349-4e71-a795-8fbc596da574 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:49.221310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ceaeac63-0349-4e71-a795-8fbc596da574 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:49.227241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ceaeac63-0349-4e71-a795-8fbc596da574 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:49.227684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ceaeac63-0349-4e71-a795-8fbc596da574 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:49.228437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ceaeac63-0349-4e71-a795-8fbc596da574 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:49.228888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ceaeac63-0349-4e71-a795-8fbc596da574 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:49.405280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-147e0fe4-ecb3-4bda-aaad-e5738c93a00e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:49.411666 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ceaeac63-0349-4e71-a795-8fbc596da574 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:49.413458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-147e0fe4-ecb3-4bda-aaad-e5738c93a00e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.208755 Jul 27 23:12:49.414041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1454/2723] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:49 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:49.418639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6a43c4b5-3e00-42c5-bfeb-6dedc73bf155 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:49.419484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6a43c4b5-3e00-42c5-bfeb-6dedc73bf155 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:49.419624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ceaeac63-0349-4e71-a795-8fbc596da574 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.202694 Jul 27 23:12:49.420219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1270/2724] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:49 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:49.426297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6a43c4b5-3e00-42c5-bfeb-6dedc73bf155 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:49.426881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6a43c4b5-3e00-42c5-bfeb-6dedc73bf155 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:49.427702 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6a43c4b5-3e00-42c5-bfeb-6dedc73bf155 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:49.428135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6a43c4b5-3e00-42c5-bfeb-6dedc73bf155 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:49.553109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6a43c4b5-3e00-42c5-bfeb-6dedc73bf155 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:49.560863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6a43c4b5-3e00-42c5-bfeb-6dedc73bf155 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.145877 Jul 27 23:12:49.561419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1455/2725] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:49 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:50.434997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c9ffbe1f-92b4-48ce-b28d-9b45bf78f949 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:50.435570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c9ffbe1f-92b4-48ce-b28d-9b45bf78f949 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:50.441153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2e0f5346-62ae-4817-aae3-3e8a187a0ced tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:50.441764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2e0f5346-62ae-4817-aae3-3e8a187a0ced tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:50.442866 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c9ffbe1f-92b4-48ce-b28d-9b45bf78f949 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:50.443320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c9ffbe1f-92b4-48ce-b28d-9b45bf78f949 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:50.444080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c9ffbe1f-92b4-48ce-b28d-9b45bf78f949 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:50.444511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c9ffbe1f-92b4-48ce-b28d-9b45bf78f949 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:50.449478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e0f5346-62ae-4817-aae3-3e8a187a0ced tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:50.449478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e0f5346-62ae-4817-aae3-3e8a187a0ced tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:50.449478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e0f5346-62ae-4817-aae3-3e8a187a0ced tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:50.449838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e0f5346-62ae-4817-aae3-3e8a187a0ced tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:50.630417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c9ffbe1f-92b4-48ce-b28d-9b45bf78f949 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:50.638585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c9ffbe1f-92b4-48ce-b28d-9b45bf78f949 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.207526 Jul 27 23:12:50.639189 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1271/2726] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:50.640782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2e0f5346-62ae-4817-aae3-3e8a187a0ced tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:50.644363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ad7fa685-6ba3-42fe-8d47-f46dc84b62e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:50.644534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ad7fa685-6ba3-42fe-8d47-f46dc84b62e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:50.648838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2e0f5346-62ae-4817-aae3-3e8a187a0ced tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.211930 Jul 27 23:12:50.652589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1456/2727] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:50 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:50.652757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad7fa685-6ba3-42fe-8d47-f46dc84b62e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:50.652757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad7fa685-6ba3-42fe-8d47-f46dc84b62e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:50.652757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad7fa685-6ba3-42fe-8d47-f46dc84b62e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:50.652757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad7fa685-6ba3-42fe-8d47-f46dc84b62e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:50.776372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ad7fa685-6ba3-42fe-8d47-f46dc84b62e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:50.784200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ad7fa685-6ba3-42fe-8d47-f46dc84b62e5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.144088 Jul 27 23:12:50.784798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1272/2728] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:50 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:51.660107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bf6ca6a4-5936-44c6-9ffb-47e75fd96a6d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:51.660741 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bf6ca6a4-5936-44c6-9ffb-47e75fd96a6d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:51.667233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf6ca6a4-5936-44c6-9ffb-47e75fd96a6d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:51.667673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf6ca6a4-5936-44c6-9ffb-47e75fd96a6d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:51.668417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf6ca6a4-5936-44c6-9ffb-47e75fd96a6d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:51.668869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf6ca6a4-5936-44c6-9ffb-47e75fd96a6d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:51.669948 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ac527b0c-cc0d-4173-b980-6c7d7f3d3f68 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:51.670557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ac527b0c-cc0d-4173-b980-6c7d7f3d3f68 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:51.677074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac527b0c-cc0d-4173-b980-6c7d7f3d3f68 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:51.677529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac527b0c-cc0d-4173-b980-6c7d7f3d3f68 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:51.678295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac527b0c-cc0d-4173-b980-6c7d7f3d3f68 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:51.678768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ac527b0c-cc0d-4173-b980-6c7d7f3d3f68 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:52.064574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bf6ca6a4-5936-44c6-9ffb-47e75fd96a6d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:52.067472 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ac527b0c-cc0d-4173-b980-6c7d7f3d3f68 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:52.072624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bf6ca6a4-5936-44c6-9ffb-47e75fd96a6d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.416885 Jul 27 23:12:52.073241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1457/2729] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:51 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:52.076219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ac527b0c-cc0d-4173-b980-6c7d7f3d3f68 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.409847 Jul 27 23:12:52.077012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1273/2730] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:51 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:52.078231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3eefe54c-bd20-47c8-8dc4-8b6818723c9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:52.079277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3eefe54c-bd20-47c8-8dc4-8b6818723c9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:52.085150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3eefe54c-bd20-47c8-8dc4-8b6818723c9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:52.085621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3eefe54c-bd20-47c8-8dc4-8b6818723c9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:52.086389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3eefe54c-bd20-47c8-8dc4-8b6818723c9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:52.086825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3eefe54c-bd20-47c8-8dc4-8b6818723c9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:52.218519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3eefe54c-bd20-47c8-8dc4-8b6818723c9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:52.227241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3eefe54c-bd20-47c8-8dc4-8b6818723c9c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.153115 Jul 27 23:12:52.227869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1458/2731] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:52 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:53.094497 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6077c229-bb75-4f3b-a2b3-9d5418ade72c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:53.095102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6077c229-bb75-4f3b-a2b3-9d5418ade72c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:53.098299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0d164555-7e7d-4996-bf23-6f23320404bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:53.098909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0d164555-7e7d-4996-bf23-6f23320404bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:53.101570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6077c229-bb75-4f3b-a2b3-9d5418ade72c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:53.102014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6077c229-bb75-4f3b-a2b3-9d5418ade72c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:53.102774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6077c229-bb75-4f3b-a2b3-9d5418ade72c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:53.103198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6077c229-bb75-4f3b-a2b3-9d5418ade72c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:53.105547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d164555-7e7d-4996-bf23-6f23320404bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:53.105991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d164555-7e7d-4996-bf23-6f23320404bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:53.106747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d164555-7e7d-4996-bf23-6f23320404bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:53.107180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d164555-7e7d-4996-bf23-6f23320404bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:53.296285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0d164555-7e7d-4996-bf23-6f23320404bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:53.302995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6077c229-bb75-4f3b-a2b3-9d5418ade72c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:53.304219 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0d164555-7e7d-4996-bf23-6f23320404bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.209688 Jul 27 23:12:53.308605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1459/2732] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:53 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:53.309206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-99b56b68-fe51-489c-85ff-7752e2b53a2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:53.309809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-99b56b68-fe51-489c-85ff-7752e2b53a2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:53.311391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6077c229-bb75-4f3b-a2b3-9d5418ade72c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.220798 Jul 27 23:12:53.312090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1274/2733] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:53 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:53.316169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99b56b68-fe51-489c-85ff-7752e2b53a2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:53.316649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99b56b68-fe51-489c-85ff-7752e2b53a2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:53.317406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99b56b68-fe51-489c-85ff-7752e2b53a2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:53.317850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99b56b68-fe51-489c-85ff-7752e2b53a2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:53.321738 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:53.442743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-99b56b68-fe51-489c-85ff-7752e2b53a2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:53.450657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-99b56b68-fe51-489c-85ff-7752e2b53a2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.144911 Jul 27 23:12:53.451228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1460/2734] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:53 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:54.325425 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ff915bf5-23b2-4620-8243-bdb66c594655 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:54.326030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ff915bf5-23b2-4620-8243-bdb66c594655 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:54.333281 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff915bf5-23b2-4620-8243-bdb66c594655 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:54.333435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ebe975de-5627-45a8-a50e-a0d035a2e95b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:54.333844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff915bf5-23b2-4620-8243-bdb66c594655 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:54.333961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ebe975de-5627-45a8-a50e-a0d035a2e95b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:54.334523 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff915bf5-23b2-4620-8243-bdb66c594655 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:54.334958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff915bf5-23b2-4620-8243-bdb66c594655 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:54.340252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebe975de-5627-45a8-a50e-a0d035a2e95b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:54.340723 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebe975de-5627-45a8-a50e-a0d035a2e95b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:54.341496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebe975de-5627-45a8-a50e-a0d035a2e95b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:54.341923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebe975de-5627-45a8-a50e-a0d035a2e95b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:54.530058 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ff915bf5-23b2-4620-8243-bdb66c594655 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:54.533165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ebe975de-5627-45a8-a50e-a0d035a2e95b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:54.538145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ff915bf5-23b2-4620-8243-bdb66c594655 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216570 Jul 27 23:12:54.538725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1275/2735] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:54 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:54.541076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ebe975de-5627-45a8-a50e-a0d035a2e95b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.212193 Jul 27 23:12:54.549145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1461/2736] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:54 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:54.549320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-25876221-ec7c-4c5d-8c5a-fb2f244bc81e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:54.549320 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-25876221-ec7c-4c5d-8c5a-fb2f244bc81e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:54.550311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-25876221-ec7c-4c5d-8c5a-fb2f244bc81e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:54.550754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-25876221-ec7c-4c5d-8c5a-fb2f244bc81e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:54.551505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-25876221-ec7c-4c5d-8c5a-fb2f244bc81e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:54.551943 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-25876221-ec7c-4c5d-8c5a-fb2f244bc81e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:54.677363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-25876221-ec7c-4c5d-8c5a-fb2f244bc81e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:54.685174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-25876221-ec7c-4c5d-8c5a-fb2f244bc81e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.145547 Jul 27 23:12:54.685735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1276/2737] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:54 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:55.559591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-99ed0238-1665-433f-b6c6-e21c4ff1fa86 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:55.560203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-99ed0238-1665-433f-b6c6-e21c4ff1fa86 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:55.562294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d87f2c86-6915-45d1-a6c8-0fbe4fd98668 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:55.562907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d87f2c86-6915-45d1-a6c8-0fbe4fd98668 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:55.566889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99ed0238-1665-433f-b6c6-e21c4ff1fa86 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:55.567331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99ed0238-1665-433f-b6c6-e21c4ff1fa86 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:55.568166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99ed0238-1665-433f-b6c6-e21c4ff1fa86 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:55.568799 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-99ed0238-1665-433f-b6c6-e21c4ff1fa86 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:55.569279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d87f2c86-6915-45d1-a6c8-0fbe4fd98668 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:55.569725 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d87f2c86-6915-45d1-a6c8-0fbe4fd98668 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:55.570479 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d87f2c86-6915-45d1-a6c8-0fbe4fd98668 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:55.570911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d87f2c86-6915-45d1-a6c8-0fbe4fd98668 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:55.761794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d87f2c86-6915-45d1-a6c8-0fbe4fd98668 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:55.764812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-99ed0238-1665-433f-b6c6-e21c4ff1fa86 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:55.770021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d87f2c86-6915-45d1-a6c8-0fbe4fd98668 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.211461 Jul 27 23:12:55.770592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1277/2738] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:55 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:55.772583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-99ed0238-1665-433f-b6c6-e21c4ff1fa86 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216775 Jul 27 23:12:55.773275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1462/2739] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:55 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:55.775486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-383d1c1b-1556-446a-8af2-ee3e24289c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:55.776351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-383d1c1b-1556-446a-8af2-ee3e24289c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:55.782630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-383d1c1b-1556-446a-8af2-ee3e24289c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:55.783077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-383d1c1b-1556-446a-8af2-ee3e24289c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:55.783948 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-383d1c1b-1556-446a-8af2-ee3e24289c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:55.784394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-383d1c1b-1556-446a-8af2-ee3e24289c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:55.913635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-383d1c1b-1556-446a-8af2-ee3e24289c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:55.921511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-383d1c1b-1556-446a-8af2-ee3e24289c64 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.149971 Jul 27 23:12:55.922068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1278/2740] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:55 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:56.791218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-498c32ae-3f48-4285-aaa5-955cfd96a1e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:56.791824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-498c32ae-3f48-4285-aaa5-955cfd96a1e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:56.793672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-72887ddd-053b-4583-89ee-b5bf2ee99bc6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:56.794281 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-72887ddd-053b-4583-89ee-b5bf2ee99bc6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:56.798414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-498c32ae-3f48-4285-aaa5-955cfd96a1e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:56.798852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-498c32ae-3f48-4285-aaa5-955cfd96a1e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:56.799601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-498c32ae-3f48-4285-aaa5-955cfd96a1e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:56.800028 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-498c32ae-3f48-4285-aaa5-955cfd96a1e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:56.800756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72887ddd-053b-4583-89ee-b5bf2ee99bc6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:56.801201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72887ddd-053b-4583-89ee-b5bf2ee99bc6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:56.801960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72887ddd-053b-4583-89ee-b5bf2ee99bc6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:56.802390 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72887ddd-053b-4583-89ee-b5bf2ee99bc6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:56.992856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-498c32ae-3f48-4285-aaa5-955cfd96a1e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:56.995828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-72887ddd-053b-4583-89ee-b5bf2ee99bc6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:56.998004 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:12:57.001902 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-498c32ae-3f48-4285-aaa5-955cfd96a1e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.214525 Jul 27 23:12:57.002664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1463/2741] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:56 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:57.005689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-72887ddd-053b-4583-89ee-b5bf2ee99bc6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215833 Jul 27 23:12:57.006373 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1279/2742] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:56 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:57.007145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-02b287f9-ca5b-4364-8eca-3191fe4d9c3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:57.007875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-02b287f9-ca5b-4364-8eca-3191fe4d9c3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:57.013809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-02b287f9-ca5b-4364-8eca-3191fe4d9c3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:57.014248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-02b287f9-ca5b-4364-8eca-3191fe4d9c3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:57.015003 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-02b287f9-ca5b-4364-8eca-3191fe4d9c3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:57.015436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-02b287f9-ca5b-4364-8eca-3191fe4d9c3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:57.142087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-02b287f9-ca5b-4364-8eca-3191fe4d9c3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:57.150011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-02b287f9-ca5b-4364-8eca-3191fe4d9c3a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.146538 Jul 27 23:12:57.150945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1464/2743] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:57 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:58.022606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3548c5f2-4204-46a4-af79-fecd2ea1a7f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:58.023224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3548c5f2-4204-46a4-af79-fecd2ea1a7f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:58.027482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-db74056d-6734-4f3a-9fd2-a205ca942dda tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:58.027850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-db74056d-6734-4f3a-9fd2-a205ca942dda tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:58.029915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3548c5f2-4204-46a4-af79-fecd2ea1a7f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:58.030361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3548c5f2-4204-46a4-af79-fecd2ea1a7f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:58.031142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3548c5f2-4204-46a4-af79-fecd2ea1a7f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:58.031564 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3548c5f2-4204-46a4-af79-fecd2ea1a7f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:58.034441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db74056d-6734-4f3a-9fd2-a205ca942dda tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:58.034886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db74056d-6734-4f3a-9fd2-a205ca942dda tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:58.035707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db74056d-6734-4f3a-9fd2-a205ca942dda tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:58.036069 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-db74056d-6734-4f3a-9fd2-a205ca942dda tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:58.225396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3548c5f2-4204-46a4-af79-fecd2ea1a7f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:58.236295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3548c5f2-4204-46a4-af79-fecd2ea1a7f7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.217376 Jul 27 23:12:58.237845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-db74056d-6734-4f3a-9fd2-a205ca942dda tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:58.245764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-db74056d-6734-4f3a-9fd2-a205ca942dda tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.222512 Jul 27 23:12:58.246504 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1465/2744] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:58 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:58.249327 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1280/2745] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:58 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:58.255669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ec4e6764-4ce9-4b1b-b60b-9483c2b5418a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:58.256364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ec4e6764-4ce9-4b1b-b60b-9483c2b5418a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:58.263133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ec4e6764-4ce9-4b1b-b60b-9483c2b5418a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:58.263660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ec4e6764-4ce9-4b1b-b60b-9483c2b5418a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:58.264502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ec4e6764-4ce9-4b1b-b60b-9483c2b5418a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:58.265060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ec4e6764-4ce9-4b1b-b60b-9483c2b5418a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:58.405683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ec4e6764-4ce9-4b1b-b60b-9483c2b5418a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:58.413966 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ec4e6764-4ce9-4b1b-b60b-9483c2b5418a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.161830 Jul 27 23:12:58.414535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1466/2746] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:58 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:59.258847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bab06269-85f6-42c6-8980-48573ff1572e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:59.259457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bab06269-85f6-42c6-8980-48573ff1572e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:59.266093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bab06269-85f6-42c6-8980-48573ff1572e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:59.266534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bab06269-85f6-42c6-8980-48573ff1572e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:59.266956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e9fbfee3-2b66-412e-b7fa-320d2864245c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:59.267358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bab06269-85f6-42c6-8980-48573ff1572e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:59.267563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e9fbfee3-2b66-412e-b7fa-320d2864245c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:59.267707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bab06269-85f6-42c6-8980-48573ff1572e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:59.273954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9fbfee3-2b66-412e-b7fa-320d2864245c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:59.274391 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9fbfee3-2b66-412e-b7fa-320d2864245c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:59.275139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9fbfee3-2b66-412e-b7fa-320d2864245c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:59.275564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e9fbfee3-2b66-412e-b7fa-320d2864245c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:59.458746 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bab06269-85f6-42c6-8980-48573ff1572e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:59.461897 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e9fbfee3-2b66-412e-b7fa-320d2864245c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:59.466841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bab06269-85f6-42c6-8980-48573ff1572e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.211901 Jul 27 23:12:59.467612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1281/2747] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:59 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:12:59.470263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e9fbfee3-2b66-412e-b7fa-320d2864245c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.207035 Jul 27 23:12:59.470994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1467/2748] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:59 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:12:59.472841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a3cc84ce-d74c-4ab7-bc3d-7ce382d91198 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:12:59.473448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a3cc84ce-d74c-4ab7-bc3d-7ce382d91198 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:12:59.479113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3cc84ce-d74c-4ab7-bc3d-7ce382d91198 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:59.479555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3cc84ce-d74c-4ab7-bc3d-7ce382d91198 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:59.480304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3cc84ce-d74c-4ab7-bc3d-7ce382d91198 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:12:59.480763 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3cc84ce-d74c-4ab7-bc3d-7ce382d91198 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:12:59.614516 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a3cc84ce-d74c-4ab7-bc3d-7ce382d91198 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:12:59.622272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a3cc84ce-d74c-4ab7-bc3d-7ce382d91198 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.153876 Jul 27 23:12:59.622827 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1282/2749] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:12:59 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:00.489244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e63e2ad7-e911-44f0-b9ba-ae8f6b99551a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:00.489877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e63e2ad7-e911-44f0-b9ba-ae8f6b99551a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:00.491295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3209cf10-95ed-468d-801e-d922588ef1dc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:00.491919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3209cf10-95ed-468d-801e-d922588ef1dc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:00.496364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e63e2ad7-e911-44f0-b9ba-ae8f6b99551a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:00.496835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e63e2ad7-e911-44f0-b9ba-ae8f6b99551a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:00.497616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e63e2ad7-e911-44f0-b9ba-ae8f6b99551a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:00.498040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e63e2ad7-e911-44f0-b9ba-ae8f6b99551a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:00.498417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3209cf10-95ed-468d-801e-d922588ef1dc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:00.498860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3209cf10-95ed-468d-801e-d922588ef1dc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:00.499603 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3209cf10-95ed-468d-801e-d922588ef1dc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:00.500060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3209cf10-95ed-468d-801e-d922588ef1dc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:00.692592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e63e2ad7-e911-44f0-b9ba-ae8f6b99551a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:00.695488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3209cf10-95ed-468d-801e-d922588ef1dc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:00.700520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e63e2ad7-e911-44f0-b9ba-ae8f6b99551a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.215892 Jul 27 23:13:00.701106 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1468/2750] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:00 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:00.703956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3209cf10-95ed-468d-801e-d922588ef1dc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215941 Jul 27 23:13:00.704697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1283/2751] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:00 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:00.706049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d9747aed-22e6-4584-9fa0-256639752fe6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:00.706664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d9747aed-22e6-4584-9fa0-256639752fe6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:00.712534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d9747aed-22e6-4584-9fa0-256639752fe6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:00.713292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d9747aed-22e6-4584-9fa0-256639752fe6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:00.714432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d9747aed-22e6-4584-9fa0-256639752fe6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:00.715042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d9747aed-22e6-4584-9fa0-256639752fe6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:00.842268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d9747aed-22e6-4584-9fa0-256639752fe6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:00.850189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d9747aed-22e6-4584-9fa0-256639752fe6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.148163 Jul 27 23:13:00.850801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1469/2752] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:00 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:01.722641 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f41ab5d3-ad93-4205-b5e6-dfbf72b9908a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:01.723414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f41ab5d3-ad93-4205-b5e6-dfbf72b9908a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:01.725726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d791ee71-2d2f-40d8-9435-fd53c13cc6f0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:01.726340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d791ee71-2d2f-40d8-9435-fd53c13cc6f0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:01.730459 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f41ab5d3-ad93-4205-b5e6-dfbf72b9908a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:01.730902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f41ab5d3-ad93-4205-b5e6-dfbf72b9908a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:01.731695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f41ab5d3-ad93-4205-b5e6-dfbf72b9908a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:01.732167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f41ab5d3-ad93-4205-b5e6-dfbf72b9908a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:01.733586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d791ee71-2d2f-40d8-9435-fd53c13cc6f0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:01.734029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d791ee71-2d2f-40d8-9435-fd53c13cc6f0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:01.735724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d791ee71-2d2f-40d8-9435-fd53c13cc6f0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:01.736158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d791ee71-2d2f-40d8-9435-fd53c13cc6f0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:01.938308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f41ab5d3-ad93-4205-b5e6-dfbf72b9908a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:01.941632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d791ee71-2d2f-40d8-9435-fd53c13cc6f0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:01.946500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f41ab5d3-ad93-4205-b5e6-dfbf72b9908a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.228292 Jul 27 23:13:01.947140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1284/2753] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:01 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:01.949536 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d791ee71-2d2f-40d8-9435-fd53c13cc6f0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.227823 Jul 27 23:13:01.950263 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1470/2754] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:01 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:01.951778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4570956c-6e5b-490c-896c-ea36277d6e23 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:01.952454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4570956c-6e5b-490c-896c-ea36277d6e23 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:01.958705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4570956c-6e5b-490c-896c-ea36277d6e23 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:01.959206 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4570956c-6e5b-490c-896c-ea36277d6e23 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:01.960024 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4570956c-6e5b-490c-896c-ea36277d6e23 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:01.960522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4570956c-6e5b-490c-896c-ea36277d6e23 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:02.093566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4570956c-6e5b-490c-896c-ea36277d6e23 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:02.102021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4570956c-6e5b-490c-896c-ea36277d6e23 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.153890 Jul 27 23:13:02.102600 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1285/2755] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:01 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:02.968664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bfb2559d-a68f-4f98-aa9a-fb9af0303964 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:02.969851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bfb2559d-a68f-4f98-aa9a-fb9af0303964 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:02.971255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e4dbd37b-dd41-4dfd-802b-2883dd5cd288 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:02.971865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e4dbd37b-dd41-4dfd-802b-2883dd5cd288 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:02.976410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bfb2559d-a68f-4f98-aa9a-fb9af0303964 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:02.976891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bfb2559d-a68f-4f98-aa9a-fb9af0303964 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:02.977644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bfb2559d-a68f-4f98-aa9a-fb9af0303964 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:02.978075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bfb2559d-a68f-4f98-aa9a-fb9af0303964 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:02.978250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4dbd37b-dd41-4dfd-802b-2883dd5cd288 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:02.978698 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4dbd37b-dd41-4dfd-802b-2883dd5cd288 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:02.979455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4dbd37b-dd41-4dfd-802b-2883dd5cd288 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:02.979887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4dbd37b-dd41-4dfd-802b-2883dd5cd288 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:03.171304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bfb2559d-a68f-4f98-aa9a-fb9af0303964 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:03.175240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e4dbd37b-dd41-4dfd-802b-2883dd5cd288 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:03.179562 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bfb2559d-a68f-4f98-aa9a-fb9af0303964 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.214698 Jul 27 23:13:03.180225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1471/2756] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:02 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:03.183191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e4dbd37b-dd41-4dfd-802b-2883dd5cd288 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216267 Jul 27 23:13:03.183880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1286/2757] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:02 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:03.184880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-642b0811-2a14-45c8-b0c6-a62f5e13c412 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:03.185482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-642b0811-2a14-45c8-b0c6-a62f5e13c412 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:03.191681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-642b0811-2a14-45c8-b0c6-a62f5e13c412 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:03.192126 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-642b0811-2a14-45c8-b0c6-a62f5e13c412 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:03.192904 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-642b0811-2a14-45c8-b0c6-a62f5e13c412 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:03.193339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-642b0811-2a14-45c8-b0c6-a62f5e13c412 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:03.318201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-642b0811-2a14-45c8-b0c6-a62f5e13c412 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:03.326031 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-642b0811-2a14-45c8-b0c6-a62f5e13c412 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.144856 Jul 27 23:13:03.326593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1472/2758] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:03 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:04.200966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6b1d3697-e657-4ab1-a1ac-306fd7bac148 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:04.201571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6b1d3697-e657-4ab1-a1ac-306fd7bac148 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:04.204781 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-314de38e-938d-4a85-aba1-d62d1f4e853c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:04.205395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-314de38e-938d-4a85-aba1-d62d1f4e853c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:04.208766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b1d3697-e657-4ab1-a1ac-306fd7bac148 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:04.209210 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b1d3697-e657-4ab1-a1ac-306fd7bac148 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:04.209978 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b1d3697-e657-4ab1-a1ac-306fd7bac148 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:04.210406 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b1d3697-e657-4ab1-a1ac-306fd7bac148 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:04.212176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-314de38e-938d-4a85-aba1-d62d1f4e853c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:04.212656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-314de38e-938d-4a85-aba1-d62d1f4e853c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:04.213429 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-314de38e-938d-4a85-aba1-d62d1f4e853c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:04.213881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-314de38e-938d-4a85-aba1-d62d1f4e853c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:04.408751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6b1d3697-e657-4ab1-a1ac-306fd7bac148 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:04.411760 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-314de38e-938d-4a85-aba1-d62d1f4e853c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:04.416619 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6b1d3697-e657-4ab1-a1ac-306fd7bac148 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.219450 Jul 27 23:13:04.417266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1287/2759] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:04 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:04.419934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-314de38e-938d-4a85-aba1-d62d1f4e853c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.219410 Jul 27 23:13:04.420934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1473/2760] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:04 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:04.421608 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f3ab13a4-7cf4-46f2-9c60-008fd543c6b4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:04.422434 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f3ab13a4-7cf4-46f2-9c60-008fd543c6b4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:04.428364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3ab13a4-7cf4-46f2-9c60-008fd543c6b4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:04.428906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3ab13a4-7cf4-46f2-9c60-008fd543c6b4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:04.429735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3ab13a4-7cf4-46f2-9c60-008fd543c6b4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:04.430230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f3ab13a4-7cf4-46f2-9c60-008fd543c6b4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:04.554746 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f3ab13a4-7cf4-46f2-9c60-008fd543c6b4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:04.562568 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f3ab13a4-7cf4-46f2-9c60-008fd543c6b4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.144385 Jul 27 23:13:04.563626 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1288/2761] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:04 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:05.022262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-884bcb0b-d19a-48b9-9cf3-a20c225c2e72 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:05.022746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-884bcb0b-d19a-48b9-9cf3-a20c225c2e72 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:05.028688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-884bcb0b-d19a-48b9-9cf3-a20c225c2e72 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:05.029132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-884bcb0b-d19a-48b9-9cf3-a20c225c2e72 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:05.029873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-884bcb0b-d19a-48b9-9cf3-a20c225c2e72 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:05.030300 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-884bcb0b-d19a-48b9-9cf3-a20c225c2e72 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:05.052489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-884bcb0b-d19a-48b9-9cf3-a20c225c2e72 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa/ips" status: 200 len: 151 microversion: 2.20 time: 0.034119 Jul 27 23:13:05.053058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1474/2762] 10.222.0.47 () {60 vars in 1289 bytes} [Wed Jul 27 23:13:05 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa/ips => generated 151 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 23:13:05.437709 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9498fe8e-e2bc-4902-9b42-609a955c875b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:05.438325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9498fe8e-e2bc-4902-9b42-609a955c875b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:05.441052 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-72958487-b8bb-4714-bbc0-9ee5800366ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:05.441670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-72958487-b8bb-4714-bbc0-9ee5800366ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:05.444926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9498fe8e-e2bc-4902-9b42-609a955c875b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:05.445400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9498fe8e-e2bc-4902-9b42-609a955c875b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:05.446162 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9498fe8e-e2bc-4902-9b42-609a955c875b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:05.446594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9498fe8e-e2bc-4902-9b42-609a955c875b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:05.448318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72958487-b8bb-4714-bbc0-9ee5800366ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:05.448883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72958487-b8bb-4714-bbc0-9ee5800366ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:05.449574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72958487-b8bb-4714-bbc0-9ee5800366ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:05.450011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72958487-b8bb-4714-bbc0-9ee5800366ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:05.635987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9498fe8e-e2bc-4902-9b42-609a955c875b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:05.643231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-72958487-b8bb-4714-bbc0-9ee5800366ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:05.644451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9498fe8e-e2bc-4902-9b42-609a955c875b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.210599 Jul 27 23:13:05.645066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1289/2763] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:05 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:05.649452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e04a566f-76c2-4cf7-8c60-15a016ca1d37 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:05.650057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e04a566f-76c2-4cf7-8c60-15a016ca1d37 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:05.651811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-72958487-b8bb-4714-bbc0-9ee5800366ec tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214581 Jul 27 23:13:05.652517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1475/2764] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:05 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:05.656086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e04a566f-76c2-4cf7-8c60-15a016ca1d37 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:05.657203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e04a566f-76c2-4cf7-8c60-15a016ca1d37 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:05.657968 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e04a566f-76c2-4cf7-8c60-15a016ca1d37 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:05.658402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e04a566f-76c2-4cf7-8c60-15a016ca1d37 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:05.789068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e04a566f-76c2-4cf7-8c60-15a016ca1d37 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:05.796848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e04a566f-76c2-4cf7-8c60-15a016ca1d37 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.150842 Jul 27 23:13:05.797400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1290/2765] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:05 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:06.666101 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-79c21997-211d-4d45-9597-ec0ce88e7125 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:06.666712 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-79c21997-211d-4d45-9597-ec0ce88e7125 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:06.673681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79c21997-211d-4d45-9597-ec0ce88e7125 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:06.674141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79c21997-211d-4d45-9597-ec0ce88e7125 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:06.674263 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5c00262c-bd00-43b8-a996-febeca623af0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:06.674789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5c00262c-bd00-43b8-a996-febeca623af0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:06.674919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79c21997-211d-4d45-9597-ec0ce88e7125 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:06.675354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-79c21997-211d-4d45-9597-ec0ce88e7125 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:06.681269 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5c00262c-bd00-43b8-a996-febeca623af0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:06.681712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5c00262c-bd00-43b8-a996-febeca623af0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:06.682461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5c00262c-bd00-43b8-a996-febeca623af0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:06.682887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5c00262c-bd00-43b8-a996-febeca623af0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:06.868999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-79c21997-211d-4d45-9597-ec0ce88e7125 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:06.871967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5c00262c-bd00-43b8-a996-febeca623af0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:06.877527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-79c21997-211d-4d45-9597-ec0ce88e7125 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.215252 Jul 27 23:13:06.878157 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1476/2766] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:06 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:06.880341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5c00262c-bd00-43b8-a996-febeca623af0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.210297 Jul 27 23:13:06.881264 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1291/2767] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:06 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:06.882657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b9b9896e-1d8c-4d8f-94e4-2bd1f8e6f3f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:06.883261 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b9b9896e-1d8c-4d8f-94e4-2bd1f8e6f3f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:06.889204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b9b9896e-1d8c-4d8f-94e4-2bd1f8e6f3f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:06.889710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b9b9896e-1d8c-4d8f-94e4-2bd1f8e6f3f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:06.890472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b9b9896e-1d8c-4d8f-94e4-2bd1f8e6f3f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:06.891606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b9b9896e-1d8c-4d8f-94e4-2bd1f8e6f3f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:06.895797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:13:07.024090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b9b9896e-1d8c-4d8f-94e4-2bd1f8e6f3f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:07.031946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b9b9896e-1d8c-4d8f-94e4-2bd1f8e6f3f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.152857 Jul 27 23:13:07.032502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1477/2768] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:06 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:07.900538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d7694fb1-3de6-42a4-a536-634920373252 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:07.901185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d7694fb1-3de6-42a4-a536-634920373252 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:07.902142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e8739a02-0060-4732-b008-d2fddbff8846 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:07.902755 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e8739a02-0060-4732-b008-d2fddbff8846 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:07.907828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7694fb1-3de6-42a4-a536-634920373252 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:07.908896 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7694fb1-3de6-42a4-a536-634920373252 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:07.909655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7694fb1-3de6-42a4-a536-634920373252 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:07.909858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8739a02-0060-4732-b008-d2fddbff8846 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:07.910079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d7694fb1-3de6-42a4-a536-634920373252 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:07.910305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8739a02-0060-4732-b008-d2fddbff8846 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:07.911574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8739a02-0060-4732-b008-d2fddbff8846 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:07.911574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8739a02-0060-4732-b008-d2fddbff8846 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:08.101776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d7694fb1-3de6-42a4-a536-634920373252 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:08.108344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e8739a02-0060-4732-b008-d2fddbff8846 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:08.110178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d7694fb1-3de6-42a4-a536-634920373252 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.213172 Jul 27 23:13:08.110749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1292/2769] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:07 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:08.115088 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b1c85307-f56f-409e-9a72-384e5a0fcb2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:08.115688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b1c85307-f56f-409e-9a72-384e5a0fcb2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:08.116868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e8739a02-0060-4732-b008-d2fddbff8846 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.218436 Jul 27 23:13:08.117640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1478/2770] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:07 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:08.121474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1c85307-f56f-409e-9a72-384e5a0fcb2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:08.121924 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1c85307-f56f-409e-9a72-384e5a0fcb2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:08.122678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1c85307-f56f-409e-9a72-384e5a0fcb2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:08.123111 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b1c85307-f56f-409e-9a72-384e5a0fcb2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:08.251002 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b1c85307-f56f-409e-9a72-384e5a0fcb2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:08.258843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b1c85307-f56f-409e-9a72-384e5a0fcb2f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.147167 Jul 27 23:13:08.259407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1293/2771] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:08 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:09.131308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-35d8cf20-39a4-4d42-92f5-e9b7f3a81e11 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:09.131919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-35d8cf20-39a4-4d42-92f5-e9b7f3a81e11 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:09.137714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2a37cc70-2438-4411-9eeb-a1ed2c639831 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:09.138354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2a37cc70-2438-4411-9eeb-a1ed2c639831 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:09.138716 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d8cf20-39a4-4d42-92f5-e9b7f3a81e11 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:09.139169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d8cf20-39a4-4d42-92f5-e9b7f3a81e11 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:09.139937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d8cf20-39a4-4d42-92f5-e9b7f3a81e11 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:09.140370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d8cf20-39a4-4d42-92f5-e9b7f3a81e11 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:09.145488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a37cc70-2438-4411-9eeb-a1ed2c639831 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:09.145932 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a37cc70-2438-4411-9eeb-a1ed2c639831 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:09.146696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a37cc70-2438-4411-9eeb-a1ed2c639831 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:09.147130 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a37cc70-2438-4411-9eeb-a1ed2c639831 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:09.329930 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-35d8cf20-39a4-4d42-92f5-e9b7f3a81e11 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:09.336826 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2a37cc70-2438-4411-9eeb-a1ed2c639831 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:09.337958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-35d8cf20-39a4-4d42-92f5-e9b7f3a81e11 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.210451 Jul 27 23:13:09.338536 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1479/2772] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:09 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:09.342944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c3c1c875-40f4-47bd-87b8-219900e51bfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:09.343674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c3c1c875-40f4-47bd-87b8-219900e51bfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:09.344991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2a37cc70-2438-4411-9eeb-a1ed2c639831 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.211091 Jul 27 23:13:09.345742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1294/2773] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:09 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:09.349449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3c1c875-40f4-47bd-87b8-219900e51bfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:09.349901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3c1c875-40f4-47bd-87b8-219900e51bfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:09.350652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3c1c875-40f4-47bd-87b8-219900e51bfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:09.351085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c3c1c875-40f4-47bd-87b8-219900e51bfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:09.479806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c3c1c875-40f4-47bd-87b8-219900e51bfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:09.488384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c3c1c875-40f4-47bd-87b8-219900e51bfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.148920 Jul 27 23:13:09.488987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1480/2774] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:09 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:10.358964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-afe296f9-130a-4df1-b644-04c46b293937 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:10.359854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-afe296f9-130a-4df1-b644-04c46b293937 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:10.365789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3f49e5dd-ed7e-4545-80c8-511348e93074 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:10.366399 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3f49e5dd-ed7e-4545-80c8-511348e93074 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:10.366534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-afe296f9-130a-4df1-b644-04c46b293937 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:10.366836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-afe296f9-130a-4df1-b644-04c46b293937 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:10.367586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-afe296f9-130a-4df1-b644-04c46b293937 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:10.368012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-afe296f9-130a-4df1-b644-04c46b293937 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:10.372732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f49e5dd-ed7e-4545-80c8-511348e93074 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:10.373176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f49e5dd-ed7e-4545-80c8-511348e93074 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:10.373918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f49e5dd-ed7e-4545-80c8-511348e93074 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:10.374378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3f49e5dd-ed7e-4545-80c8-511348e93074 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:10.558983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-afe296f9-130a-4df1-b644-04c46b293937 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:10.562181 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3f49e5dd-ed7e-4545-80c8-511348e93074 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:10.567505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-afe296f9-130a-4df1-b644-04c46b293937 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.212354 Jul 27 23:13:10.568152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1295/2775] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:10 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:10.570691 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3f49e5dd-ed7e-4545-80c8-511348e93074 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.208578 Jul 27 23:13:10.571406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1481/2776] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:10 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:10.572707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dec31d56-03ae-4569-9c92-8f7c4fb714a0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:10.573376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dec31d56-03ae-4569-9c92-8f7c4fb714a0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:10.579181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dec31d56-03ae-4569-9c92-8f7c4fb714a0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:10.580350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dec31d56-03ae-4569-9c92-8f7c4fb714a0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:10.581193 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dec31d56-03ae-4569-9c92-8f7c4fb714a0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:10.581686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dec31d56-03ae-4569-9c92-8f7c4fb714a0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:10.596170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:13:10.711175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-dec31d56-03ae-4569-9c92-8f7c4fb714a0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:10.718917 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dec31d56-03ae-4569-9c92-8f7c4fb714a0 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.149761 Jul 27 23:13:10.719471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1296/2777] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:10 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:11.592245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7952f610-40f4-4540-a126-120474f2b605 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:11.592771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7952f610-40f4-4540-a126-120474f2b605 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:11.599656 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7952f610-40f4-4540-a126-120474f2b605 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:11.600099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7952f610-40f4-4540-a126-120474f2b605 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:11.600881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7952f610-40f4-4540-a126-120474f2b605 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:11.601417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7952f610-40f4-4540-a126-120474f2b605 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:11.722327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fb712100-71cf-4903-80ab-91e9d45f9262 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:11.723039 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fb712100-71cf-4903-80ab-91e9d45f9262 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:11.729061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb712100-71cf-4903-80ab-91e9d45f9262 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:11.729501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb712100-71cf-4903-80ab-91e9d45f9262 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:11.730256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb712100-71cf-4903-80ab-91e9d45f9262 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:11.730683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb712100-71cf-4903-80ab-91e9d45f9262 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:11.735190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7952f610-40f4-4540-a126-120474f2b605 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:11.743255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7952f610-40f4-4540-a126-120474f2b605 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.154986 Jul 27 23:13:11.743911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1297/2778] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:11 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:11.748374 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-82b02078-c68c-424e-983c-4e2b56490e85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:11.749080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-82b02078-c68c-424e-983c-4e2b56490e85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:11.754921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82b02078-c68c-424e-983c-4e2b56490e85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:11.755464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82b02078-c68c-424e-983c-4e2b56490e85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:11.756292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82b02078-c68c-424e-983c-4e2b56490e85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:11.756853 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-82b02078-c68c-424e-983c-4e2b56490e85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:11.924623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fb712100-71cf-4903-80ab-91e9d45f9262 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:11.931304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-82b02078-c68c-424e-983c-4e2b56490e85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:11.932458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fb712100-71cf-4903-80ab-91e9d45f9262 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.346819 Jul 27 23:13:11.933055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1482/2779] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:11 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:11.939824 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-82b02078-c68c-424e-983c-4e2b56490e85 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.194904 Jul 27 23:13:11.941120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1298/2780] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:11 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:12.764628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6deb7bf7-8af9-4d65-9994-75ef3c9c6ba5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:12.765236 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6deb7bf7-8af9-4d65-9994-75ef3c9c6ba5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:12.771179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6deb7bf7-8af9-4d65-9994-75ef3c9c6ba5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:12.771619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6deb7bf7-8af9-4d65-9994-75ef3c9c6ba5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:12.772361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6deb7bf7-8af9-4d65-9994-75ef3c9c6ba5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:12.772815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6deb7bf7-8af9-4d65-9994-75ef3c9c6ba5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:12.902318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6deb7bf7-8af9-4d65-9994-75ef3c9c6ba5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:12.910551 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6deb7bf7-8af9-4d65-9994-75ef3c9c6ba5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.149973 Jul 27 23:13:12.911104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1483/2781] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:12 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:12.953504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0e74b638-7f6d-42a5-b9a4-93ce64f3abae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:12.954115 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0e74b638-7f6d-42a5-b9a4-93ce64f3abae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:12.960648 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e74b638-7f6d-42a5-b9a4-93ce64f3abae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:12.960918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5e850805-afa7-481b-ab45-a684c5d7c6bb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:12.961093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e74b638-7f6d-42a5-b9a4-93ce64f3abae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:12.961643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5e850805-afa7-481b-ab45-a684c5d7c6bb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:12.961845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e74b638-7f6d-42a5-b9a4-93ce64f3abae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:12.962279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e74b638-7f6d-42a5-b9a4-93ce64f3abae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:12.967681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5e850805-afa7-481b-ab45-a684c5d7c6bb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:12.968121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5e850805-afa7-481b-ab45-a684c5d7c6bb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:12.968891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5e850805-afa7-481b-ab45-a684c5d7c6bb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:12.969315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5e850805-afa7-481b-ab45-a684c5d7c6bb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:13.156134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0e74b638-7f6d-42a5-b9a4-93ce64f3abae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:13.160441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5e850805-afa7-481b-ab45-a684c5d7c6bb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:13.164936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0e74b638-7f6d-42a5-b9a4-93ce64f3abae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.215125 Jul 27 23:13:13.165504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1299/2782] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:12 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:13.168255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5e850805-afa7-481b-ab45-a684c5d7c6bb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.210991 Jul 27 23:13:13.168831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1484/2783] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:12 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:13.932229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8851f3b1-f857-434c-81a4-a0f39e5af673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:13.932851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8851f3b1-f857-434c-81a4-a0f39e5af673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:13.939601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8851f3b1-f857-434c-81a4-a0f39e5af673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:13.940043 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8851f3b1-f857-434c-81a4-a0f39e5af673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:13.940819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8851f3b1-f857-434c-81a4-a0f39e5af673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:13.941251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8851f3b1-f857-434c-81a4-a0f39e5af673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:14.073097 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8851f3b1-f857-434c-81a4-a0f39e5af673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:14.081360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8851f3b1-f857-434c-81a4-a0f39e5af673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.152919 Jul 27 23:13:14.081925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1300/2784] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:13 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:14.186325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c9a9edc6-9f8f-48bc-99d6-1a696d6f21fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:14.186872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c9a9edc6-9f8f-48bc-99d6-1a696d6f21fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:14.189422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1c1f820b-27c5-4c6a-b6a5-c292711837b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:14.190061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1c1f820b-27c5-4c6a-b6a5-c292711837b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:14.194120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9a9edc6-9f8f-48bc-99d6-1a696d6f21fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:14.194565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9a9edc6-9f8f-48bc-99d6-1a696d6f21fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:14.195321 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9a9edc6-9f8f-48bc-99d6-1a696d6f21fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:14.195752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9a9edc6-9f8f-48bc-99d6-1a696d6f21fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:14.195956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c1f820b-27c5-4c6a-b6a5-c292711837b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:14.196408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c1f820b-27c5-4c6a-b6a5-c292711837b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:14.197318 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c1f820b-27c5-4c6a-b6a5-c292711837b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:14.197758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1c1f820b-27c5-4c6a-b6a5-c292711837b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:14.391680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c9a9edc6-9f8f-48bc-99d6-1a696d6f21fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:14.395090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1c1f820b-27c5-4c6a-b6a5-c292711837b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:14.400035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c9a9edc6-9f8f-48bc-99d6-1a696d6f21fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.217700 Jul 27 23:13:14.400840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1485/2785] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:14 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:14.402968 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1c1f820b-27c5-4c6a-b6a5-c292711837b5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217992 Jul 27 23:13:14.403516 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1301/2786] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:14 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:15.102762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8e09d065-b93c-4f8d-a930-7090783676a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:15.103361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8e09d065-b93c-4f8d-a930-7090783676a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:15.109565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e09d065-b93c-4f8d-a930-7090783676a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:15.110265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e09d065-b93c-4f8d-a930-7090783676a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:15.111059 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e09d065-b93c-4f8d-a930-7090783676a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:15.111482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e09d065-b93c-4f8d-a930-7090783676a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:15.239802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8e09d065-b93c-4f8d-a930-7090783676a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:15.248278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8e09d065-b93c-4f8d-a930-7090783676a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.149346 Jul 27 23:13:15.248896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1486/2787] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:15 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:15.421719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-67ad8fb7-5808-46e8-84e1-ce35e873dbf0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:15.422346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-67ad8fb7-5808-46e8-84e1-ce35e873dbf0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:15.424583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-10c35934-ecf5-461b-8a20-2a77ac7b92bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:15.425191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-10c35934-ecf5-461b-8a20-2a77ac7b92bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:15.429452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67ad8fb7-5808-46e8-84e1-ce35e873dbf0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:15.429896 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67ad8fb7-5808-46e8-84e1-ce35e873dbf0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:15.430648 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67ad8fb7-5808-46e8-84e1-ce35e873dbf0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:15.431032 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10c35934-ecf5-461b-8a20-2a77ac7b92bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:15.431173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67ad8fb7-5808-46e8-84e1-ce35e873dbf0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:15.431480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10c35934-ecf5-461b-8a20-2a77ac7b92bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:15.432222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10c35934-ecf5-461b-8a20-2a77ac7b92bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:15.432688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10c35934-ecf5-461b-8a20-2a77ac7b92bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:15.615176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-67ad8fb7-5808-46e8-84e1-ce35e873dbf0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:15.623136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-67ad8fb7-5808-46e8-84e1-ce35e873dbf0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.205412 Jul 27 23:13:15.623694 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1302/2788] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:15 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:15.625795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-10c35934-ecf5-461b-8a20-2a77ac7b92bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:15.634416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-10c35934-ecf5-461b-8a20-2a77ac7b92bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.214114 Jul 27 23:13:15.634960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1487/2789] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:16.271014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d8e88a92-cc0c-402d-8169-45fa036530b8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:16.271629 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d8e88a92-cc0c-402d-8169-45fa036530b8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:16.277799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8e88a92-cc0c-402d-8169-45fa036530b8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:16.278244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8e88a92-cc0c-402d-8169-45fa036530b8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:16.278997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8e88a92-cc0c-402d-8169-45fa036530b8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:16.279432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8e88a92-cc0c-402d-8169-45fa036530b8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:16.411801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d8e88a92-cc0c-402d-8169-45fa036530b8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:16.419682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d8e88a92-cc0c-402d-8169-45fa036530b8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.153142 Jul 27 23:13:16.420243 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1303/2790] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:16 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:16.645165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e71b31eb-8f05-4001-a6c6-105a27e0661a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:16.645775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e71b31eb-8f05-4001-a6c6-105a27e0661a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:16.648040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=76 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:13:16.653404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e71b31eb-8f05-4001-a6c6-105a27e0661a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:16.653851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e71b31eb-8f05-4001-a6c6-105a27e0661a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:16.654607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e71b31eb-8f05-4001-a6c6-105a27e0661a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:16.654998 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1e077a59-6668-4183-a1ed-b8f9bfd9832a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:16.655429 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e71b31eb-8f05-4001-a6c6-105a27e0661a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:16.655602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1e077a59-6668-4183-a1ed-b8f9bfd9832a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:16.662157 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1e077a59-6668-4183-a1ed-b8f9bfd9832a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:16.662545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1e077a59-6668-4183-a1ed-b8f9bfd9832a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:16.663300 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1e077a59-6668-4183-a1ed-b8f9bfd9832a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:16.663735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1e077a59-6668-4183-a1ed-b8f9bfd9832a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:16.842061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e71b31eb-8f05-4001-a6c6-105a27e0661a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:16.848755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1e077a59-6668-4183-a1ed-b8f9bfd9832a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:16.849981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e71b31eb-8f05-4001-a6c6-105a27e0661a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.209283 Jul 27 23:13:16.850561 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1488/2791] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:16 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:16.857006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1e077a59-6668-4183-a1ed-b8f9bfd9832a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.205692 Jul 27 23:13:16.857561 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1304/2792] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:16 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:17.441464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8c6dd8f8-e78b-41eb-8506-4570a103fe50 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:17.441993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8c6dd8f8-e78b-41eb-8506-4570a103fe50 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:17.448094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c6dd8f8-e78b-41eb-8506-4570a103fe50 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:17.448545 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c6dd8f8-e78b-41eb-8506-4570a103fe50 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:17.449325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c6dd8f8-e78b-41eb-8506-4570a103fe50 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:17.449758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c6dd8f8-e78b-41eb-8506-4570a103fe50 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:17.576571 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8c6dd8f8-e78b-41eb-8506-4570a103fe50 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:17.584392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8c6dd8f8-e78b-41eb-8506-4570a103fe50 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.146855 Jul 27 23:13:17.584992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1489/2793] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:17 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:17.871776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fbdf23fd-5a92-4a3f-b0d2-3f692dc958aa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:17.872381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fbdf23fd-5a92-4a3f-b0d2-3f692dc958aa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:17.874724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=76 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:13:17.878799 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c68752a1-1f19-4eef-a2e3-6fba5959ed4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:17.879411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c68752a1-1f19-4eef-a2e3-6fba5959ed4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:17.879950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fbdf23fd-5a92-4a3f-b0d2-3f692dc958aa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:17.880396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fbdf23fd-5a92-4a3f-b0d2-3f692dc958aa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:17.881179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fbdf23fd-5a92-4a3f-b0d2-3f692dc958aa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:17.881611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fbdf23fd-5a92-4a3f-b0d2-3f692dc958aa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:17.885771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c68752a1-1f19-4eef-a2e3-6fba5959ed4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:17.886212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c68752a1-1f19-4eef-a2e3-6fba5959ed4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:17.886971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c68752a1-1f19-4eef-a2e3-6fba5959ed4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:17.887404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c68752a1-1f19-4eef-a2e3-6fba5959ed4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:18.074074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fbdf23fd-5a92-4a3f-b0d2-3f692dc958aa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:18.076874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c68752a1-1f19-4eef-a2e3-6fba5959ed4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:18.083362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fbdf23fd-5a92-4a3f-b0d2-3f692dc958aa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.215367 Jul 27 23:13:18.083931 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1305/2794] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:17 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:18.085222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c68752a1-1f19-4eef-a2e3-6fba5959ed4d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.210206 Jul 27 23:13:18.085782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1490/2795] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:17 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:18.606659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c91519c6-50e2-4190-9db0-a97b87006081 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:18.607269 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c91519c6-50e2-4190-9db0-a97b87006081 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:18.614171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c91519c6-50e2-4190-9db0-a97b87006081 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:18.614615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c91519c6-50e2-4190-9db0-a97b87006081 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:18.615362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c91519c6-50e2-4190-9db0-a97b87006081 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:18.615792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c91519c6-50e2-4190-9db0-a97b87006081 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:18.744100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c91519c6-50e2-4190-9db0-a97b87006081 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:18.751940 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c91519c6-50e2-4190-9db0-a97b87006081 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.149251 Jul 27 23:13:18.752503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1306/2796] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:18 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:19.103776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-15408f73-81f8-48c3-a485-a4142579b3e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:19.104390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-15408f73-81f8-48c3-a485-a4142579b3e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:19.105356 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-018d0d68-ca04-42c2-94a0-5d22f2283ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:19.105964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-018d0d68-ca04-42c2-94a0-5d22f2283ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:19.111942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15408f73-81f8-48c3-a485-a4142579b3e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:19.112387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15408f73-81f8-48c3-a485-a4142579b3e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:19.112852 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-018d0d68-ca04-42c2-94a0-5d22f2283ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:19.113196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15408f73-81f8-48c3-a485-a4142579b3e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:19.113318 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-018d0d68-ca04-42c2-94a0-5d22f2283ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:19.113628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15408f73-81f8-48c3-a485-a4142579b3e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:19.114028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-018d0d68-ca04-42c2-94a0-5d22f2283ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:19.114455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-018d0d68-ca04-42c2-94a0-5d22f2283ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:19.301309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-018d0d68-ca04-42c2-94a0-5d22f2283ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:19.307906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-15408f73-81f8-48c3-a485-a4142579b3e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:19.309378 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-018d0d68-ca04-42c2-94a0-5d22f2283ddc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.207819 Jul 27 23:13:19.309951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1307/2797] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:19 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:19.315944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-15408f73-81f8-48c3-a485-a4142579b3e6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.216057 Jul 27 23:13:19.316494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1491/2798] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:19 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:19.773718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bba0e5d3-f67a-4176-957d-9d49a1ebcd96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:19.774380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bba0e5d3-f67a-4176-957d-9d49a1ebcd96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:19.780875 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bba0e5d3-f67a-4176-957d-9d49a1ebcd96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:19.781321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bba0e5d3-f67a-4176-957d-9d49a1ebcd96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:19.782085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bba0e5d3-f67a-4176-957d-9d49a1ebcd96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:19.782519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bba0e5d3-f67a-4176-957d-9d49a1ebcd96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:19.910401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bba0e5d3-f67a-4176-957d-9d49a1ebcd96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:19.918251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bba0e5d3-f67a-4176-957d-9d49a1ebcd96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.148453 Jul 27 23:13:19.918816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1308/2799] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:19 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:20.332452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f532db4b-e1f0-4fb6-9699-8f08c2f82000 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:20.333083 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f532db4b-e1f0-4fb6-9699-8f08c2f82000 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:20.336414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-78ccb6a7-cf35-4adf-bfcb-fe9e6503153b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:20.337129 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-78ccb6a7-cf35-4adf-bfcb-fe9e6503153b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:20.339944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f532db4b-e1f0-4fb6-9699-8f08c2f82000 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:20.340098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f532db4b-e1f0-4fb6-9699-8f08c2f82000 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:20.340783 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f532db4b-e1f0-4fb6-9699-8f08c2f82000 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:20.341213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f532db4b-e1f0-4fb6-9699-8f08c2f82000 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:20.342988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78ccb6a7-cf35-4adf-bfcb-fe9e6503153b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:20.343448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78ccb6a7-cf35-4adf-bfcb-fe9e6503153b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:20.344170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78ccb6a7-cf35-4adf-bfcb-fe9e6503153b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:20.344617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78ccb6a7-cf35-4adf-bfcb-fe9e6503153b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:20.537363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f532db4b-e1f0-4fb6-9699-8f08c2f82000 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:20.541269 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-78ccb6a7-cf35-4adf-bfcb-fe9e6503153b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:20.545345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f532db4b-e1f0-4fb6-9699-8f08c2f82000 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.216721 Jul 27 23:13:20.545921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1492/2800] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:20 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:20.550093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-78ccb6a7-cf35-4adf-bfcb-fe9e6503153b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.217464 Jul 27 23:13:20.550647 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1309/2801] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:20 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:20.939343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5393580f-cf11-4e79-adfd-53768b367d40 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:20.939949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5393580f-cf11-4e79-adfd-53768b367d40 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:20.946139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5393580f-cf11-4e79-adfd-53768b367d40 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:20.946589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5393580f-cf11-4e79-adfd-53768b367d40 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:20.947412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5393580f-cf11-4e79-adfd-53768b367d40 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:20.947851 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5393580f-cf11-4e79-adfd-53768b367d40 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:21.073435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5393580f-cf11-4e79-adfd-53768b367d40 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:21.075585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:13:21.083439 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5393580f-cf11-4e79-adfd-53768b367d40 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.148021 Jul 27 23:13:21.084007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1493/2802] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:20 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:21.567589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c8bc9a26-d86b-470b-b6b2-a8a37665fa26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:21.568203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c8bc9a26-d86b-470b-b6b2-a8a37665fa26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:21.570724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fd9bc208-68cc-4797-b40a-29dad75e8fe3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:21.571334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fd9bc208-68cc-4797-b40a-29dad75e8fe3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:21.574801 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8bc9a26-d86b-470b-b6b2-a8a37665fa26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:21.575251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8bc9a26-d86b-470b-b6b2-a8a37665fa26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:21.576010 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8bc9a26-d86b-470b-b6b2-a8a37665fa26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:21.576442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8bc9a26-d86b-470b-b6b2-a8a37665fa26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:21.577936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd9bc208-68cc-4797-b40a-29dad75e8fe3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:21.578377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd9bc208-68cc-4797-b40a-29dad75e8fe3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:21.579121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd9bc208-68cc-4797-b40a-29dad75e8fe3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:21.579549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd9bc208-68cc-4797-b40a-29dad75e8fe3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:21.965415 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c8bc9a26-d86b-470b-b6b2-a8a37665fa26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:21.974015 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c8bc9a26-d86b-470b-b6b2-a8a37665fa26 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.410735 Jul 27 23:13:21.974579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1310/2803] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:21 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:21.977011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fd9bc208-68cc-4797-b40a-29dad75e8fe3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:21.985102 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fd9bc208-68cc-4797-b40a-29dad75e8fe3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.417861 Jul 27 23:13:21.986257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1494/2804] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:21 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:22.104196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b7f39330-7149-48f5-898c-06ec7ca5195d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:22.104832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b7f39330-7149-48f5-898c-06ec7ca5195d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:22.111749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7f39330-7149-48f5-898c-06ec7ca5195d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:22.112194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7f39330-7149-48f5-898c-06ec7ca5195d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:22.112996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7f39330-7149-48f5-898c-06ec7ca5195d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:22.113426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7f39330-7149-48f5-898c-06ec7ca5195d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:22.237395 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b7f39330-7149-48f5-898c-06ec7ca5195d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:22.245233 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b7f39330-7149-48f5-898c-06ec7ca5195d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.144860 Jul 27 23:13:22.245810 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1311/2805] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:22 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:22.995870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-da7f6dde-1b12-4d66-9645-95fc532e0309 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:22.996619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-da7f6dde-1b12-4d66-9645-95fc532e0309 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:23.003785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da7f6dde-1b12-4d66-9645-95fc532e0309 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:23.004234 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da7f6dde-1b12-4d66-9645-95fc532e0309 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:23.005016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da7f6dde-1b12-4d66-9645-95fc532e0309 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:23.005453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da7f6dde-1b12-4d66-9645-95fc532e0309 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:23.006955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5856de6d-5b7c-47f2-bdd2-4c1eec1fdcb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:23.007560 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5856de6d-5b7c-47f2-bdd2-4c1eec1fdcb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:23.014187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5856de6d-5b7c-47f2-bdd2-4c1eec1fdcb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:23.014623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5856de6d-5b7c-47f2-bdd2-4c1eec1fdcb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:23.015369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5856de6d-5b7c-47f2-bdd2-4c1eec1fdcb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:23.015791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5856de6d-5b7c-47f2-bdd2-4c1eec1fdcb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:23.194644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-da7f6dde-1b12-4d66-9645-95fc532e0309 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:23.201251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5856de6d-5b7c-47f2-bdd2-4c1eec1fdcb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:23.202563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-da7f6dde-1b12-4d66-9645-95fc532e0309 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.210515 Jul 27 23:13:23.203325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1495/2806] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:22 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:23.209350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5856de6d-5b7c-47f2-bdd2-4c1eec1fdcb6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.206100 Jul 27 23:13:23.209900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1312/2807] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:23 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:23.266152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-85b502ab-da85-4b57-98ba-541eb25c3ad4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:23.266690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-85b502ab-da85-4b57-98ba-541eb25c3ad4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:23.272609 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85b502ab-da85-4b57-98ba-541eb25c3ad4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:23.273051 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85b502ab-da85-4b57-98ba-541eb25c3ad4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:23.273797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85b502ab-da85-4b57-98ba-541eb25c3ad4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:23.274227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85b502ab-da85-4b57-98ba-541eb25c3ad4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:23.401683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-85b502ab-da85-4b57-98ba-541eb25c3ad4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:23.410109 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-85b502ab-da85-4b57-98ba-541eb25c3ad4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.147740 Jul 27 23:13:23.410674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1496/2808] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:23 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:24.223972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cd0532c0-63d3-44e3-aab9-3b896a85533e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:24.224731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cd0532c0-63d3-44e3-aab9-3b896a85533e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:24.230464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c01591fb-af4d-473a-95e5-3200287a72ca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:24.231078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c01591fb-af4d-473a-95e5-3200287a72ca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:24.231282 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd0532c0-63d3-44e3-aab9-3b896a85533e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:24.231722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd0532c0-63d3-44e3-aab9-3b896a85533e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:24.232471 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd0532c0-63d3-44e3-aab9-3b896a85533e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:24.232936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cd0532c0-63d3-44e3-aab9-3b896a85533e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:24.236357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:13:24.238764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c01591fb-af4d-473a-95e5-3200287a72ca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:24.239211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c01591fb-af4d-473a-95e5-3200287a72ca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:24.239971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c01591fb-af4d-473a-95e5-3200287a72ca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:24.240402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c01591fb-af4d-473a-95e5-3200287a72ca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:24.431967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cd0532c0-63d3-44e3-aab9-3b896a85533e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:24.435937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c01591fb-af4d-473a-95e5-3200287a72ca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:24.439997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cd0532c0-63d3-44e3-aab9-3b896a85533e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.220367 Jul 27 23:13:24.440578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1313/2809] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:24 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:24.443819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c01591fb-af4d-473a-95e5-3200287a72ca tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.217121 Jul 27 23:13:24.444498 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1497/2810] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:24 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:24.444927 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8e4fa0a4-62a8-499d-b721-ce521195bbd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:24.445534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8e4fa0a4-62a8-499d-b721-ce521195bbd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:24.451180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e4fa0a4-62a8-499d-b721-ce521195bbd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:24.451630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e4fa0a4-62a8-499d-b721-ce521195bbd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:24.452381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e4fa0a4-62a8-499d-b721-ce521195bbd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:24.452833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8e4fa0a4-62a8-499d-b721-ce521195bbd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:24.577230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8e4fa0a4-62a8-499d-b721-ce521195bbd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:24.585635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8e4fa0a4-62a8-499d-b721-ce521195bbd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.144130 Jul 27 23:13:24.586224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1314/2811] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:24 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:25.461458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-156f2577-3b81-41aa-b2e8-cb8d0c261972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:25.461989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-156f2577-3b81-41aa-b2e8-cb8d0c261972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:25.464854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5474cbb9-9ec7-4a2e-b7f9-42c9380f99e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:25.465508 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5474cbb9-9ec7-4a2e-b7f9-42c9380f99e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:25.468631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-156f2577-3b81-41aa-b2e8-cb8d0c261972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:25.469113 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-156f2577-3b81-41aa-b2e8-cb8d0c261972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:25.470540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-156f2577-3b81-41aa-b2e8-cb8d0c261972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:25.470973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-156f2577-3b81-41aa-b2e8-cb8d0c261972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:25.472652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5474cbb9-9ec7-4a2e-b7f9-42c9380f99e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:25.473112 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5474cbb9-9ec7-4a2e-b7f9-42c9380f99e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:25.473872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5474cbb9-9ec7-4a2e-b7f9-42c9380f99e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:25.474306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5474cbb9-9ec7-4a2e-b7f9-42c9380f99e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:25.660081 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-156f2577-3b81-41aa-b2e8-cb8d0c261972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:25.666995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5474cbb9-9ec7-4a2e-b7f9-42c9380f99e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:25.668154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-156f2577-3b81-41aa-b2e8-cb8d0c261972 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.210605 Jul 27 23:13:25.668885 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1498/2812] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:25 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:25.673200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fb4ea893-c706-4397-9f4c-7cb91aa0f77c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:25.673855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fb4ea893-c706-4397-9f4c-7cb91aa0f77c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:25.675143 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5474cbb9-9ec7-4a2e-b7f9-42c9380f99e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.214007 Jul 27 23:13:25.675814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1315/2813] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:25.679697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb4ea893-c706-4397-9f4c-7cb91aa0f77c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:25.680137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb4ea893-c706-4397-9f4c-7cb91aa0f77c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:25.680903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb4ea893-c706-4397-9f4c-7cb91aa0f77c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:25.681334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb4ea893-c706-4397-9f4c-7cb91aa0f77c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:25.812654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fb4ea893-c706-4397-9f4c-7cb91aa0f77c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:25.820864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fb4ea893-c706-4397-9f4c-7cb91aa0f77c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.151156 Jul 27 23:13:25.821418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1499/2814] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:25 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:26.689588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ebb98e1c-750c-4517-a55e-7d506c417380 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:26.690155 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ebb98e1c-750c-4517-a55e-7d506c417380 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:26.696398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a23fd8df-cfe7-4630-980e-3b6b04677480 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:26.696848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebb98e1c-750c-4517-a55e-7d506c417380 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:26.696983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebb98e1c-750c-4517-a55e-7d506c417380 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:26.697093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a23fd8df-cfe7-4630-980e-3b6b04677480 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:26.697610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebb98e1c-750c-4517-a55e-7d506c417380 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:26.698037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ebb98e1c-750c-4517-a55e-7d506c417380 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:26.703390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a23fd8df-cfe7-4630-980e-3b6b04677480 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:26.703833 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a23fd8df-cfe7-4630-980e-3b6b04677480 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:26.704602 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a23fd8df-cfe7-4630-980e-3b6b04677480 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:26.705038 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a23fd8df-cfe7-4630-980e-3b6b04677480 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:26.856982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a23fd8df-cfe7-4630-980e-3b6b04677480 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:26.865826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a23fd8df-cfe7-4630-980e-3b6b04677480 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.173164 Jul 27 23:13:26.866433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1500/2815] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:26 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:26.870837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-86d2569b-7bf0-4d29-a34d-23b8212632f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:26.871436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-86d2569b-7bf0-4d29-a34d-23b8212632f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:26.877958 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-86d2569b-7bf0-4d29-a34d-23b8212632f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:26.878395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-86d2569b-7bf0-4d29-a34d-23b8212632f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:26.879145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-86d2569b-7bf0-4d29-a34d-23b8212632f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:26.880075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-86d2569b-7bf0-4d29-a34d-23b8212632f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:27.042862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ebb98e1c-750c-4517-a55e-7d506c417380 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:27.051141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ebb98e1c-750c-4517-a55e-7d506c417380 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.366059 Jul 27 23:13:27.051700 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1316/2816] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:26 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:27.063690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-86d2569b-7bf0-4d29-a34d-23b8212632f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:27.071427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-86d2569b-7bf0-4d29-a34d-23b8212632f3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.204063 Jul 27 23:13:27.071983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1501/2817] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:26 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:27.887798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-eac95d17-e3f2-4deb-8bc6-7aebef28aad6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:27.888491 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-eac95d17-e3f2-4deb-8bc6-7aebef28aad6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:27.895462 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eac95d17-e3f2-4deb-8bc6-7aebef28aad6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:27.895900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eac95d17-e3f2-4deb-8bc6-7aebef28aad6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:27.896836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eac95d17-e3f2-4deb-8bc6-7aebef28aad6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:27.897596 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eac95d17-e3f2-4deb-8bc6-7aebef28aad6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:28.036306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eac95d17-e3f2-4deb-8bc6-7aebef28aad6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:28.044435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-eac95d17-e3f2-4deb-8bc6-7aebef28aad6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.160414 Jul 27 23:13:28.045099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1317/2818] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:27 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:28.073037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3bb2b554-e79e-4418-b1cf-6980cf832605 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:28.073640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3bb2b554-e79e-4418-b1cf-6980cf832605 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:28.081020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bb2b554-e79e-4418-b1cf-6980cf832605 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:28.081460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bb2b554-e79e-4418-b1cf-6980cf832605 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:28.082338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bb2b554-e79e-4418-b1cf-6980cf832605 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:28.082765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3bb2b554-e79e-4418-b1cf-6980cf832605 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:28.094918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3e442f0a-bc55-4004-8738-717eaa248b94 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:28.095529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3e442f0a-bc55-4004-8738-717eaa248b94 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:28.101683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e442f0a-bc55-4004-8738-717eaa248b94 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:28.102130 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e442f0a-bc55-4004-8738-717eaa248b94 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:28.102892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e442f0a-bc55-4004-8738-717eaa248b94 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:28.103322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3e442f0a-bc55-4004-8738-717eaa248b94 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:28.285975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3bb2b554-e79e-4418-b1cf-6980cf832605 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:28.294209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3bb2b554-e79e-4418-b1cf-6980cf832605 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.225121 Jul 27 23:13:28.294944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1502/2819] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:28 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:28.297509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3e442f0a-bc55-4004-8738-717eaa248b94 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:28.305872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3e442f0a-bc55-4004-8738-717eaa248b94 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216300 Jul 27 23:13:28.306404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1318/2820] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:28 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:29.065320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-deef90bb-0880-43ac-b7af-b6b388ea7dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:29.065934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-deef90bb-0880-43ac-b7af-b6b388ea7dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:29.071908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-deef90bb-0880-43ac-b7af-b6b388ea7dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:29.072348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-deef90bb-0880-43ac-b7af-b6b388ea7dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:29.073189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-deef90bb-0880-43ac-b7af-b6b388ea7dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:29.073725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-deef90bb-0880-43ac-b7af-b6b388ea7dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:29.199661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-deef90bb-0880-43ac-b7af-b6b388ea7dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:29.208004 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-deef90bb-0880-43ac-b7af-b6b388ea7dbd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146548 Jul 27 23:13:29.208572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1503/2821] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:29 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:29.316291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6c86713a-818d-485b-bbd4-dd0dcef10400 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:29.316871 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6c86713a-818d-485b-bbd4-dd0dcef10400 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:29.323369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c86713a-818d-485b-bbd4-dd0dcef10400 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:29.323839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c86713a-818d-485b-bbd4-dd0dcef10400 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:29.324606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c86713a-818d-485b-bbd4-dd0dcef10400 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:29.325033 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c86713a-818d-485b-bbd4-dd0dcef10400 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:29.327637 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0e8cc6a4-68c3-477b-b1cf-03c0eb4de339 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:29.328275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0e8cc6a4-68c3-477b-b1cf-03c0eb4de339 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:29.334747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e8cc6a4-68c3-477b-b1cf-03c0eb4de339 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:29.335189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e8cc6a4-68c3-477b-b1cf-03c0eb4de339 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:29.335941 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e8cc6a4-68c3-477b-b1cf-03c0eb4de339 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:29.336373 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e8cc6a4-68c3-477b-b1cf-03c0eb4de339 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:29.518821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6c86713a-818d-485b-bbd4-dd0dcef10400 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:29.522872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0e8cc6a4-68c3-477b-b1cf-03c0eb4de339 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:29.526775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6c86713a-818d-485b-bbd4-dd0dcef10400 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.214837 Jul 27 23:13:29.527331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1319/2822] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:29 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:29.531087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0e8cc6a4-68c3-477b-b1cf-03c0eb4de339 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.206915 Jul 27 23:13:29.531651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1504/2823] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:29 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:30.229797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0013f0ac-3be0-4c98-a0a0-53cef0c6f24b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:30.230407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0013f0ac-3be0-4c98-a0a0-53cef0c6f24b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:30.236727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0013f0ac-3be0-4c98-a0a0-53cef0c6f24b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:30.237169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0013f0ac-3be0-4c98-a0a0-53cef0c6f24b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:30.237935 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0013f0ac-3be0-4c98-a0a0-53cef0c6f24b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:30.238346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0013f0ac-3be0-4c98-a0a0-53cef0c6f24b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:30.370682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0013f0ac-3be0-4c98-a0a0-53cef0c6f24b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:30.379858 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0013f0ac-3be0-4c98-a0a0-53cef0c6f24b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.153904 Jul 27 23:13:30.380416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1320/2824] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:30 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:30.547590 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-df6a729d-5cfb-4177-85de-a31fb7282090 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:30.548732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-df6a729d-5cfb-4177-85de-a31fb7282090 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:30.552154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c1e3ef99-0921-4537-8e81-d63492857797 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:30.552814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c1e3ef99-0921-4537-8e81-d63492857797 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:30.555467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df6a729d-5cfb-4177-85de-a31fb7282090 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:30.555912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df6a729d-5cfb-4177-85de-a31fb7282090 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:30.556690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df6a729d-5cfb-4177-85de-a31fb7282090 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:30.557122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df6a729d-5cfb-4177-85de-a31fb7282090 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:30.558541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c1e3ef99-0921-4537-8e81-d63492857797 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:30.558986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c1e3ef99-0921-4537-8e81-d63492857797 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:30.559737 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c1e3ef99-0921-4537-8e81-d63492857797 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:30.560166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c1e3ef99-0921-4537-8e81-d63492857797 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:30.747630 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-df6a729d-5cfb-4177-85de-a31fb7282090 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:30.754886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c1e3ef99-0921-4537-8e81-d63492857797 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:30.756912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-df6a729d-5cfb-4177-85de-a31fb7282090 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.213168 Jul 27 23:13:30.757502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1505/2825] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:30 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:30.762921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c1e3ef99-0921-4537-8e81-d63492857797 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214994 Jul 27 23:13:30.763489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1321/2826] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:30 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:31.400824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fd4d3f3d-45dc-4040-be00-14b7775ec546 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:31.401432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fd4d3f3d-45dc-4040-be00-14b7775ec546 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:31.407683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd4d3f3d-45dc-4040-be00-14b7775ec546 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:31.408056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd4d3f3d-45dc-4040-be00-14b7775ec546 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:31.408825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd4d3f3d-45dc-4040-be00-14b7775ec546 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:31.409258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fd4d3f3d-45dc-4040-be00-14b7775ec546 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:31.542284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fd4d3f3d-45dc-4040-be00-14b7775ec546 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:31.550808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fd4d3f3d-45dc-4040-be00-14b7775ec546 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.153841 Jul 27 23:13:31.551442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1506/2827] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:31 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:31.778156 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-54b2c8d1-61f1-434d-87e7-2b6b7c6abeec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:31.778760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-54b2c8d1-61f1-434d-87e7-2b6b7c6abeec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:31.784895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6cb85b3c-9bab-4a95-ae93-618bdad97525 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:31.785509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6cb85b3c-9bab-4a95-ae93-618bdad97525 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:31.785950 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54b2c8d1-61f1-434d-87e7-2b6b7c6abeec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:31.786391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54b2c8d1-61f1-434d-87e7-2b6b7c6abeec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:31.787163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54b2c8d1-61f1-434d-87e7-2b6b7c6abeec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:31.787569 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-54b2c8d1-61f1-434d-87e7-2b6b7c6abeec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:31.792188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6cb85b3c-9bab-4a95-ae93-618bdad97525 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:31.793651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6cb85b3c-9bab-4a95-ae93-618bdad97525 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:31.793651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6cb85b3c-9bab-4a95-ae93-618bdad97525 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:31.793877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6cb85b3c-9bab-4a95-ae93-618bdad97525 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:31.985935 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-54b2c8d1-61f1-434d-87e7-2b6b7c6abeec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:31.989677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6cb85b3c-9bab-4a95-ae93-618bdad97525 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:31.993969 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-54b2c8d1-61f1-434d-87e7-2b6b7c6abeec tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.219620 Jul 27 23:13:31.994529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1322/2828] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:31 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:31.998197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6cb85b3c-9bab-4a95-ae93-618bdad97525 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.217583 Jul 27 23:13:31.998894 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1507/2829] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:31 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:32.571548 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-67b33dbe-0eb1-4e14-b94a-482222a0c50b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:32.572149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-67b33dbe-0eb1-4e14-b94a-482222a0c50b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:32.579996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67b33dbe-0eb1-4e14-b94a-482222a0c50b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:32.580441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67b33dbe-0eb1-4e14-b94a-482222a0c50b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:32.581311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67b33dbe-0eb1-4e14-b94a-482222a0c50b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:32.581734 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-67b33dbe-0eb1-4e14-b94a-482222a0c50b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:32.707949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-67b33dbe-0eb1-4e14-b94a-482222a0c50b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:32.715703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-67b33dbe-0eb1-4e14-b94a-482222a0c50b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147999 Jul 27 23:13:32.716253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1323/2830] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:32 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:33.015260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-62308ead-372d-44a3-ac04-8a29ce4b6ef4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:33.015787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-62308ead-372d-44a3-ac04-8a29ce4b6ef4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:33.018996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-de9ac42e-a5c0-40ed-a05f-c6aae6c98bd6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:33.019611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-de9ac42e-a5c0-40ed-a05f-c6aae6c98bd6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:33.022400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62308ead-372d-44a3-ac04-8a29ce4b6ef4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:33.022842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62308ead-372d-44a3-ac04-8a29ce4b6ef4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:33.023588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62308ead-372d-44a3-ac04-8a29ce4b6ef4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:33.024014 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62308ead-372d-44a3-ac04-8a29ce4b6ef4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:33.026032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de9ac42e-a5c0-40ed-a05f-c6aae6c98bd6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:33.026477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de9ac42e-a5c0-40ed-a05f-c6aae6c98bd6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:33.027228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de9ac42e-a5c0-40ed-a05f-c6aae6c98bd6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:33.027659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-de9ac42e-a5c0-40ed-a05f-c6aae6c98bd6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:33.219001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-62308ead-372d-44a3-ac04-8a29ce4b6ef4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:33.223607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-de9ac42e-a5c0-40ed-a05f-c6aae6c98bd6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:33.227423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-62308ead-372d-44a3-ac04-8a29ce4b6ef4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.216064 Jul 27 23:13:33.227991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1508/2831] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:33 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:33.231765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-de9ac42e-a5c0-40ed-a05f-c6aae6c98bd6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216537 Jul 27 23:13:33.232391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1324/2832] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:33 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:33.737106 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6e590356-5d62-4eb8-bf43-5e4fb7d47b41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:33.737707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6e590356-5d62-4eb8-bf43-5e4fb7d47b41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:33.743682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e590356-5d62-4eb8-bf43-5e4fb7d47b41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:33.744118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e590356-5d62-4eb8-bf43-5e4fb7d47b41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:33.744895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e590356-5d62-4eb8-bf43-5e4fb7d47b41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:33.745320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e590356-5d62-4eb8-bf43-5e4fb7d47b41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:33.871924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6e590356-5d62-4eb8-bf43-5e4fb7d47b41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:33.880297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6e590356-5d62-4eb8-bf43-5e4fb7d47b41 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147328 Jul 27 23:13:33.880892 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1509/2833] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:33 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:34.248573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b709aa17-f670-45bd-b6be-462981050e00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:34.249208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b709aa17-f670-45bd-b6be-462981050e00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:34.254243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c1204741-b91f-4ef5-bf95-038fd9a4b09b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:34.254852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c1204741-b91f-4ef5-bf95-038fd9a4b09b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:34.255798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b709aa17-f670-45bd-b6be-462981050e00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:34.256250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b709aa17-f670-45bd-b6be-462981050e00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:34.257036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b709aa17-f670-45bd-b6be-462981050e00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:34.257473 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b709aa17-f670-45bd-b6be-462981050e00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:34.261222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1204741-b91f-4ef5-bf95-038fd9a4b09b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:34.261665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1204741-b91f-4ef5-bf95-038fd9a4b09b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:34.262412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1204741-b91f-4ef5-bf95-038fd9a4b09b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:34.262837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c1204741-b91f-4ef5-bf95-038fd9a4b09b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:34.277919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:13:34.451610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b709aa17-f670-45bd-b6be-462981050e00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:34.455936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c1204741-b91f-4ef5-bf95-038fd9a4b09b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:34.460163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b709aa17-f670-45bd-b6be-462981050e00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.215500 Jul 27 23:13:34.460745 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1325/2834] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:34 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:34.463923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c1204741-b91f-4ef5-bf95-038fd9a4b09b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.213504 Jul 27 23:13:34.464477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1510/2835] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:34 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:34.901723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4abbf84c-dc19-4f53-afc8-d82ba3c64a56 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:34.902335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4abbf84c-dc19-4f53-afc8-d82ba3c64a56 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:34.908360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4abbf84c-dc19-4f53-afc8-d82ba3c64a56 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:34.908836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4abbf84c-dc19-4f53-afc8-d82ba3c64a56 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:34.909592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4abbf84c-dc19-4f53-afc8-d82ba3c64a56 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:34.910027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4abbf84c-dc19-4f53-afc8-d82ba3c64a56 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:35.034907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4abbf84c-dc19-4f53-afc8-d82ba3c64a56 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:35.042764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4abbf84c-dc19-4f53-afc8-d82ba3c64a56 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.144928 Jul 27 23:13:35.043321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1326/2836] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:34 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:35.481282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-002077c4-86fd-4c51-b6d1-fa1dfa51b840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:35.481812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-002077c4-86fd-4c51-b6d1-fa1dfa51b840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:35.484727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e55cc6fc-90d4-4aaa-87e3-a0bb185e7ab8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:35.486174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e55cc6fc-90d4-4aaa-87e3-a0bb185e7ab8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:35.489503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-002077c4-86fd-4c51-b6d1-fa1dfa51b840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:35.489691 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-002077c4-86fd-4c51-b6d1-fa1dfa51b840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:35.490448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-002077c4-86fd-4c51-b6d1-fa1dfa51b840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:35.490881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-002077c4-86fd-4c51-b6d1-fa1dfa51b840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:35.492578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e55cc6fc-90d4-4aaa-87e3-a0bb185e7ab8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:35.493037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e55cc6fc-90d4-4aaa-87e3-a0bb185e7ab8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:35.493802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e55cc6fc-90d4-4aaa-87e3-a0bb185e7ab8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:35.494236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e55cc6fc-90d4-4aaa-87e3-a0bb185e7ab8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:35.684784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-002077c4-86fd-4c51-b6d1-fa1dfa51b840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:35.688224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e55cc6fc-90d4-4aaa-87e3-a0bb185e7ab8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:35.692753 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-002077c4-86fd-4c51-b6d1-fa1dfa51b840 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.215695 Jul 27 23:13:35.693539 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1511/2837] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:35 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:35.696259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e55cc6fc-90d4-4aaa-87e3-a0bb185e7ab8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215332 Jul 27 23:13:35.696919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1327/2838] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:35 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:36.064577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-871b07a4-4800-41e0-a0ac-442a2d68348e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:36.065110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-871b07a4-4800-41e0-a0ac-442a2d68348e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:36.071100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-871b07a4-4800-41e0-a0ac-442a2d68348e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:36.071544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-871b07a4-4800-41e0-a0ac-442a2d68348e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:36.072295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-871b07a4-4800-41e0-a0ac-442a2d68348e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:36.072767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-871b07a4-4800-41e0-a0ac-442a2d68348e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:36.201522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-871b07a4-4800-41e0-a0ac-442a2d68348e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:36.209982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-871b07a4-4800-41e0-a0ac-442a2d68348e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.149823 Jul 27 23:13:36.210540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1512/2839] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:36 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:36.714294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-38395dad-972e-4f98-a3d2-3792ece56a0e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:36.714935 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-38395dad-972e-4f98-a3d2-3792ece56a0e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:36.717805 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-82d2e7b5-83e0-4676-ab26-e332f3751673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:36.718418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-82d2e7b5-83e0-4676-ab26-e332f3751673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:36.721790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-38395dad-972e-4f98-a3d2-3792ece56a0e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:36.722229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-38395dad-972e-4f98-a3d2-3792ece56a0e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:36.722982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-38395dad-972e-4f98-a3d2-3792ece56a0e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:36.723405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-38395dad-972e-4f98-a3d2-3792ece56a0e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:36.725623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82d2e7b5-83e0-4676-ab26-e332f3751673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:36.726064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82d2e7b5-83e0-4676-ab26-e332f3751673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:36.726816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82d2e7b5-83e0-4676-ab26-e332f3751673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:36.727246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-82d2e7b5-83e0-4676-ab26-e332f3751673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:36.911638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-38395dad-972e-4f98-a3d2-3792ece56a0e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:36.915623 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-82d2e7b5-83e0-4676-ab26-e332f3751673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:36.919571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-38395dad-972e-4f98-a3d2-3792ece56a0e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.209148 Jul 27 23:13:36.920133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1328/2840] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:36 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:36.924343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-82d2e7b5-83e0-4676-ab26-e332f3751673 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.210300 Jul 27 23:13:36.924953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1513/2841] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:36 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:37.230724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4a13d2d6-40c0-4b15-9d47-c9511ef104d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:37.231327 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4a13d2d6-40c0-4b15-9d47-c9511ef104d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:37.237532 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4a13d2d6-40c0-4b15-9d47-c9511ef104d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:37.237968 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4a13d2d6-40c0-4b15-9d47-c9511ef104d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:37.238742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4a13d2d6-40c0-4b15-9d47-c9511ef104d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:37.239168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4a13d2d6-40c0-4b15-9d47-c9511ef104d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:37.367082 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4a13d2d6-40c0-4b15-9d47-c9511ef104d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:37.369228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:13:37.376077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4a13d2d6-40c0-4b15-9d47-c9511ef104d7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.149198 Jul 27 23:13:37.376644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1329/2842] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:37 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:37.942427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8588e130-1524-40c1-a8df-f1d99b3e0be5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:37.943042 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8588e130-1524-40c1-a8df-f1d99b3e0be5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:37.945731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-65eedf2a-6b8a-4a31-835d-453ac6b5e71a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:37.946346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-65eedf2a-6b8a-4a31-835d-453ac6b5e71a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:37.949551 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8588e130-1524-40c1-a8df-f1d99b3e0be5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:37.949996 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8588e130-1524-40c1-a8df-f1d99b3e0be5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:37.950763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8588e130-1524-40c1-a8df-f1d99b3e0be5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:37.951196 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8588e130-1524-40c1-a8df-f1d99b3e0be5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:37.952872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65eedf2a-6b8a-4a31-835d-453ac6b5e71a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:37.953323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65eedf2a-6b8a-4a31-835d-453ac6b5e71a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:37.954080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65eedf2a-6b8a-4a31-835d-453ac6b5e71a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:37.954517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65eedf2a-6b8a-4a31-835d-453ac6b5e71a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:38.146364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8588e130-1524-40c1-a8df-f1d99b3e0be5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:38.150064 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-65eedf2a-6b8a-4a31-835d-453ac6b5e71a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:38.158153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8588e130-1524-40c1-a8df-f1d99b3e0be5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217592 Jul 27 23:13:38.158153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1514/2843] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:37 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:38.163898 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-65eedf2a-6b8a-4a31-835d-453ac6b5e71a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.222048 Jul 27 23:13:38.164609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1330/2844] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:37 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:38.396435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f0768d59-5929-4d2a-9886-cfd04e4237b6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:38.397092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f0768d59-5929-4d2a-9886-cfd04e4237b6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:38.403314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f0768d59-5929-4d2a-9886-cfd04e4237b6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:38.403759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f0768d59-5929-4d2a-9886-cfd04e4237b6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:38.404513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f0768d59-5929-4d2a-9886-cfd04e4237b6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:38.404984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f0768d59-5929-4d2a-9886-cfd04e4237b6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:38.531923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f0768d59-5929-4d2a-9886-cfd04e4237b6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:38.540544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f0768d59-5929-4d2a-9886-cfd04e4237b6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147989 Jul 27 23:13:38.541162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1515/2845] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:38 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:39.177078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-066e5e85-033d-4db5-96f1-6f55d9eb08ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:39.177689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-066e5e85-033d-4db5-96f1-6f55d9eb08ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:39.184169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-066e5e85-033d-4db5-96f1-6f55d9eb08ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:39.184665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-066e5e85-033d-4db5-96f1-6f55d9eb08ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:39.185446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-066e5e85-033d-4db5-96f1-6f55d9eb08ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:39.185561 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3c6b295b-36f4-4eca-9146-2dff33192185 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:39.185939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-066e5e85-033d-4db5-96f1-6f55d9eb08ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:39.186128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3c6b295b-36f4-4eca-9146-2dff33192185 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:39.193324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c6b295b-36f4-4eca-9146-2dff33192185 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:39.193891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c6b295b-36f4-4eca-9146-2dff33192185 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:39.194657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c6b295b-36f4-4eca-9146-2dff33192185 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:39.195092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c6b295b-36f4-4eca-9146-2dff33192185 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:39.375390 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-066e5e85-033d-4db5-96f1-6f55d9eb08ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:39.380168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3c6b295b-36f4-4eca-9146-2dff33192185 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:39.383969 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-066e5e85-033d-4db5-96f1-6f55d9eb08ab tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.210655 Jul 27 23:13:39.384597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1331/2846] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:39 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:39.388197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3c6b295b-36f4-4eca-9146-2dff33192185 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.206482 Jul 27 23:13:39.388784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1516/2847] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:39 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:39.562176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8251c646-991f-4914-bd7a-ed0aad4a8df4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:39.562784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8251c646-991f-4914-bd7a-ed0aad4a8df4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:39.569391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8251c646-991f-4914-bd7a-ed0aad4a8df4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:39.569836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8251c646-991f-4914-bd7a-ed0aad4a8df4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:39.570584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8251c646-991f-4914-bd7a-ed0aad4a8df4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:39.571018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8251c646-991f-4914-bd7a-ed0aad4a8df4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:39.696712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8251c646-991f-4914-bd7a-ed0aad4a8df4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:39.704627 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8251c646-991f-4914-bd7a-ed0aad4a8df4 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146391 Jul 27 23:13:39.705182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1332/2848] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:39 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:40.406240 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-107e2ca1-2169-4915-a5ba-d038e71f54ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:40.406826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-107e2ca1-2169-4915-a5ba-d038e71f54ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:40.409922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3d7e1d2b-9c89-4d77-8053-10f5b83cf463 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:40.410527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3d7e1d2b-9c89-4d77-8053-10f5b83cf463 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:40.413995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-107e2ca1-2169-4915-a5ba-d038e71f54ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:40.414444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-107e2ca1-2169-4915-a5ba-d038e71f54ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:40.415206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-107e2ca1-2169-4915-a5ba-d038e71f54ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:40.415642 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-107e2ca1-2169-4915-a5ba-d038e71f54ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:40.416804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d7e1d2b-9c89-4d77-8053-10f5b83cf463 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:40.417250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d7e1d2b-9c89-4d77-8053-10f5b83cf463 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:40.417991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d7e1d2b-9c89-4d77-8053-10f5b83cf463 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:40.418412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d7e1d2b-9c89-4d77-8053-10f5b83cf463 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:40.610838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-107e2ca1-2169-4915-a5ba-d038e71f54ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:40.617542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3d7e1d2b-9c89-4d77-8053-10f5b83cf463 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:40.618569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-107e2ca1-2169-4915-a5ba-d038e71f54ff tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.216342 Jul 27 23:13:40.619174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1517/2849] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:40 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:40.625676 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3d7e1d2b-9c89-4d77-8053-10f5b83cf463 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.220143 Jul 27 23:13:40.626723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1333/2850] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:40 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:40.725732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-578af90d-0a95-4150-8c13-cd8292f9968f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:40.726275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-578af90d-0a95-4150-8c13-cd8292f9968f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:40.732145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-578af90d-0a95-4150-8c13-cd8292f9968f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:40.732618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-578af90d-0a95-4150-8c13-cd8292f9968f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:40.733358 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-578af90d-0a95-4150-8c13-cd8292f9968f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:40.733795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-578af90d-0a95-4150-8c13-cd8292f9968f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:40.862591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-578af90d-0a95-4150-8c13-cd8292f9968f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:40.870434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-578af90d-0a95-4150-8c13-cd8292f9968f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148562 Jul 27 23:13:40.870989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1518/2851] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:40 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:41.639421 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ad156587-47bf-4006-a3fa-abee3496a52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:41.640018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ad156587-47bf-4006-a3fa-abee3496a52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:41.647153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad156587-47bf-4006-a3fa-abee3496a52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:41.647318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5f1d03bc-306f-416a-a3c8-e206a11ffe84 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:41.647706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad156587-47bf-4006-a3fa-abee3496a52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:41.648035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5f1d03bc-306f-416a-a3c8-e206a11ffe84 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:41.648322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad156587-47bf-4006-a3fa-abee3496a52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:41.648788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad156587-47bf-4006-a3fa-abee3496a52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:41.654546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f1d03bc-306f-416a-a3c8-e206a11ffe84 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:41.654990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f1d03bc-306f-416a-a3c8-e206a11ffe84 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:41.655742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f1d03bc-306f-416a-a3c8-e206a11ffe84 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:41.656178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5f1d03bc-306f-416a-a3c8-e206a11ffe84 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:41.842861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ad156587-47bf-4006-a3fa-abee3496a52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:41.847063 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5f1d03bc-306f-416a-a3c8-e206a11ffe84 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:41.851848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ad156587-47bf-4006-a3fa-abee3496a52f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.216292 Jul 27 23:13:41.852412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1334/2852] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:41 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:41.855063 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5f1d03bc-306f-416a-a3c8-e206a11ffe84 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.211549 Jul 27 23:13:41.855613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1519/2853] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:41 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:41.891983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1ee3b57d-31f6-4d99-8a98-c68af52ef146 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:41.892544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1ee3b57d-31f6-4d99-8a98-c68af52ef146 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:41.898360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ee3b57d-31f6-4d99-8a98-c68af52ef146 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:41.898793 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ee3b57d-31f6-4d99-8a98-c68af52ef146 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:41.899535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ee3b57d-31f6-4d99-8a98-c68af52ef146 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:41.899961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1ee3b57d-31f6-4d99-8a98-c68af52ef146 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:42.025575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1ee3b57d-31f6-4d99-8a98-c68af52ef146 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:42.033346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1ee3b57d-31f6-4d99-8a98-c68af52ef146 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.145653 Jul 27 23:13:42.033899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1335/2854] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:41 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:42.873326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b7490ba7-3e88-4b8b-b143-185430d2d795 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:42.873926 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b7490ba7-3e88-4b8b-b143-185430d2d795 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:42.874898 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9fe322c4-aac3-4fdc-af10-005c2670b3b6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:42.875508 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9fe322c4-aac3-4fdc-af10-005c2670b3b6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:42.879912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7490ba7-3e88-4b8b-b143-185430d2d795 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:42.880361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7490ba7-3e88-4b8b-b143-185430d2d795 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:42.881152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7490ba7-3e88-4b8b-b143-185430d2d795 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:42.881684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7490ba7-3e88-4b8b-b143-185430d2d795 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:42.881965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9fe322c4-aac3-4fdc-af10-005c2670b3b6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:42.882441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9fe322c4-aac3-4fdc-af10-005c2670b3b6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:42.883195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9fe322c4-aac3-4fdc-af10-005c2670b3b6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:42.883640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9fe322c4-aac3-4fdc-af10-005c2670b3b6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:43.068822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b7490ba7-3e88-4b8b-b143-185430d2d795 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:43.075300 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9fe322c4-aac3-4fdc-af10-005c2670b3b6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:43.076887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b7490ba7-3e88-4b8b-b143-185430d2d795 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.207499 Jul 27 23:13:43.077560 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1520/2855] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:42 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:43.083460 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cae2ea2d-eaad-4bc6-b166-47a0d7b4d552 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:43.084065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cae2ea2d-eaad-4bc6-b166-47a0d7b4d552 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:43.084872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9fe322c4-aac3-4fdc-af10-005c2670b3b6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.213649 Jul 27 23:13:43.085651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1336/2856] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:42 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:43.090163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cae2ea2d-eaad-4bc6-b166-47a0d7b4d552 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:43.090613 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cae2ea2d-eaad-4bc6-b166-47a0d7b4d552 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:43.091370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cae2ea2d-eaad-4bc6-b166-47a0d7b4d552 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:43.091804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cae2ea2d-eaad-4bc6-b166-47a0d7b4d552 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:43.217927 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cae2ea2d-eaad-4bc6-b166-47a0d7b4d552 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:43.226293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cae2ea2d-eaad-4bc6-b166-47a0d7b4d552 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147139 Jul 27 23:13:43.226850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1521/2857] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:43 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:44.098989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fad94254-b0c0-41a1-a574-0d9476152994 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:44.099571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fad94254-b0c0-41a1-a574-0d9476152994 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:44.106028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fad94254-b0c0-41a1-a574-0d9476152994 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:44.106297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a23cad7f-ef7d-49b7-8229-a61ab154d4db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:44.106696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fad94254-b0c0-41a1-a574-0d9476152994 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:44.106915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a23cad7f-ef7d-49b7-8229-a61ab154d4db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:44.107199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fad94254-b0c0-41a1-a574-0d9476152994 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:44.107622 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fad94254-b0c0-41a1-a574-0d9476152994 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:44.114166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a23cad7f-ef7d-49b7-8229-a61ab154d4db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:44.114606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a23cad7f-ef7d-49b7-8229-a61ab154d4db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:44.115360 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a23cad7f-ef7d-49b7-8229-a61ab154d4db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:44.115797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a23cad7f-ef7d-49b7-8229-a61ab154d4db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:44.302114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a23cad7f-ef7d-49b7-8229-a61ab154d4db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:44.304870 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fad94254-b0c0-41a1-a574-0d9476152994 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:44.310154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a23cad7f-ef7d-49b7-8229-a61ab154d4db tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.207578 Jul 27 23:13:44.310723 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1522/2858] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:44 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:44.312718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fad94254-b0c0-41a1-a574-0d9476152994 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.217523 Jul 27 23:13:44.313568 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1337/2859] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:44 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:44.315206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1ced4d56-5918-4ceb-a828-1df68c6f89e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:44.315809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1ced4d56-5918-4ceb-a828-1df68c6f89e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:44.321545 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ced4d56-5918-4ceb-a828-1df68c6f89e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:44.322015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ced4d56-5918-4ceb-a828-1df68c6f89e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:44.322772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ced4d56-5918-4ceb-a828-1df68c6f89e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:44.323201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1ced4d56-5918-4ceb-a828-1df68c6f89e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:44.455992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1ced4d56-5918-4ceb-a828-1df68c6f89e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:44.463994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1ced4d56-5918-4ceb-a828-1df68c6f89e7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.152343 Jul 27 23:13:44.464638 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1523/2860] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:44 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:45.332117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3b405f9a-e1c8-4c41-8f69-c6911d664137 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:45.332748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3b405f9a-e1c8-4c41-8f69-c6911d664137 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:45.334122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-36c498e1-eb44-4ed3-901f-0b7050ee09ad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:45.334729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-36c498e1-eb44-4ed3-901f-0b7050ee09ad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:45.339483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b405f9a-e1c8-4c41-8f69-c6911d664137 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:45.339928 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b405f9a-e1c8-4c41-8f69-c6911d664137 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:45.340747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b405f9a-e1c8-4c41-8f69-c6911d664137 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:45.341171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-36c498e1-eb44-4ed3-901f-0b7050ee09ad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:45.341317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3b405f9a-e1c8-4c41-8f69-c6911d664137 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:45.341612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-36c498e1-eb44-4ed3-901f-0b7050ee09ad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:45.342354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-36c498e1-eb44-4ed3-901f-0b7050ee09ad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:45.342782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-36c498e1-eb44-4ed3-901f-0b7050ee09ad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:45.533511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-36c498e1-eb44-4ed3-901f-0b7050ee09ad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:45.536717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3b405f9a-e1c8-4c41-8f69-c6911d664137 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:45.541681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-36c498e1-eb44-4ed3-901f-0b7050ee09ad tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.211244 Jul 27 23:13:45.542350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1524/2861] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:45 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:45.544769 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3b405f9a-e1c8-4c41-8f69-c6911d664137 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.217139 Jul 27 23:13:45.545467 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1338/2862] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:45 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:45.546909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3e0723b6-751a-405c-a0b0-c7970be2e922 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:45.548077 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3e0723b6-751a-405c-a0b0-c7970be2e922 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:45.554402 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e0723b6-751a-405c-a0b0-c7970be2e922 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:45.554917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e0723b6-751a-405c-a0b0-c7970be2e922 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:45.555665 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e0723b6-751a-405c-a0b0-c7970be2e922 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:45.556093 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3e0723b6-751a-405c-a0b0-c7970be2e922 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:45.681207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3e0723b6-751a-405c-a0b0-c7970be2e922 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:45.689751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3e0723b6-751a-405c-a0b0-c7970be2e922 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146419 Jul 27 23:13:45.690317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1525/2863] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:45 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:46.563224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e5ecae92-7504-4945-9177-087447cf17c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:46.564327 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e5ecae92-7504-4945-9177-087447cf17c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:46.566125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a77ce073-84cf-47ee-9c54-31557a3cbe87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:46.566730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a77ce073-84cf-47ee-9c54-31557a3cbe87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:46.570843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5ecae92-7504-4945-9177-087447cf17c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:46.571288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5ecae92-7504-4945-9177-087447cf17c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:46.572052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5ecae92-7504-4945-9177-087447cf17c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:46.572484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e5ecae92-7504-4945-9177-087447cf17c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:46.573259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a77ce073-84cf-47ee-9c54-31557a3cbe87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:46.573696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a77ce073-84cf-47ee-9c54-31557a3cbe87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:46.574444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a77ce073-84cf-47ee-9c54-31557a3cbe87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:46.574872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a77ce073-84cf-47ee-9c54-31557a3cbe87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:46.766395 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e5ecae92-7504-4945-9177-087447cf17c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:46.770396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a77ce073-84cf-47ee-9c54-31557a3cbe87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:46.774388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e5ecae92-7504-4945-9177-087447cf17c5 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.215101 Jul 27 23:13:46.774956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1339/2864] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:46 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:46.778527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a77ce073-84cf-47ee-9c54-31557a3cbe87 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216167 Jul 27 23:13:46.779243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1526/2865] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:46 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:46.779502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-771d166f-6077-4208-9cc7-1418920364e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:46.780178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-771d166f-6077-4208-9cc7-1418920364e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:46.786696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-771d166f-6077-4208-9cc7-1418920364e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:46.787146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-771d166f-6077-4208-9cc7-1418920364e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:46.787902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-771d166f-6077-4208-9cc7-1418920364e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:46.788339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-771d166f-6077-4208-9cc7-1418920364e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:46.912636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-771d166f-6077-4208-9cc7-1418920364e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:46.920455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-771d166f-6077-4208-9cc7-1418920364e1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.144568 Jul 27 23:13:46.921048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1340/2866] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:46 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:47.796853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-97a6d862-b6c7-47ea-a09e-7409bf5d3f1e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:47.797970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-97a6d862-b6c7-47ea-a09e-7409bf5d3f1e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:47.799540 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d9d22ec6-cdcf-4b05-aa89-da9d02799b28 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:47.800149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d9d22ec6-cdcf-4b05-aa89-da9d02799b28 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:47.800301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=78 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:13:47.805667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97a6d862-b6c7-47ea-a09e-7409bf5d3f1e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:47.806114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97a6d862-b6c7-47ea-a09e-7409bf5d3f1e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:47.806550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9d22ec6-cdcf-4b05-aa89-da9d02799b28 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:47.806879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97a6d862-b6c7-47ea-a09e-7409bf5d3f1e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:47.806996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9d22ec6-cdcf-4b05-aa89-da9d02799b28 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:47.807311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97a6d862-b6c7-47ea-a09e-7409bf5d3f1e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:47.807734 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9d22ec6-cdcf-4b05-aa89-da9d02799b28 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:47.808167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d9d22ec6-cdcf-4b05-aa89-da9d02799b28 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:47.811379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:13:48.210699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-97a6d862-b6c7-47ea-a09e-7409bf5d3f1e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:48.213995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d9d22ec6-cdcf-4b05-aa89-da9d02799b28 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:48.218847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-97a6d862-b6c7-47ea-a09e-7409bf5d3f1e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.425992 Jul 27 23:13:48.219913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1527/2867] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:47 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:48.223054 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d9d22ec6-cdcf-4b05-aa89-da9d02799b28 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.427807 Jul 27 23:13:48.223783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1341/2868] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:47 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:48.224294 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-78c04ada-c9e7-437c-a59a-3adc82f6f3e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:48.224925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-78c04ada-c9e7-437c-a59a-3adc82f6f3e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:48.230598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78c04ada-c9e7-437c-a59a-3adc82f6f3e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:48.231045 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78c04ada-c9e7-437c-a59a-3adc82f6f3e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:48.231796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78c04ada-c9e7-437c-a59a-3adc82f6f3e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:48.232227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-78c04ada-c9e7-437c-a59a-3adc82f6f3e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:48.361512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-78c04ada-c9e7-437c-a59a-3adc82f6f3e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:48.369275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-78c04ada-c9e7-437c-a59a-3adc82f6f3e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148441 Jul 27 23:13:48.369828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1528/2869] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:48 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:49.240756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-aed3d2af-49a8-4194-bbbd-dff331b57482 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:49.241375 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-aed3d2af-49a8-4194-bbbd-dff331b57482 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:49.243193 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=74 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:13:49.244889 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-71a1aa5c-484b-427c-9fd4-dd6344f89cd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:49.245554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-71a1aa5c-484b-427c-9fd4-dd6344f89cd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:49.248536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aed3d2af-49a8-4194-bbbd-dff331b57482 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:49.249007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aed3d2af-49a8-4194-bbbd-dff331b57482 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:49.249768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aed3d2af-49a8-4194-bbbd-dff331b57482 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:49.250218 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aed3d2af-49a8-4194-bbbd-dff331b57482 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:49.251977 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-71a1aa5c-484b-427c-9fd4-dd6344f89cd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:49.252418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-71a1aa5c-484b-427c-9fd4-dd6344f89cd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:49.253205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-71a1aa5c-484b-427c-9fd4-dd6344f89cd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:49.253632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-71a1aa5c-484b-427c-9fd4-dd6344f89cd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:49.435493 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-aed3d2af-49a8-4194-bbbd-dff331b57482 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:49.442065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-71a1aa5c-484b-427c-9fd4-dd6344f89cd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:49.443436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-aed3d2af-49a8-4194-bbbd-dff331b57482 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.206689 Jul 27 23:13:49.444036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1342/2870] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:49 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:49.448363 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7ec3ff7e-bbbb-4356-adee-714b79fe793c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:49.448993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7ec3ff7e-bbbb-4356-adee-714b79fe793c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:49.450176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-71a1aa5c-484b-427c-9fd4-dd6344f89cd3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.209021 Jul 27 23:13:49.451065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1529/2871] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:49 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:49.455248 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ec3ff7e-bbbb-4356-adee-714b79fe793c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:49.455692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ec3ff7e-bbbb-4356-adee-714b79fe793c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:49.456456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ec3ff7e-bbbb-4356-adee-714b79fe793c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:49.456911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7ec3ff7e-bbbb-4356-adee-714b79fe793c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:49.582930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7ec3ff7e-bbbb-4356-adee-714b79fe793c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:49.591018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7ec3ff7e-bbbb-4356-adee-714b79fe793c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146101 Jul 27 23:13:49.591575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1343/2872] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:49 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:50.465307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cd2a0640-682a-4e61-ba8b-4d750f211e68 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:50.466000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cd2a0640-682a-4e61-ba8b-4d750f211e68 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:50.471623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dd805a7f-50da-45eb-bb86-7a5b14f66774 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:50.472236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dd805a7f-50da-45eb-bb86-7a5b14f66774 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:50.473207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd2a0640-682a-4e61-ba8b-4d750f211e68 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:50.473653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd2a0640-682a-4e61-ba8b-4d750f211e68 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:50.474411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd2a0640-682a-4e61-ba8b-4d750f211e68 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:50.474838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd2a0640-682a-4e61-ba8b-4d750f211e68 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:50.478590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dd805a7f-50da-45eb-bb86-7a5b14f66774 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:50.479038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dd805a7f-50da-45eb-bb86-7a5b14f66774 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:50.479794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dd805a7f-50da-45eb-bb86-7a5b14f66774 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:50.480223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dd805a7f-50da-45eb-bb86-7a5b14f66774 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:50.665717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cd2a0640-682a-4e61-ba8b-4d750f211e68 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:50.672419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-dd805a7f-50da-45eb-bb86-7a5b14f66774 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:50.673992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cd2a0640-682a-4e61-ba8b-4d750f211e68 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.212616 Jul 27 23:13:50.674564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1530/2873] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:50 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:50.678925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0e47e0d0-3b5f-4f11-a7c8-3f96dc9c679c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:50.679522 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0e47e0d0-3b5f-4f11-a7c8-3f96dc9c679c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:50.680808 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dd805a7f-50da-45eb-bb86-7a5b14f66774 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.213464 Jul 27 23:13:50.681353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1344/2874] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:50 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:50.685397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e47e0d0-3b5f-4f11-a7c8-3f96dc9c679c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:50.685843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e47e0d0-3b5f-4f11-a7c8-3f96dc9c679c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:50.686594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e47e0d0-3b5f-4f11-a7c8-3f96dc9c679c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:50.687025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0e47e0d0-3b5f-4f11-a7c8-3f96dc9c679c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:50.810838 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0e47e0d0-3b5f-4f11-a7c8-3f96dc9c679c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:50.818708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0e47e0d0-3b5f-4f11-a7c8-3f96dc9c679c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.143197 Jul 27 23:13:50.819275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1531/2875] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:51.695156 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0d838b42-b49f-481d-ba41-765e0e4f8211 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:51.695765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0d838b42-b49f-481d-ba41-765e0e4f8211 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:51.702025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-772079d8-4cc8-4f90-ab74-129a82735bff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:51.702514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0d838b42-b49f-481d-ba41-765e0e4f8211 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:51.702648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-772079d8-4cc8-4f90-ab74-129a82735bff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:51.702841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0d838b42-b49f-481d-ba41-765e0e4f8211 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:51.703595 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0d838b42-b49f-481d-ba41-765e0e4f8211 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:51.704028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0d838b42-b49f-481d-ba41-765e0e4f8211 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:51.709046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-772079d8-4cc8-4f90-ab74-129a82735bff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:51.709493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-772079d8-4cc8-4f90-ab74-129a82735bff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:51.710252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-772079d8-4cc8-4f90-ab74-129a82735bff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:51.710686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-772079d8-4cc8-4f90-ab74-129a82735bff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:51.897017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0d838b42-b49f-481d-ba41-765e0e4f8211 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:51.900873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-772079d8-4cc8-4f90-ab74-129a82735bff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:51.905240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0d838b42-b49f-481d-ba41-765e0e4f8211 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.213863 Jul 27 23:13:51.905887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1345/2876] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:51 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:51.910833 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5b7d245c-baa1-4c27-8884-27ca60f77d86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:51.911432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5b7d245c-baa1-4c27-8884-27ca60f77d86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:51.912331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-772079d8-4cc8-4f90-ab74-129a82735bff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214077 Jul 27 23:13:51.915962 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1532/2877] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:51 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:51.917133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b7d245c-baa1-4c27-8884-27ca60f77d86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:51.917578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b7d245c-baa1-4c27-8884-27ca60f77d86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:51.918329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b7d245c-baa1-4c27-8884-27ca60f77d86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:51.918759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5b7d245c-baa1-4c27-8884-27ca60f77d86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:51.933613 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:13:52.047016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5b7d245c-baa1-4c27-8884-27ca60f77d86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:52.055465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5b7d245c-baa1-4c27-8884-27ca60f77d86 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148656 Jul 27 23:13:52.056014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1346/2878] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:51 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:52.927345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-39886616-f52b-486b-af32-9fc04faaf465 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:52.927951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-39886616-f52b-486b-af32-9fc04faaf465 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:52.933979 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f187488f-237f-4475-90a4-e09ca6baa824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:52.934427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39886616-f52b-486b-af32-9fc04faaf465 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:52.934588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f187488f-237f-4475-90a4-e09ca6baa824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:52.934871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39886616-f52b-486b-af32-9fc04faaf465 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:52.935621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39886616-f52b-486b-af32-9fc04faaf465 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:52.936056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39886616-f52b-486b-af32-9fc04faaf465 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:52.941577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f187488f-237f-4475-90a4-e09ca6baa824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:52.942023 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f187488f-237f-4475-90a4-e09ca6baa824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:52.942779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f187488f-237f-4475-90a4-e09ca6baa824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:52.943207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f187488f-237f-4475-90a4-e09ca6baa824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:53.128060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-39886616-f52b-486b-af32-9fc04faaf465 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:53.131905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f187488f-237f-4475-90a4-e09ca6baa824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:53.136380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-39886616-f52b-486b-af32-9fc04faaf465 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.212852 Jul 27 23:13:53.137184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1533/2879] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:52 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:53.140381 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f187488f-237f-4475-90a4-e09ca6baa824 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.210182 Jul 27 23:13:53.141184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1347/2880] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:52 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:53.141657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c667210c-dd99-4fce-9ff3-00526fb1f3b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:53.142329 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c667210c-dd99-4fce-9ff3-00526fb1f3b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:53.148673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c667210c-dd99-4fce-9ff3-00526fb1f3b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:53.149499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c667210c-dd99-4fce-9ff3-00526fb1f3b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:53.150659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c667210c-dd99-4fce-9ff3-00526fb1f3b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:53.151095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c667210c-dd99-4fce-9ff3-00526fb1f3b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:53.283857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c667210c-dd99-4fce-9ff3-00526fb1f3b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:53.291638 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c667210c-dd99-4fce-9ff3-00526fb1f3b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.153659 Jul 27 23:13:53.292191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1534/2881] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:53 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:54.157983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8c7637fe-e25f-4c2d-afcb-5a51857adb6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:54.158755 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8c7637fe-e25f-4c2d-afcb-5a51857adb6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:54.161814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-34dc0406-66fd-4675-bf9a-1219e59f8d17 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:54.162425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-34dc0406-66fd-4675-bf9a-1219e59f8d17 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:54.165555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c7637fe-e25f-4c2d-afcb-5a51857adb6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:54.166066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c7637fe-e25f-4c2d-afcb-5a51857adb6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:54.166863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c7637fe-e25f-4c2d-afcb-5a51857adb6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:54.167291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8c7637fe-e25f-4c2d-afcb-5a51857adb6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:54.168774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34dc0406-66fd-4675-bf9a-1219e59f8d17 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:54.169213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34dc0406-66fd-4675-bf9a-1219e59f8d17 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:54.169963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34dc0406-66fd-4675-bf9a-1219e59f8d17 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:54.170387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34dc0406-66fd-4675-bf9a-1219e59f8d17 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:54.364778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8c7637fe-e25f-4c2d-afcb-5a51857adb6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:54.367559 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-34dc0406-66fd-4675-bf9a-1219e59f8d17 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:54.372847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8c7637fe-e25f-4c2d-afcb-5a51857adb6c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.219001 Jul 27 23:13:54.373414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1348/2882] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:54 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:54.375387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-34dc0406-66fd-4675-bf9a-1219e59f8d17 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.217273 Jul 27 23:13:54.376688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1535/2883] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:54 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:54.378634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-80973191-6ce9-4537-8496-b342d98f8c73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:54.379241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-80973191-6ce9-4537-8496-b342d98f8c73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:54.384901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80973191-6ce9-4537-8496-b342d98f8c73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:54.385346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80973191-6ce9-4537-8496-b342d98f8c73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:54.386095 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80973191-6ce9-4537-8496-b342d98f8c73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:54.386534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80973191-6ce9-4537-8496-b342d98f8c73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:54.515391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-80973191-6ce9-4537-8496-b342d98f8c73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:54.523248 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-80973191-6ce9-4537-8496-b342d98f8c73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148904 Jul 27 23:13:54.523802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1349/2884] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:54 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:55.394635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-aa72e1c6-77cf-4871-a3f7-e0739ed4b4c7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:55.395217 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-aa72e1c6-77cf-4871-a3f7-e0739ed4b4c7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:55.396860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-db08fd44-2077-4479-8436-bb940c1663ff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:55.397525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-db08fd44-2077-4479-8436-bb940c1663ff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:55.401801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa72e1c6-77cf-4871-a3f7-e0739ed4b4c7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:55.402242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa72e1c6-77cf-4871-a3f7-e0739ed4b4c7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:55.402994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa72e1c6-77cf-4871-a3f7-e0739ed4b4c7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:55.403419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aa72e1c6-77cf-4871-a3f7-e0739ed4b4c7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:55.403673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db08fd44-2077-4479-8436-bb940c1663ff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:55.404118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db08fd44-2077-4479-8436-bb940c1663ff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:55.404958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db08fd44-2077-4479-8436-bb940c1663ff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:55.405336 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db08fd44-2077-4479-8436-bb940c1663ff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:55.592100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-aa72e1c6-77cf-4871-a3f7-e0739ed4b4c7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:55.599537 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-db08fd44-2077-4479-8436-bb940c1663ff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:55.600774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-aa72e1c6-77cf-4871-a3f7-e0739ed4b4c7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.209995 Jul 27 23:13:55.601441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1536/2885] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:55 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:55.606946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ed03c90e-22f5-489f-ac39-337702a1d58b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:55.607555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ed03c90e-22f5-489f-ac39-337702a1d58b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:55.607690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-db08fd44-2077-4479-8436-bb940c1663ff tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214715 Jul 27 23:13:55.608418 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1350/2886] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:55 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:55.614578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed03c90e-22f5-489f-ac39-337702a1d58b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:55.615029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed03c90e-22f5-489f-ac39-337702a1d58b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:55.615781 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed03c90e-22f5-489f-ac39-337702a1d58b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:55.616211 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ed03c90e-22f5-489f-ac39-337702a1d58b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:55.746519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ed03c90e-22f5-489f-ac39-337702a1d58b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:55.754626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ed03c90e-22f5-489f-ac39-337702a1d58b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.151199 Jul 27 23:13:55.755193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1537/2887] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:55 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:56.621855 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b2e9ec82-da4a-4321-86a9-ba2647091575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:56.622448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b2e9ec82-da4a-4321-86a9-ba2647091575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:56.629493 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2e9ec82-da4a-4321-86a9-ba2647091575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:56.629930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2e9ec82-da4a-4321-86a9-ba2647091575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:56.630675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2e9ec82-da4a-4321-86a9-ba2647091575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:56.631049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ccfcc2fc-6ef7-43d2-b37b-9fb31f8a4709 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:56.631488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2e9ec82-da4a-4321-86a9-ba2647091575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:56.631654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ccfcc2fc-6ef7-43d2-b37b-9fb31f8a4709 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:56.637984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccfcc2fc-6ef7-43d2-b37b-9fb31f8a4709 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:56.638421 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccfcc2fc-6ef7-43d2-b37b-9fb31f8a4709 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:56.639164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccfcc2fc-6ef7-43d2-b37b-9fb31f8a4709 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:56.639586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccfcc2fc-6ef7-43d2-b37b-9fb31f8a4709 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:56.816223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b2e9ec82-da4a-4321-86a9-ba2647091575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:56.824330 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b2e9ec82-da4a-4321-86a9-ba2647091575 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.206311 Jul 27 23:13:56.825078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1351/2888] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:56 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:56.827114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ccfcc2fc-6ef7-43d2-b37b-9fb31f8a4709 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:56.829974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0e397b24-bb9e-492f-b351-c08230fd79fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:56.831185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0e397b24-bb9e-492f-b351-c08230fd79fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:56.835000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ccfcc2fc-6ef7-43d2-b37b-9fb31f8a4709 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.207696 Jul 27 23:13:56.836594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1538/2889] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:56 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:56.837156 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e397b24-bb9e-492f-b351-c08230fd79fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:56.837603 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e397b24-bb9e-492f-b351-c08230fd79fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:56.838365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e397b24-bb9e-492f-b351-c08230fd79fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:56.838794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0e397b24-bb9e-492f-b351-c08230fd79fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:56.970276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0e397b24-bb9e-492f-b351-c08230fd79fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:56.978255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0e397b24-bb9e-492f-b351-c08230fd79fa tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.152187 Jul 27 23:13:56.978821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1352/2890] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:56 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:57.845834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-afd70b10-f5a1-45af-817f-79ec2abe7301 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:57.846442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-afd70b10-f5a1-45af-817f-79ec2abe7301 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:57.853066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afd70b10-f5a1-45af-817f-79ec2abe7301 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:57.853513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afd70b10-f5a1-45af-817f-79ec2abe7301 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:57.854265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afd70b10-f5a1-45af-817f-79ec2abe7301 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:57.854699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-afd70b10-f5a1-45af-817f-79ec2abe7301 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:57.855614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6c4c36d8-339b-4a68-903e-c008aa7e888a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:57.856229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6c4c36d8-339b-4a68-903e-c008aa7e888a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:57.862902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c4c36d8-339b-4a68-903e-c008aa7e888a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:57.863340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c4c36d8-339b-4a68-903e-c008aa7e888a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:57.864086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c4c36d8-339b-4a68-903e-c008aa7e888a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:57.864533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c4c36d8-339b-4a68-903e-c008aa7e888a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:58.051967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-afd70b10-f5a1-45af-817f-79ec2abe7301 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:58.054718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6c4c36d8-339b-4a68-903e-c008aa7e888a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:58.060272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-afd70b10-f5a1-45af-817f-79ec2abe7301 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.218223 Jul 27 23:13:58.060864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1539/2891] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:57 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:58.062674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6c4c36d8-339b-4a68-903e-c008aa7e888a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.210775 Jul 27 23:13:58.063750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1353/2892] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:57 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:58.066117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cd19a16c-cbdd-4dec-ad35-a93a6d2242b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:58.066721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cd19a16c-cbdd-4dec-ad35-a93a6d2242b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:58.072462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd19a16c-cbdd-4dec-ad35-a93a6d2242b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:58.072942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd19a16c-cbdd-4dec-ad35-a93a6d2242b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:58.073694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd19a16c-cbdd-4dec-ad35-a93a6d2242b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:58.074152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cd19a16c-cbdd-4dec-ad35-a93a6d2242b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:58.201003 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cd19a16c-cbdd-4dec-ad35-a93a6d2242b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:58.208872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cd19a16c-cbdd-4dec-ad35-a93a6d2242b2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147060 Jul 27 23:13:58.209440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1540/2893] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:58 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:59.083073 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-dc4d3673-1fb4-4898-b530-60d2fb4532bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:59.083655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0f145819-b230-4351-b691-daedd2e2ed5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:59.084029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-dc4d3673-1fb4-4898-b530-60d2fb4532bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:59.084140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0f145819-b230-4351-b691-daedd2e2ed5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:59.090219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc4d3673-1fb4-4898-b530-60d2fb4532bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:59.090471 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0f145819-b230-4351-b691-daedd2e2ed5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:59.090666 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc4d3673-1fb4-4898-b530-60d2fb4532bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:59.090917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0f145819-b230-4351-b691-daedd2e2ed5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:59.091428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc4d3673-1fb4-4898-b530-60d2fb4532bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:59.091680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0f145819-b230-4351-b691-daedd2e2ed5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:59.091870 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-dc4d3673-1fb4-4898-b530-60d2fb4532bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:59.092105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0f145819-b230-4351-b691-daedd2e2ed5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:59.280268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0f145819-b230-4351-b691-daedd2e2ed5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:59.288439 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0f145819-b230-4351-b691-daedd2e2ed5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.208671 Jul 27 23:13:59.289070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1541/2894] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:59 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:13:59.290929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-dc4d3673-1fb4-4898-b530-60d2fb4532bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:59.293626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-716314fd-9579-492c-ae6b-91d3ddd73d3f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:13:59.294373 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-716314fd-9579-492c-ae6b-91d3ddd73d3f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:13:59.299067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-dc4d3673-1fb4-4898-b530-60d2fb4532bc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.220650 Jul 27 23:13:59.299813 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1354/2895] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:59 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:13:59.300150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-716314fd-9579-492c-ae6b-91d3ddd73d3f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:59.300620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-716314fd-9579-492c-ae6b-91d3ddd73d3f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:59.301383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-716314fd-9579-492c-ae6b-91d3ddd73d3f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:13:59.301812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-716314fd-9579-492c-ae6b-91d3ddd73d3f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:13:59.430027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-716314fd-9579-492c-ae6b-91d3ddd73d3f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:13:59.438350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-716314fd-9579-492c-ae6b-91d3ddd73d3f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147753 Jul 27 23:13:59.438910 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1542/2896] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:13:59 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:00.310195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8cfd097a-8bf0-4156-8708-cffb91b54b8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:00.310802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8cfd097a-8bf0-4156-8708-cffb91b54b8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:00.318061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8cfd097a-8bf0-4156-8708-cffb91b54b8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:00.318517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8cfd097a-8bf0-4156-8708-cffb91b54b8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:00.319313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8cfd097a-8bf0-4156-8708-cffb91b54b8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:00.319461 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fb5f1576-9408-41ff-9070-bdcf71ff8041 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:00.319888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8cfd097a-8bf0-4156-8708-cffb91b54b8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:00.320069 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fb5f1576-9408-41ff-9070-bdcf71ff8041 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:00.326445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb5f1576-9408-41ff-9070-bdcf71ff8041 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:00.326887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb5f1576-9408-41ff-9070-bdcf71ff8041 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:00.327641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb5f1576-9408-41ff-9070-bdcf71ff8041 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:00.328071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb5f1576-9408-41ff-9070-bdcf71ff8041 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:00.511571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8cfd097a-8bf0-4156-8708-cffb91b54b8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:00.515489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fb5f1576-9408-41ff-9070-bdcf71ff8041 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:00.517689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:00.519926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8cfd097a-8bf0-4156-8708-cffb91b54b8c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.213494 Jul 27 23:14:00.520498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1355/2897] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:00 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:00.524835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fb5f1576-9408-41ff-9070-bdcf71ff8041 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.209037 Jul 27 23:14:00.524998 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f645121f-d002-4086-947c-53cd3787ab75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:00.525429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f645121f-d002-4086-947c-53cd3787ab75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:00.525688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1543/2898] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:00 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:00.534999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f645121f-d002-4086-947c-53cd3787ab75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:00.535440 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f645121f-d002-4086-947c-53cd3787ab75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:00.536196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f645121f-d002-4086-947c-53cd3787ab75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:00.536662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f645121f-d002-4086-947c-53cd3787ab75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:00.662122 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f645121f-d002-4086-947c-53cd3787ab75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:00.670193 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f645121f-d002-4086-947c-53cd3787ab75 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148725 Jul 27 23:14:00.670767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1356/2899] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:00 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:01.540773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6fbbdcfb-fd91-4b45-b4e6-499d56580173 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:01.541386 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6fbbdcfb-fd91-4b45-b4e6-499d56580173 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:01.545614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-77fc2d29-fe48-4255-961c-0d70e4680264 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:01.546221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-77fc2d29-fe48-4255-961c-0d70e4680264 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:01.547978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6fbbdcfb-fd91-4b45-b4e6-499d56580173 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:01.548418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6fbbdcfb-fd91-4b45-b4e6-499d56580173 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:01.549200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6fbbdcfb-fd91-4b45-b4e6-499d56580173 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:01.549628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6fbbdcfb-fd91-4b45-b4e6-499d56580173 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:01.552513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77fc2d29-fe48-4255-961c-0d70e4680264 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:01.552991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77fc2d29-fe48-4255-961c-0d70e4680264 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:01.553740 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77fc2d29-fe48-4255-961c-0d70e4680264 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:01.554173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-77fc2d29-fe48-4255-961c-0d70e4680264 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:01.745882 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6fbbdcfb-fd91-4b45-b4e6-499d56580173 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:01.749631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-77fc2d29-fe48-4255-961c-0d70e4680264 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:01.754356 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6fbbdcfb-fd91-4b45-b4e6-499d56580173 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.217613 Jul 27 23:14:01.754919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1544/2900] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:01 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:01.758177 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-77fc2d29-fe48-4255-961c-0d70e4680264 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.216441 Jul 27 23:14:01.758888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1357/2901] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:01 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:01.759474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b0db10a1-0751-46d2-9b9d-7323b7a709cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:01.760056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b0db10a1-0751-46d2-9b9d-7323b7a709cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:01.765925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0db10a1-0751-46d2-9b9d-7323b7a709cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:01.766906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0db10a1-0751-46d2-9b9d-7323b7a709cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:01.767666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0db10a1-0751-46d2-9b9d-7323b7a709cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:01.768099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b0db10a1-0751-46d2-9b9d-7323b7a709cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:01.892617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b0db10a1-0751-46d2-9b9d-7323b7a709cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:01.900407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b0db10a1-0751-46d2-9b9d-7323b7a709cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.144545 Jul 27 23:14:01.900998 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1545/2902] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:01 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:02.776821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f1d8213f-db1e-42fc-b1bd-813439722622 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:02.777436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f1d8213f-db1e-42fc-b1bd-813439722622 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:02.778799 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5cd833d5-637b-44c7-a5a0-65144bcdc389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:02.779406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5cd833d5-637b-44c7-a5a0-65144bcdc389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:02.784667 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1d8213f-db1e-42fc-b1bd-813439722622 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:02.785119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1d8213f-db1e-42fc-b1bd-813439722622 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:02.785874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1d8213f-db1e-42fc-b1bd-813439722622 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:02.786304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1d8213f-db1e-42fc-b1bd-813439722622 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:02.786631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5cd833d5-637b-44c7-a5a0-65144bcdc389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:02.787075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5cd833d5-637b-44c7-a5a0-65144bcdc389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:02.787819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5cd833d5-637b-44c7-a5a0-65144bcdc389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:02.788249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5cd833d5-637b-44c7-a5a0-65144bcdc389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:02.978913 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f1d8213f-db1e-42fc-b1bd-813439722622 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:02.981737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5cd833d5-637b-44c7-a5a0-65144bcdc389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:02.987270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f1d8213f-db1e-42fc-b1bd-813439722622 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.214278 Jul 27 23:14:02.987816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1358/2903] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:02 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:02.990120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5cd833d5-637b-44c7-a5a0-65144bcdc389 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.215042 Jul 27 23:14:02.990847 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1546/2904] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:02 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:02.992191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-aa13e0bc-47ba-4433-93d6-f87462abc534 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:02.992890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-aa13e0bc-47ba-4433-93d6-f87462abc534 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:02.998716 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aa13e0bc-47ba-4433-93d6-f87462abc534 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:02.999159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aa13e0bc-47ba-4433-93d6-f87462abc534 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:02.999910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aa13e0bc-47ba-4433-93d6-f87462abc534 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:03.000884 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aa13e0bc-47ba-4433-93d6-f87462abc534 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:03.129335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-aa13e0bc-47ba-4433-93d6-f87462abc534 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:03.137184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-aa13e0bc-47ba-4433-93d6-f87462abc534 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148422 Jul 27 23:14:03.137749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1359/2905] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:02 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:04.009130 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-deb3cd2a-8653-4a91-8c2f-48bf53d83800 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:04.009721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-deb3cd2a-8653-4a91-8c2f-48bf53d83800 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:04.012644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-943c1ddb-f834-4e01-8dbd-23c73af4880c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:04.013317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-943c1ddb-f834-4e01-8dbd-23c73af4880c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:04.016585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-deb3cd2a-8653-4a91-8c2f-48bf53d83800 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:04.017339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-deb3cd2a-8653-4a91-8c2f-48bf53d83800 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:04.018485 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-deb3cd2a-8653-4a91-8c2f-48bf53d83800 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:04.018920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-deb3cd2a-8653-4a91-8c2f-48bf53d83800 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:04.019686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-943c1ddb-f834-4e01-8dbd-23c73af4880c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:04.020129 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-943c1ddb-f834-4e01-8dbd-23c73af4880c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:04.020905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-943c1ddb-f834-4e01-8dbd-23c73af4880c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:04.021335 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-943c1ddb-f834-4e01-8dbd-23c73af4880c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:04.214543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-deb3cd2a-8653-4a91-8c2f-48bf53d83800 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:04.218481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-943c1ddb-f834-4e01-8dbd-23c73af4880c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:04.224307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-deb3cd2a-8653-4a91-8c2f-48bf53d83800 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.218916 Jul 27 23:14:04.224938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1547/2906] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:04 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:04.229466 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ad527f97-c434-4f28-9b64-3ced0da63fb3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:04.230085 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ad527f97-c434-4f28-9b64-3ced0da63fb3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:04.235928 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-943c1ddb-f834-4e01-8dbd-23c73af4880c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.227145 Jul 27 23:14:04.236526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1360/2907] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:04 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:04.236699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ad527f97-c434-4f28-9b64-3ced0da63fb3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:04.237007 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ad527f97-c434-4f28-9b64-3ced0da63fb3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:04.237824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ad527f97-c434-4f28-9b64-3ced0da63fb3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:04.238282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ad527f97-c434-4f28-9b64-3ced0da63fb3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:04.363903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ad527f97-c434-4f28-9b64-3ced0da63fb3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:04.371782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ad527f97-c434-4f28-9b64-3ced0da63fb3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.145916 Jul 27 23:14:04.372349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1548/2908] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:04 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:05.145498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-50772909-643b-4e94-8e49-ce140502a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:05.146063 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-50772909-643b-4e94-8e49-ce140502a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:05.152726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50772909-643b-4e94-8e49-ce140502a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:05.153167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50772909-643b-4e94-8e49-ce140502a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:05.153945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50772909-643b-4e94-8e49-ce140502a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:05.154642 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50772909-643b-4e94-8e49-ce140502a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:05.179757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-50772909-643b-4e94-8e49-ce140502a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Going to try to terminate instance {{(pid=129294) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 23:14:05.223653 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:05.246933 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2d0ada95-1d03-49e3-9249-1c6c2faae5bf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:05.247632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2d0ada95-1d03-49e3-9249-1c6c2faae5bf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:05.256598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2d0ada95-1d03-49e3-9249-1c6c2faae5bf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:05.257006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2d0ada95-1d03-49e3-9249-1c6c2faae5bf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:05.257770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2d0ada95-1d03-49e3-9249-1c6c2faae5bf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:05.258201 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2d0ada95-1d03-49e3-9249-1c6c2faae5bf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:05.259262 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-50772909-643b-4e94-8e49-ce140502a367 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 204 len: 0 microversion: 2.20 time: 0.117331 Jul 27 23:14:05.263521 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1361/2909] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Jul 27 23:14:05 2022] DELETE /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 23:14:05.267455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2a36203f-19ad-4690-8f37-bb3ea858d130 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:05.268154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2a36203f-19ad-4690-8f37-bb3ea858d130 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:05.274183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a36203f-19ad-4690-8f37-bb3ea858d130 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:05.274631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a36203f-19ad-4690-8f37-bb3ea858d130 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:05.275394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a36203f-19ad-4690-8f37-bb3ea858d130 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:05.275827 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2a36203f-19ad-4690-8f37-bb3ea858d130 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:05.443582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2d0ada95-1d03-49e3-9249-1c6c2faae5bf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:05.451545 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2d0ada95-1d03-49e3-9249-1c6c2faae5bf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.208432 Jul 27 23:14:05.452317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1549/2910] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:05 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:05.457515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-46f3a55b-a0b5-4e98-a7b7-0b274f9007a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:05.458198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-46f3a55b-a0b5-4e98-a7b7-0b274f9007a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:05.464840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-46f3a55b-a0b5-4e98-a7b7-0b274f9007a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:05.465117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2a36203f-19ad-4690-8f37-bb3ea858d130 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:05.465281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-46f3a55b-a0b5-4e98-a7b7-0b274f9007a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:05.466242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-46f3a55b-a0b5-4e98-a7b7-0b274f9007a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:05.466668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-46f3a55b-a0b5-4e98-a7b7-0b274f9007a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:05.473350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2a36203f-19ad-4690-8f37-bb3ea858d130 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.210867 Jul 27 23:14:05.473911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1362/2911] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:05 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:05.478322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4de95d12-a0c5-45cf-9da5-7307036db2a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:05.479164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4de95d12-a0c5-45cf-9da5-7307036db2a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:05.484925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4de95d12-a0c5-45cf-9da5-7307036db2a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:05.485694 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4de95d12-a0c5-45cf-9da5-7307036db2a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:05.486577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4de95d12-a0c5-45cf-9da5-7307036db2a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:05.487099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4de95d12-a0c5-45cf-9da5-7307036db2a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:05.661081 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-46f3a55b-a0b5-4e98-a7b7-0b274f9007a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:05.667567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4de95d12-a0c5-45cf-9da5-7307036db2a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:05.669119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-46f3a55b-a0b5-4e98-a7b7-0b274f9007a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:05.670631 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-46f3a55b-a0b5-4e98-a7b7-0b274f9007a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:05.671799 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-46f3a55b-a0b5-4e98-a7b7-0b274f9007a4 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 200 len: 1723 microversion: 2.20 time: 0.218496 Jul 27 23:14:05.672901 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1550/2912] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:14:05 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:14:05.676170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4de95d12-a0c5-45cf-9da5-7307036db2a9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.201299 Jul 27 23:14:05.676758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1363/2913] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:05 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:06.474346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c9a1f75f-1a4d-4261-bf3f-a12a4c1ec426 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:06.474972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c9a1f75f-1a4d-4261-bf3f-a12a4c1ec426 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:06.481477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9a1f75f-1a4d-4261-bf3f-a12a4c1ec426 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:06.481920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9a1f75f-1a4d-4261-bf3f-a12a4c1ec426 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:06.482667 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9a1f75f-1a4d-4261-bf3f-a12a4c1ec426 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:06.483099 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c9a1f75f-1a4d-4261-bf3f-a12a4c1ec426 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:06.495321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-51fe045b-31c8-433c-bac6-aac2f6726873 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:06.495954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-51fe045b-31c8-433c-bac6-aac2f6726873 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:06.502507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51fe045b-31c8-433c-bac6-aac2f6726873 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:06.502948 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51fe045b-31c8-433c-bac6-aac2f6726873 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:06.503702 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51fe045b-31c8-433c-bac6-aac2f6726873 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:06.504126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-51fe045b-31c8-433c-bac6-aac2f6726873 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:06.688979 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c9a1f75f-1a4d-4261-bf3f-a12a4c1ec426 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:06.694289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-51fe045b-31c8-433c-bac6-aac2f6726873 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:06.702067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-51fe045b-31c8-433c-bac6-aac2f6726873 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.211158 Jul 27 23:14:06.702807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1364/2914] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:06 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:06.705560 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c9a1f75f-1a4d-4261-bf3f-a12a4c1ec426 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.234598 Jul 27 23:14:06.706663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1551/2915] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:06 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:06.707519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7d51186f-e695-462a-8c94-981cbf650ad6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:06.708241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7d51186f-e695-462a-8c94-981cbf650ad6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:06.713915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7d51186f-e695-462a-8c94-981cbf650ad6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:06.714354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7d51186f-e695-462a-8c94-981cbf650ad6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:06.715097 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7d51186f-e695-462a-8c94-981cbf650ad6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:06.715522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7d51186f-e695-462a-8c94-981cbf650ad6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:06.733313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-459fa649-a5f0-4b70-8cc1-81e4afae6160 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:06.734057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-459fa649-a5f0-4b70-8cc1-81e4afae6160 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:06.741086 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-459fa649-a5f0-4b70-8cc1-81e4afae6160 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:06.741657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-459fa649-a5f0-4b70-8cc1-81e4afae6160 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:06.742559 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-459fa649-a5f0-4b70-8cc1-81e4afae6160 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:06.742992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-459fa649-a5f0-4b70-8cc1-81e4afae6160 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:06.913997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7d51186f-e695-462a-8c94-981cbf650ad6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:06.919480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-459fa649-a5f0-4b70-8cc1-81e4afae6160 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:06.927550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7d51186f-e695-462a-8c94-981cbf650ad6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:06.927830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-459fa649-a5f0-4b70-8cc1-81e4afae6160 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.205785 Jul 27 23:14:06.928403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1552/2916] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:06 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:06.929070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7d51186f-e695-462a-8c94-981cbf650ad6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:06.930233 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7d51186f-e695-462a-8c94-981cbf650ad6 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 200 len: 1723 microversion: 2.20 time: 0.226713 Jul 27 23:14:06.938220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1365/2917] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:14:06 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:14:07.649859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-68bf0cc8-4105-4950-9250-be2d39093ff6 req-5831ba3b-5396-49d3-9aaf-f09cb9cbaab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e14c602-f2a6-42c9-a947-98efffc174fa", "name": "network-vif-deleted", "tag": "cda98f4f-a5d7-411b-8d2f-4f739e8e8af3"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:14:07.660525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-68bf0cc8-4105-4950-9250-be2d39093ff6 req-5831ba3b-5396-49d3-9aaf-f09cb9cbaab5 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:07.661104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-68bf0cc8-4105-4950-9250-be2d39093ff6 req-5831ba3b-5396-49d3-9aaf-f09cb9cbaab5 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:07.673032 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-68bf0cc8-4105-4950-9250-be2d39093ff6 req-5831ba3b-5396-49d3-9aaf-f09cb9cbaab5 service nova] Creating event network-vif-deleted:cda98f4f-a5d7-411b-8d2f-4f739e8e8af3 for instance 3e14c602-f2a6-42c9-a947-98efffc174fa on hv-cinder-85124 Jul 27 23:14:07.678418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-68bf0cc8-4105-4950-9250-be2d39093ff6 req-5831ba3b-5396-49d3-9aaf-f09cb9cbaab5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032166 Jul 27 23:14:07.678997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1553/2918] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:14:07.743767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a4482590-b385-4e07-98a0-abdbc5d65ebd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:07.744052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-41d9cb7b-82b4-416a-ae5c-5954fab5e4a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:07.745029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a4482590-b385-4e07-98a0-abdbc5d65ebd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:07.745714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-41d9cb7b-82b4-416a-ae5c-5954fab5e4a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:07.753791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41d9cb7b-82b4-416a-ae5c-5954fab5e4a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:07.754717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41d9cb7b-82b4-416a-ae5c-5954fab5e4a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:07.756167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41d9cb7b-82b4-416a-ae5c-5954fab5e4a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:07.756884 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-41d9cb7b-82b4-416a-ae5c-5954fab5e4a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:07.765539 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4482590-b385-4e07-98a0-abdbc5d65ebd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:07.766029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4482590-b385-4e07-98a0-abdbc5d65ebd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:07.766795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4482590-b385-4e07-98a0-abdbc5d65ebd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:07.767489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a4482590-b385-4e07-98a0-abdbc5d65ebd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:07.965985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-41d9cb7b-82b4-416a-ae5c-5954fab5e4a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:07.975493 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-41d9cb7b-82b4-416a-ae5c-5954fab5e4a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.239098 Jul 27 23:14:07.976279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1366/2919] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:07 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:07.980953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d054facf-f434-4d21-b7d9-510a33583760 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:07.981625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d054facf-f434-4d21-b7d9-510a33583760 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:07.987733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d054facf-f434-4d21-b7d9-510a33583760 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:07.988248 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d054facf-f434-4d21-b7d9-510a33583760 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:07.989096 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d054facf-f434-4d21-b7d9-510a33583760 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:07.989590 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d054facf-f434-4d21-b7d9-510a33583760 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:08.000317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a4482590-b385-4e07-98a0-abdbc5d65ebd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:08.010124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a4482590-b385-4e07-98a0-abdbc5d65ebd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.272152 Jul 27 23:14:08.011293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1554/2920] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:07 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:08.017341 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c11ef95a-099a-4dfd-91be-1748072d37d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:08.018176 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c11ef95a-099a-4dfd-91be-1748072d37d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:08.029462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c11ef95a-099a-4dfd-91be-1748072d37d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:08.029916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c11ef95a-099a-4dfd-91be-1748072d37d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:08.030688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c11ef95a-099a-4dfd-91be-1748072d37d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:08.031121 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c11ef95a-099a-4dfd-91be-1748072d37d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:08.065363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c11ef95a-099a-4dfd-91be-1748072d37d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:08.066311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c11ef95a-099a-4dfd-91be-1748072d37d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:08.066773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.objects.instance [None req-c11ef95a-099a-4dfd-91be-1748072d37d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lazy-loading 'fault' on Instance uuid 3e14c602-f2a6-42c9-a947-98efffc174fa {{(pid=129295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 23:14:08.131759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c11ef95a-099a-4dfd-91be-1748072d37d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:08.147711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c11ef95a-099a-4dfd-91be-1748072d37d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:08.149589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c11ef95a-099a-4dfd-91be-1748072d37d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51db745daefd448b80630ef1bceca4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d65941ddb4346e0b3fdc6b751a6aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:08.151174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c11ef95a-099a-4dfd-91be-1748072d37d7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 200 len: 1371 microversion: 2.20 time: 0.138111 Jul 27 23:14:08.151903 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1555/2921] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:14:08 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 1371 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 23:14:08.177718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d054facf-f434-4d21-b7d9-510a33583760 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:08.185599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d054facf-f434-4d21-b7d9-510a33583760 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.208074 Jul 27 23:14:08.186164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1367/2922] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:07 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:08.997949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ebe9baae-6044-4e11-b1bd-b7031a022d6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:08.998521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ebe9baae-6044-4e11-b1bd-b7031a022d6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:09.004987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebe9baae-6044-4e11-b1bd-b7031a022d6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:09.005429 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebe9baae-6044-4e11-b1bd-b7031a022d6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:09.006174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebe9baae-6044-4e11-b1bd-b7031a022d6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:09.006600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ebe9baae-6044-4e11-b1bd-b7031a022d6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:09.032907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-70275945-0c32-4111-a56d-0773e6e84ead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:09.033541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-70275945-0c32-4111-a56d-0773e6e84ead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:09.039961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-70275945-0c32-4111-a56d-0773e6e84ead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:09.040402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-70275945-0c32-4111-a56d-0773e6e84ead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:09.041398 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-70275945-0c32-4111-a56d-0773e6e84ead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:09.041832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-70275945-0c32-4111-a56d-0773e6e84ead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:09.187207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ebe9baae-6044-4e11-b1bd-b7031a022d6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:09.195188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ebe9baae-6044-4e11-b1bd-b7031a022d6a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.201097 Jul 27 23:14:09.195837 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1556/2923] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:08 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:09.201366 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e75101f1-84c1-400d-9a35-663104801ba7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:09.201366 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e75101f1-84c1-400d-9a35-663104801ba7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:09.206956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e75101f1-84c1-400d-9a35-663104801ba7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:09.207490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e75101f1-84c1-400d-9a35-663104801ba7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:09.208310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e75101f1-84c1-400d-9a35-663104801ba7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:09.208829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e75101f1-84c1-400d-9a35-663104801ba7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:09.213534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-70275945-0c32-4111-a56d-0773e6e84ead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:09.221989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-70275945-0c32-4111-a56d-0773e6e84ead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.193506 Jul 27 23:14:09.222555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1368/2924] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:09 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:09.222910 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-e75101f1-84c1-400d-9a35-663104801ba7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] HTTP exception thrown: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e75101f1-84c1-400d-9a35-663104801ba7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Request method failure captured: Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa HTTP/1.1 Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cDv1fgJXsCQ367hlkfbdy7_aF-GgajmNo48KEhXU3sOmci0R6PIoILwJ9otstrCU4xECyUgYlbPwRnfHz_orgOPqIQAEPi2rXWNdR68mzoCl_EJZ_E_UmV4xv9NhF92_iS6PFjgjvqGQlUXvFZSUkhi1-s4n18VxZnhkGbSDsJ3BEE Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 0d65941ddb4346e0b3fdc6b751a6aa07 Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:14:09.224747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:14:09.226690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0d65941ddb4346e0b3fdc6b751a6aa07", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:14:09.226690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:14:09.226690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 0d65941ddb4346e0b3fdc6b751a6aa07 Jul 27 23:14:09.226690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:14:09.226690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-AttachVolumeShelveTestJSON-2081014947-project Jul 27 23:14:09.226690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:14:09.226690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:14:09.226690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 51db745daefd448b80630ef1bceca4c4 Jul 27 23:14:09.226690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2081014947-project Jul 27 23:14:09.226690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:14:09.226690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.226690 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': '3e14c602-f2a6-42c9-a947-98efffc174fa'} Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:14:09.227578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.229152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.231502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e75101f1-84c1-400d-9a35-663104801ba7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Returning 404 to user: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:14:09.231502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e75101f1-84c1-400d-9a35-663104801ba7 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 404 len: 111 microversion: 2.20 time: 0.029317 Jul 27 23:14:09.231502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1557/2925] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:14:09 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 23:14:09.233807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a507a008-b30f-40d4-ae65-720635d2ff0c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:09.234411 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a507a008-b30f-40d4-ae65-720635d2ff0c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:09.235499 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c5c2a029-9e75-40d9-87fc-8c6b872ae5d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '.version_select at 0x7f696e964160>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:09.241389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a507a008-b30f-40d4-ae65-720635d2ff0c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:09.241834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a507a008-b30f-40d4-ae65-720635d2ff0c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:09.242592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a507a008-b30f-40d4-ae65-720635d2ff0c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:09.243022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a507a008-b30f-40d4-ae65-720635d2ff0c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:09.253607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c5c2a029-9e75-40d9-87fc-8c6b872ae5d5 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863141698" status: 204 len: 0 microversion: 2.20 time: 0.022506 Jul 27 23:14:09.254103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1558/2926] 10.222.0.47 () {60 vars in 1262 bytes} [Wed Jul 27 23:14:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863141698 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 23:14:09.372308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a507a008-b30f-40d4-ae65-720635d2ff0c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:09.380704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a507a008-b30f-40d4-ae65-720635d2ff0c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.157171 Jul 27 23:14:09.381273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1369/2927] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:09 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:09.867913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b5c0276d-9e81-4c15-9774-ffe95b416970 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:09.868375 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b5c0276d-9e81-4c15-9774-ffe95b416970 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:09.874450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5c0276d-9e81-4c15-9774-ffe95b416970 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:09.874890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5c0276d-9e81-4c15-9774-ffe95b416970 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:09.876145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5c0276d-9e81-4c15-9774-ffe95b416970 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:09.876585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b5c0276d-9e81-4c15-9774-ffe95b416970 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:09.890185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-b5c0276d-9e81-4c15-9774-ffe95b416970 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] HTTP exception thrown: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b5c0276d-9e81-4c15-9774-ffe95b416970 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Request method failure captured: Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: DELETE /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa HTTP/1.1 Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cDv1fgJXsCQ367hlkfbdy7_aF-GgajmNo48KEhXU3sOmci0R6PIoILwJ9otstrCU4xECyUgYlbPwRnfHz_orgOPqIQAEPi2rXWNdR68mzoCl_EJZ_E_UmV4xv9NhF92_iS6PFjgjvqGQlUXvFZSUkhi1-s4n18VxZnhkGbSDsJ3BEE Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 0d65941ddb4346e0b3fdc6b751a6aa07 Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:14:09.892304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:14:09.894184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0d65941ddb4346e0b3fdc6b751a6aa07", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:14:09.894184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:14:09.894184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 0d65941ddb4346e0b3fdc6b751a6aa07 Jul 27 23:14:09.894184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:14:09.894184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-AttachVolumeShelveTestJSON-2081014947-project Jul 27 23:14:09.894184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:14:09.894184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:14:09.894184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 51db745daefd448b80630ef1bceca4c4 Jul 27 23:14:09.894184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2081014947-project Jul 27 23:14:09.894184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:14:09.894184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.894184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': '3e14c602-f2a6-42c9-a947-98efffc174fa'} Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:14:09.895280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.896898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.898627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b5c0276d-9e81-4c15-9774-ffe95b416970 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Returning 404 to user: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:14:09.898627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b5c0276d-9e81-4c15-9774-ffe95b416970 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 404 len: 111 microversion: 2.20 time: 0.029816 Jul 27 23:14:09.898627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1559/2928] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Jul 27 23:14:09 2022] DELETE /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 23:14:09.902217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-75930c72-039b-4ebb-a491-30ae3c4ea034 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:09.903091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-75930c72-039b-4ebb-a491-30ae3c4ea034 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: 3e14c602-f2a6-42c9-a947-98efffc174fa] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:09.909019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75930c72-039b-4ebb-a491-30ae3c4ea034 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:09.909483 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75930c72-039b-4ebb-a491-30ae3c4ea034 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:09.910225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75930c72-039b-4ebb-a491-30ae3c4ea034 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:09.910652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-75930c72-039b-4ebb-a491-30ae3c4ea034 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:09.923834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-75930c72-039b-4ebb-a491-30ae3c4ea034 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] HTTP exception thrown: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-75930c72-039b-4ebb-a491-30ae3c4ea034 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Request method failure captured: Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa HTTP/1.1 Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cDv1fgJXsCQ367hlkfbdy7_aF-GgajmNo48KEhXU3sOmci0R6PIoILwJ9otstrCU4xECyUgYlbPwRnfHz_orgOPqIQAEPi2rXWNdR68mzoCl_EJZ_E_UmV4xv9NhF92_iS6PFjgjvqGQlUXvFZSUkhi1-s4n18VxZnhkGbSDsJ3BEE Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 0d65941ddb4346e0b3fdc6b751a6aa07 Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 23:14:09.925486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 23:14:09.927260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0d65941ddb4346e0b3fdc6b751a6aa07", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:14:09.927260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:14:09.927260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 0d65941ddb4346e0b3fdc6b751a6aa07 Jul 27 23:14:09.927260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:14:09.927260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-AttachVolumeShelveTestJSON-2081014947-project Jul 27 23:14:09.927260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 23:14:09.927260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 23:14:09.927260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 51db745daefd448b80630ef1bceca4c4 Jul 27 23:14:09.927260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2081014947-project Jul 27 23:14:09.927260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 23:14:09.927260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.927260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '3e14c602-f2a6-42c9-a947-98efffc174fa'} Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:14:09.928227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. Jul 27 23:14:09.929847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:14:09.931209 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-75930c72-039b-4ebb-a491-30ae3c4ea034 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Returning 404 to user: Instance 3e14c602-f2a6-42c9-a947-98efffc174fa could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:14:09.931209 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-75930c72-039b-4ebb-a491-30ae3c4ea034 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa" status: 404 len: 111 microversion: 2.20 time: 0.028439 Jul 27 23:14:09.931209 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1370/2929] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:14:09 2022] GET /compute/v2.1/servers/3e14c602-f2a6-42c9-a947-98efffc174fa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 23:14:10.216866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2f93e84b-6973-4428-8a75-dd32e6062d02 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:10.217477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2f93e84b-6973-4428-8a75-dd32e6062d02 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:10.223972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2f93e84b-6973-4428-8a75-dd32e6062d02 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:10.224414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2f93e84b-6973-4428-8a75-dd32e6062d02 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:10.225194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2f93e84b-6973-4428-8a75-dd32e6062d02 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:10.225630 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2f93e84b-6973-4428-8a75-dd32e6062d02 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:10.243101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-27a6bda2-b900-421b-9328-86ff882332e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:10.243715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-27a6bda2-b900-421b-9328-86ff882332e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:10.250942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-27a6bda2-b900-421b-9328-86ff882332e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:10.251383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-27a6bda2-b900-421b-9328-86ff882332e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:10.252134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-27a6bda2-b900-421b-9328-86ff882332e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:10.252575 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-27a6bda2-b900-421b-9328-86ff882332e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:10.627174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2f93e84b-6973-4428-8a75-dd32e6062d02 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:10.634098 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-27a6bda2-b900-421b-9328-86ff882332e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:10.635361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2f93e84b-6973-4428-8a75-dd32e6062d02 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.422265 Jul 27 23:14:10.641908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1560/2930] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:10 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:10.641908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e31326e3-7f6b-487e-87a1-19083b940514 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:10.641908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e31326e3-7f6b-487e-87a1-19083b940514 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:10.642284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-27a6bda2-b900-421b-9328-86ff882332e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.402958 Jul 27 23:14:10.643070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1371/2931] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:10 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:10.649310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e31326e3-7f6b-487e-87a1-19083b940514 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:10.649868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e31326e3-7f6b-487e-87a1-19083b940514 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:10.650624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e31326e3-7f6b-487e-87a1-19083b940514 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:10.651050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e31326e3-7f6b-487e-87a1-19083b940514 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:10.778162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e31326e3-7f6b-487e-87a1-19083b940514 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:10.786413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e31326e3-7f6b-487e-87a1-19083b940514 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.149301 Jul 27 23:14:10.786973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1561/2932] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:10 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:11.657121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7f4999bb-6cbe-4c58-ac8b-69f417cedb65 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:11.657730 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7f4999bb-6cbe-4c58-ac8b-69f417cedb65 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:11.663075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-739c0cff-f96f-41c8-98d3-73b9377ab907 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:11.664174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-739c0cff-f96f-41c8-98d3-73b9377ab907 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:11.664337 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f4999bb-6cbe-4c58-ac8b-69f417cedb65 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:11.664783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f4999bb-6cbe-4c58-ac8b-69f417cedb65 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:11.665540 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f4999bb-6cbe-4c58-ac8b-69f417cedb65 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:11.665973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f4999bb-6cbe-4c58-ac8b-69f417cedb65 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:11.670546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-739c0cff-f96f-41c8-98d3-73b9377ab907 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:11.670988 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-739c0cff-f96f-41c8-98d3-73b9377ab907 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:11.671733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-739c0cff-f96f-41c8-98d3-73b9377ab907 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:11.672696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-739c0cff-f96f-41c8-98d3-73b9377ab907 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:11.801432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-739c0cff-f96f-41c8-98d3-73b9377ab907 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:11.809913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-739c0cff-f96f-41c8-98d3-73b9377ab907 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.150644 Jul 27 23:14:11.810562 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1562/2933] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:11 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:11.815590 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-85fa0b10-2d6d-4039-94f2-2984f1cb66b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:11.816282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-85fa0b10-2d6d-4039-94f2-2984f1cb66b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:11.822313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85fa0b10-2d6d-4039-94f2-2984f1cb66b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:11.822836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85fa0b10-2d6d-4039-94f2-2984f1cb66b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:11.823664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85fa0b10-2d6d-4039-94f2-2984f1cb66b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:11.824250 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-85fa0b10-2d6d-4039-94f2-2984f1cb66b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:11.827026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:11.910425 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7f4999bb-6cbe-4c58-ac8b-69f417cedb65 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:11.923534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7f4999bb-6cbe-4c58-ac8b-69f417cedb65 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.268197 Jul 27 23:14:11.923534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1372/2934] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:11 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:12.102241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-85fa0b10-2d6d-4039-94f2-2984f1cb66b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:12.110829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-85fa0b10-2d6d-4039-94f2-2984f1cb66b3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.299276 Jul 27 23:14:12.111390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1563/2935] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:11 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:12.831786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ad0137d4-c547-48c1-9ede-43dd6e499680 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:12.832395 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ad0137d4-c547-48c1-9ede-43dd6e499680 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:12.838841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad0137d4-c547-48c1-9ede-43dd6e499680 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:12.839279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad0137d4-c547-48c1-9ede-43dd6e499680 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:12.840026 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad0137d4-c547-48c1-9ede-43dd6e499680 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:12.840454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad0137d4-c547-48c1-9ede-43dd6e499680 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:12.948508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4b93b72f-78e9-4535-aa0b-69a592b1e764 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:12.949162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4b93b72f-78e9-4535-aa0b-69a592b1e764 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:12.957709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4b93b72f-78e9-4535-aa0b-69a592b1e764 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:12.958156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4b93b72f-78e9-4535-aa0b-69a592b1e764 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:12.958917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4b93b72f-78e9-4535-aa0b-69a592b1e764 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:12.959345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4b93b72f-78e9-4535-aa0b-69a592b1e764 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:12.972960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ad0137d4-c547-48c1-9ede-43dd6e499680 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:12.980860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ad0137d4-c547-48c1-9ede-43dd6e499680 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.153484 Jul 27 23:14:12.981428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1373/2936] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:12 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:13.089095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4b93b72f-78e9-4535-aa0b-69a592b1e764 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:13.097122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4b93b72f-78e9-4535-aa0b-69a592b1e764 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.152733 Jul 27 23:14:13.097708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1564/2937] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:12 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:13.133154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d1d6b1a1-fb0b-490f-b93a-93d01ed88bf9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:13.133767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d1d6b1a1-fb0b-490f-b93a-93d01ed88bf9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:13.139784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1a1-fb0b-490f-b93a-93d01ed88bf9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:13.140229 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1a1-fb0b-490f-b93a-93d01ed88bf9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:13.141094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1a1-fb0b-490f-b93a-93d01ed88bf9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:13.141529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1a1-fb0b-490f-b93a-93d01ed88bf9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:13.266969 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d1d6b1a1-fb0b-490f-b93a-93d01ed88bf9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:13.281839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d1d6b1a1-fb0b-490f-b93a-93d01ed88bf9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.152413 Jul 27 23:14:13.282444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1374/2938] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:13 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:14.002754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8de0a083-c47b-4fb0-9013-e2e912c837f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:14.003301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8de0a083-c47b-4fb0-9013-e2e912c837f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:14.009411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8de0a083-c47b-4fb0-9013-e2e912c837f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:14.009854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8de0a083-c47b-4fb0-9013-e2e912c837f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:14.010600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8de0a083-c47b-4fb0-9013-e2e912c837f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:14.011025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8de0a083-c47b-4fb0-9013-e2e912c837f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:14.122200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0bbc6a02-f67a-4cbe-8abf-86b42312cc1a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:14.122200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0bbc6a02-f67a-4cbe-8abf-86b42312cc1a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:14.126605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bbc6a02-f67a-4cbe-8abf-86b42312cc1a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:14.127053 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bbc6a02-f67a-4cbe-8abf-86b42312cc1a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:14.127853 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bbc6a02-f67a-4cbe-8abf-86b42312cc1a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:14.128312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0bbc6a02-f67a-4cbe-8abf-86b42312cc1a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:14.147143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8de0a083-c47b-4fb0-9013-e2e912c837f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:14.155503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8de0a083-c47b-4fb0-9013-e2e912c837f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.156674 Jul 27 23:14:14.156072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1565/2939] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:13 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:14.273109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0bbc6a02-f67a-4cbe-8abf-86b42312cc1a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:14.281021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0bbc6a02-f67a-4cbe-8abf-86b42312cc1a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1734 microversion: 2.1 time: 0.165742 Jul 27 23:14:14.281615 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1375/2940] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:14 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:14.304829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1dab98a7-5f57-4786-87a9-fa57f8be2f60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:14.305433 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1dab98a7-5f57-4786-87a9-fa57f8be2f60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:14.311307 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1dab98a7-5f57-4786-87a9-fa57f8be2f60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:14.311752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1dab98a7-5f57-4786-87a9-fa57f8be2f60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:14.312491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1dab98a7-5f57-4786-87a9-fa57f8be2f60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:14.313440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1dab98a7-5f57-4786-87a9-fa57f8be2f60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:14.438068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1dab98a7-5f57-4786-87a9-fa57f8be2f60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:14.446037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1dab98a7-5f57-4786-87a9-fa57f8be2f60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.144901 Jul 27 23:14:14.446587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1566/2941] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:14 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:15.178341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bf104ef2-4816-4ce5-860d-7dfecdb9fdea tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:15.178932 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bf104ef2-4816-4ce5-860d-7dfecdb9fdea tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:15.185235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf104ef2-4816-4ce5-860d-7dfecdb9fdea tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:15.185672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf104ef2-4816-4ce5-860d-7dfecdb9fdea tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:15.186420 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf104ef2-4816-4ce5-860d-7dfecdb9fdea tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:15.186849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf104ef2-4816-4ce5-860d-7dfecdb9fdea tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:15.257478 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-3068d7b6-0939-4742-8ca3-3cfba8df4629 req-abc8083e-91ce-478a-9d50-59559085f7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a5ccc96-6331-4ef5-a712-a72739545469", "name": "network-vif-deleted", "tag": "e522cce6-f90b-46c9-abd8-23ce56eaac03"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:14:15.269999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-3068d7b6-0939-4742-8ca3-3cfba8df4629 req-abc8083e-91ce-478a-9d50-59559085f7ab service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:15.273191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-3068d7b6-0939-4742-8ca3-3cfba8df4629 req-abc8083e-91ce-478a-9d50-59559085f7ab service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:15.296750 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-3068d7b6-0939-4742-8ca3-3cfba8df4629 req-abc8083e-91ce-478a-9d50-59559085f7ab service nova] Creating event network-vif-deleted:e522cce6-f90b-46c9-abd8-23ce56eaac03 for instance 9a5ccc96-6331-4ef5-a712-a72739545469 on hv-cinder-85124 Jul 27 23:14:15.301965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-3068d7b6-0939-4742-8ca3-3cfba8df4629 req-abc8083e-91ce-478a-9d50-59559085f7ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048050 Jul 27 23:14:15.302559 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1567/2942] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 23:14:15.311767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9418924e-ac46-49cd-a927-5b1272d36899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:15.313811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9418924e-ac46-49cd-a927-5b1272d36899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:15.321276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9418924e-ac46-49cd-a927-5b1272d36899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:15.322049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9418924e-ac46-49cd-a927-5b1272d36899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:15.323193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9418924e-ac46-49cd-a927-5b1272d36899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:15.323953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9418924e-ac46-49cd-a927-5b1272d36899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:15.384452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bf104ef2-4816-4ce5-860d-7dfecdb9fdea tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:15.393449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bf104ef2-4816-4ce5-860d-7dfecdb9fdea tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.218870 Jul 27 23:14:15.403798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1376/2943] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:15 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:15.407443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9418924e-ac46-49cd-a927-5b1272d36899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:15.417070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9418924e-ac46-49cd-a927-5b1272d36899 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.110295 Jul 27 23:14:15.417881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1568/2944] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:15.467553 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-57af111c-c3c8-4da2-97c2-45a2253a3aff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:15.468170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-57af111c-c3c8-4da2-97c2-45a2253a3aff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:15.474869 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-57af111c-c3c8-4da2-97c2-45a2253a3aff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:15.475427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-57af111c-c3c8-4da2-97c2-45a2253a3aff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:15.476304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-57af111c-c3c8-4da2-97c2-45a2253a3aff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:15.476961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-57af111c-c3c8-4da2-97c2-45a2253a3aff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:15.607899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-57af111c-c3c8-4da2-97c2-45a2253a3aff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:15.616674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-57af111c-c3c8-4da2-97c2-45a2253a3aff tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.152928 Jul 27 23:14:15.617184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1377/2945] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:15 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:16.415586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-253f473f-56e5-4805-962a-6d36970588f7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:16.416530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-253f473f-56e5-4805-962a-6d36970588f7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:16.423352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-253f473f-56e5-4805-962a-6d36970588f7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:16.423796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-253f473f-56e5-4805-962a-6d36970588f7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:16.424594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-253f473f-56e5-4805-962a-6d36970588f7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:16.425013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-253f473f-56e5-4805-962a-6d36970588f7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:16.437509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-14e5cc4a-c620-4630-821a-f20b97f53168 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:16.438135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-14e5cc4a-c620-4630-821a-f20b97f53168 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:16.444323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14e5cc4a-c620-4630-821a-f20b97f53168 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:16.444799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14e5cc4a-c620-4630-821a-f20b97f53168 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:16.445564 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14e5cc4a-c620-4630-821a-f20b97f53168 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:16.445996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-14e5cc4a-c620-4630-821a-f20b97f53168 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:16.526436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-14e5cc4a-c620-4630-821a-f20b97f53168 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:16.530382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:16.538580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-14e5cc4a-c620-4630-821a-f20b97f53168 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.104879 Jul 27 23:14:16.539432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1378/2946] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:16 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:16.585157 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-253f473f-56e5-4805-962a-6d36970588f7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:16.593058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-253f473f-56e5-4805-962a-6d36970588f7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.181576 Jul 27 23:14:16.593617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1569/2947] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:16 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:16.639432 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-767bce72-2047-4aa9-8175-3c8e6784c4fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:16.639973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-767bce72-2047-4aa9-8175-3c8e6784c4fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:16.647492 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-767bce72-2047-4aa9-8175-3c8e6784c4fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:16.647936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-767bce72-2047-4aa9-8175-3c8e6784c4fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:16.648719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-767bce72-2047-4aa9-8175-3c8e6784c4fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:16.649152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-767bce72-2047-4aa9-8175-3c8e6784c4fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:16.775800 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-767bce72-2047-4aa9-8175-3c8e6784c4fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:16.783842 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-767bce72-2047-4aa9-8175-3c8e6784c4fb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148329 Jul 27 23:14:16.784461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1379/2948] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:16 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:17.564268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cdc3eaec-7d55-41f4-95ad-58b06618c071 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:17.564900 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cdc3eaec-7d55-41f4-95ad-58b06618c071 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:17.571462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cdc3eaec-7d55-41f4-95ad-58b06618c071 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:17.571932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cdc3eaec-7d55-41f4-95ad-58b06618c071 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:17.572686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cdc3eaec-7d55-41f4-95ad-58b06618c071 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:17.573129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cdc3eaec-7d55-41f4-95ad-58b06618c071 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:17.615103 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0c7d25eb-a90d-4145-b2c5-f3e77a5127a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:17.615708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0c7d25eb-a90d-4145-b2c5-f3e77a5127a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:17.622253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0c7d25eb-a90d-4145-b2c5-f3e77a5127a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:17.622701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0c7d25eb-a90d-4145-b2c5-f3e77a5127a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:17.623463 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0c7d25eb-a90d-4145-b2c5-f3e77a5127a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:17.623900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0c7d25eb-a90d-4145-b2c5-f3e77a5127a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:17.636769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cdc3eaec-7d55-41f4-95ad-58b06618c071 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:17.644497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cdc3eaec-7d55-41f4-95ad-58b06618c071 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.084559 Jul 27 23:14:17.645280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1570/2949] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:17 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:17.753821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0c7d25eb-a90d-4145-b2c5-f3e77a5127a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:17.761662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0c7d25eb-a90d-4145-b2c5-f3e77a5127a8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.150370 Jul 27 23:14:17.762211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1380/2950] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:17 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:17.804400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5aa2a4f8-65ae-46b5-a331-bdf408644f25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:17.805064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5aa2a4f8-65ae-46b5-a331-bdf408644f25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:17.808056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:17.812044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5aa2a4f8-65ae-46b5-a331-bdf408644f25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:17.813120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5aa2a4f8-65ae-46b5-a331-bdf408644f25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:17.813881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5aa2a4f8-65ae-46b5-a331-bdf408644f25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:17.814315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5aa2a4f8-65ae-46b5-a331-bdf408644f25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:17.940124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5aa2a4f8-65ae-46b5-a331-bdf408644f25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:17.947974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5aa2a4f8-65ae-46b5-a331-bdf408644f25 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147320 Jul 27 23:14:17.948515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1571/2951] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:17 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:18.665589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c44c4880-c145-4447-9f6b-935791a8e32b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:18.666181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c44c4880-c145-4447-9f6b-935791a8e32b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:18.672967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c44c4880-c145-4447-9f6b-935791a8e32b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:18.673404 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c44c4880-c145-4447-9f6b-935791a8e32b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:18.674142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c44c4880-c145-4447-9f6b-935791a8e32b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:18.674570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c44c4880-c145-4447-9f6b-935791a8e32b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:18.737680 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c44c4880-c145-4447-9f6b-935791a8e32b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:18.745548 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c44c4880-c145-4447-9f6b-935791a8e32b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083930 Jul 27 23:14:18.746100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1381/2952] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:18 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:18.783078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cac688e7-c567-4a7f-9f3b-7ae14a0d66bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:18.783686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cac688e7-c567-4a7f-9f3b-7ae14a0d66bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:18.790944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cac688e7-c567-4a7f-9f3b-7ae14a0d66bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:18.791491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cac688e7-c567-4a7f-9f3b-7ae14a0d66bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:18.792242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cac688e7-c567-4a7f-9f3b-7ae14a0d66bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:18.792696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cac688e7-c567-4a7f-9f3b-7ae14a0d66bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:18.916839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cac688e7-c567-4a7f-9f3b-7ae14a0d66bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:18.925174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cac688e7-c567-4a7f-9f3b-7ae14a0d66bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.146489 Jul 27 23:14:18.925729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1572/2953] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:18 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:18.969287 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9f4efe43-5d5f-4132-be0f-3b2e2a7db27a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:18.969903 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9f4efe43-5d5f-4132-be0f-3b2e2a7db27a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:18.975875 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9f4efe43-5d5f-4132-be0f-3b2e2a7db27a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:18.976315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9f4efe43-5d5f-4132-be0f-3b2e2a7db27a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:18.977689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9f4efe43-5d5f-4132-be0f-3b2e2a7db27a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:18.978458 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9f4efe43-5d5f-4132-be0f-3b2e2a7db27a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:19.107350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9f4efe43-5d5f-4132-be0f-3b2e2a7db27a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:19.115419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9f4efe43-5d5f-4132-be0f-3b2e2a7db27a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.150563 Jul 27 23:14:19.115970 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1382/2954] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:18 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:19.766586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b1c92b45-56b6-40fa-b65d-2d3c4250f379 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:19.767190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b1c92b45-56b6-40fa-b65d-2d3c4250f379 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:19.773166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1c92b45-56b6-40fa-b65d-2d3c4250f379 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:19.773610 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1c92b45-56b6-40fa-b65d-2d3c4250f379 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:19.774352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1c92b45-56b6-40fa-b65d-2d3c4250f379 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:19.774778 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1c92b45-56b6-40fa-b65d-2d3c4250f379 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:19.837247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b1c92b45-56b6-40fa-b65d-2d3c4250f379 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:19.845194 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b1c92b45-56b6-40fa-b65d-2d3c4250f379 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083022 Jul 27 23:14:19.845746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1573/2955] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:19 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:19.945849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0b4aa047-9c90-472e-933b-866583abe2c5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:19.946450 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0b4aa047-9c90-472e-933b-866583abe2c5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:19.948830 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:19.954033 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b4aa047-9c90-472e-933b-866583abe2c5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:19.954478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b4aa047-9c90-472e-933b-866583abe2c5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:19.955225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b4aa047-9c90-472e-933b-866583abe2c5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:19.955651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0b4aa047-9c90-472e-933b-866583abe2c5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:20.083592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0b4aa047-9c90-472e-933b-866583abe2c5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:20.091576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0b4aa047-9c90-472e-933b-866583abe2c5 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.149580 Jul 27 23:14:20.092130 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1383/2956] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:19 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:20.135704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dc794070-48ad-4c92-acba-6c5b23599db1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:20.136308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dc794070-48ad-4c92-acba-6c5b23599db1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:20.142320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc794070-48ad-4c92-acba-6c5b23599db1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:20.142765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc794070-48ad-4c92-acba-6c5b23599db1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:20.143516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc794070-48ad-4c92-acba-6c5b23599db1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:20.143946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc794070-48ad-4c92-acba-6c5b23599db1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:20.269006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dc794070-48ad-4c92-acba-6c5b23599db1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:20.276823 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dc794070-48ad-4c92-acba-6c5b23599db1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.144888 Jul 27 23:14:20.277369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1574/2957] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:20 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:20.866701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-08d456fd-ab41-4ff6-9813-e714fa71fc8a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:20.867379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-08d456fd-ab41-4ff6-9813-e714fa71fc8a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:20.873909 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08d456fd-ab41-4ff6-9813-e714fa71fc8a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:20.874349 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08d456fd-ab41-4ff6-9813-e714fa71fc8a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:20.875736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08d456fd-ab41-4ff6-9813-e714fa71fc8a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:20.876164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08d456fd-ab41-4ff6-9813-e714fa71fc8a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:20.939364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-08d456fd-ab41-4ff6-9813-e714fa71fc8a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:20.947239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-08d456fd-ab41-4ff6-9813-e714fa71fc8a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.084414 Jul 27 23:14:20.947787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1384/2958] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:20 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:21.113442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-282c0c81-c942-4b5f-a932-3163bab91b6b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:21.114048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-282c0c81-c942-4b5f-a932-3163bab91b6b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:21.120533 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-282c0c81-c942-4b5f-a932-3163bab91b6b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:21.120947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-282c0c81-c942-4b5f-a932-3163bab91b6b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:21.121688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-282c0c81-c942-4b5f-a932-3163bab91b6b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:21.122116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-282c0c81-c942-4b5f-a932-3163bab91b6b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:21.250573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-282c0c81-c942-4b5f-a932-3163bab91b6b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:21.258387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-282c0c81-c942-4b5f-a932-3163bab91b6b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.149645 Jul 27 23:14:21.258957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1575/2959] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:21 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:21.298163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e40b92f0-932a-4985-84bb-32a78b45d5af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:21.298777 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e40b92f0-932a-4985-84bb-32a78b45d5af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:21.305190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e40b92f0-932a-4985-84bb-32a78b45d5af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:21.305636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e40b92f0-932a-4985-84bb-32a78b45d5af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:21.306417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e40b92f0-932a-4985-84bb-32a78b45d5af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:21.306848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e40b92f0-932a-4985-84bb-32a78b45d5af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:21.403325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:14:21.403325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:14:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:14:21.433108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e40b92f0-932a-4985-84bb-32a78b45d5af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:21.440862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e40b92f0-932a-4985-84bb-32a78b45d5af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147160 Jul 27 23:14:21.441417 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1385/2960] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:21 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:21.884159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:14:21.884332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:14:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:14:21.967607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3582fad1-387c-4ab3-a69c-989613fc5c8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:21.968214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3582fad1-387c-4ab3-a69c-989613fc5c8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:21.974761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3582fad1-387c-4ab3-a69c-989613fc5c8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:21.975205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3582fad1-387c-4ab3-a69c-989613fc5c8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:21.975961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3582fad1-387c-4ab3-a69c-989613fc5c8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:21.976395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3582fad1-387c-4ab3-a69c-989613fc5c8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:22.040981 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3582fad1-387c-4ab3-a69c-989613fc5c8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:22.049671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3582fad1-387c-4ab3-a69c-989613fc5c8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.085910 Jul 27 23:14:22.050254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1576/2961] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:21 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:22.279827 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-81081559-4f47-4d7b-9092-7346d97ec768 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:22.280436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-81081559-4f47-4d7b-9092-7346d97ec768 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:22.287343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-81081559-4f47-4d7b-9092-7346d97ec768 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:22.287784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-81081559-4f47-4d7b-9092-7346d97ec768 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:22.288533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-81081559-4f47-4d7b-9092-7346d97ec768 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:22.288985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-81081559-4f47-4d7b-9092-7346d97ec768 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:22.414566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-81081559-4f47-4d7b-9092-7346d97ec768 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:22.422394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-81081559-4f47-4d7b-9092-7346d97ec768 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.146458 Jul 27 23:14:22.422942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1386/2962] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:22 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:22.461850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-97655d50-006c-40a6-a638-1095264bf9f9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:22.462451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-97655d50-006c-40a6-a638-1095264bf9f9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:22.469432 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97655d50-006c-40a6-a638-1095264bf9f9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:22.469873 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97655d50-006c-40a6-a638-1095264bf9f9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:22.470615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97655d50-006c-40a6-a638-1095264bf9f9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:22.471043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97655d50-006c-40a6-a638-1095264bf9f9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:22.597505 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-97655d50-006c-40a6-a638-1095264bf9f9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:22.605524 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-97655d50-006c-40a6-a638-1095264bf9f9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147383 Jul 27 23:14:22.606115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1577/2963] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:22 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:23.070261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-08256f17-7640-428d-af12-b3f6569dbb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:23.070876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-08256f17-7640-428d-af12-b3f6569dbb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:23.076893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08256f17-7640-428d-af12-b3f6569dbb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:23.077341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08256f17-7640-428d-af12-b3f6569dbb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:23.078106 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08256f17-7640-428d-af12-b3f6569dbb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:23.078543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-08256f17-7640-428d-af12-b3f6569dbb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:23.143273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-08256f17-7640-428d-af12-b3f6569dbb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:23.151225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-08256f17-7640-428d-af12-b3f6569dbb58 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.084803 Jul 27 23:14:23.151786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1387/2964] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:23 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:23.443737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b55aeb93-9b5d-4019-84df-d81d52dc069d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:23.444346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b55aeb93-9b5d-4019-84df-d81d52dc069d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:23.450502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b55aeb93-9b5d-4019-84df-d81d52dc069d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:23.450951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b55aeb93-9b5d-4019-84df-d81d52dc069d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:23.451697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b55aeb93-9b5d-4019-84df-d81d52dc069d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:23.452131 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b55aeb93-9b5d-4019-84df-d81d52dc069d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:23.627436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4f58e497-b564-4e14-880e-77e90fac5a4d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:23.628174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4f58e497-b564-4e14-880e-77e90fac5a4d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:23.634663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4f58e497-b564-4e14-880e-77e90fac5a4d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:23.634990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b55aeb93-9b5d-4019-84df-d81d52dc069d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:23.635422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4f58e497-b564-4e14-880e-77e90fac5a4d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:23.635895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4f58e497-b564-4e14-880e-77e90fac5a4d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:23.636332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4f58e497-b564-4e14-880e-77e90fac5a4d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:23.644697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b55aeb93-9b5d-4019-84df-d81d52dc069d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.204441 Jul 27 23:14:23.645731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1578/2965] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:23 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:23.763964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4f58e497-b564-4e14-880e-77e90fac5a4d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:23.771772 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4f58e497-b564-4e14-880e-77e90fac5a4d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148890 Jul 27 23:14:23.772327 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1388/2966] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:23 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:24.171315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0d7ccba6-bce2-4eb3-8fee-58adeb1fd305 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:24.171821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0d7ccba6-bce2-4eb3-8fee-58adeb1fd305 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:24.177899 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d7ccba6-bce2-4eb3-8fee-58adeb1fd305 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:24.178335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d7ccba6-bce2-4eb3-8fee-58adeb1fd305 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:24.179078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d7ccba6-bce2-4eb3-8fee-58adeb1fd305 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:24.179508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d7ccba6-bce2-4eb3-8fee-58adeb1fd305 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:24.244105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0d7ccba6-bce2-4eb3-8fee-58adeb1fd305 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:24.252487 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0d7ccba6-bce2-4eb3-8fee-58adeb1fd305 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.085172 Jul 27 23:14:24.253066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1579/2967] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:24 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:24.666969 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c729c774-4019-4fef-9b5a-38042cb3be79 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:24.667605 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c729c774-4019-4fef-9b5a-38042cb3be79 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:24.674659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c729c774-4019-4fef-9b5a-38042cb3be79 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:24.675097 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c729c774-4019-4fef-9b5a-38042cb3be79 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:24.675836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c729c774-4019-4fef-9b5a-38042cb3be79 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:24.676260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c729c774-4019-4fef-9b5a-38042cb3be79 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:24.792830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-87994417-b1ae-4d8a-90e4-de722346ac73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:24.793415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-87994417-b1ae-4d8a-90e4-de722346ac73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:24.800511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87994417-b1ae-4d8a-90e4-de722346ac73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:24.800984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87994417-b1ae-4d8a-90e4-de722346ac73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:24.801737 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87994417-b1ae-4d8a-90e4-de722346ac73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:24.802166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87994417-b1ae-4d8a-90e4-de722346ac73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:24.803764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c729c774-4019-4fef-9b5a-38042cb3be79 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:24.811752 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c729c774-4019-4fef-9b5a-38042cb3be79 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.148750 Jul 27 23:14:24.812301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1389/2968] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:24 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:24.817284 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:24.928834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-87994417-b1ae-4d8a-90e4-de722346ac73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:24.936587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-87994417-b1ae-4d8a-90e4-de722346ac73 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147616 Jul 27 23:14:24.937136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1580/2969] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:24 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:25.272607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-aba6b650-dc68-4106-8c18-91067e7fce9b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:25.273209 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-aba6b650-dc68-4106-8c18-91067e7fce9b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:25.279210 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aba6b650-dc68-4106-8c18-91067e7fce9b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:25.279655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aba6b650-dc68-4106-8c18-91067e7fce9b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:25.280406 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aba6b650-dc68-4106-8c18-91067e7fce9b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:25.280879 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-aba6b650-dc68-4106-8c18-91067e7fce9b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:25.344246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-aba6b650-dc68-4106-8c18-91067e7fce9b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:25.352327 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-aba6b650-dc68-4106-8c18-91067e7fce9b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083554 Jul 27 23:14:25.352896 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1390/2970] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:25 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:25.833298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4504cf23-dd68-4f95-920a-a51bf3dd977c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:25.833833 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4504cf23-dd68-4f95-920a-a51bf3dd977c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:25.840214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4504cf23-dd68-4f95-920a-a51bf3dd977c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:25.840687 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4504cf23-dd68-4f95-920a-a51bf3dd977c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:25.841430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4504cf23-dd68-4f95-920a-a51bf3dd977c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:25.841886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4504cf23-dd68-4f95-920a-a51bf3dd977c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:25.957554 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c8cd1e38-f1e4-40d1-bb5c-a7f3bc7391bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:25.958505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c8cd1e38-f1e4-40d1-bb5c-a7f3bc7391bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:25.965310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8cd1e38-f1e4-40d1-bb5c-a7f3bc7391bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:25.965750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8cd1e38-f1e4-40d1-bb5c-a7f3bc7391bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:25.966669 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8cd1e38-f1e4-40d1-bb5c-a7f3bc7391bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:25.967215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c8cd1e38-f1e4-40d1-bb5c-a7f3bc7391bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:25.974252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4504cf23-dd68-4f95-920a-a51bf3dd977c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:25.982569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4504cf23-dd68-4f95-920a-a51bf3dd977c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.153135 Jul 27 23:14:25.983436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1581/2971] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:25 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:26.102921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c8cd1e38-f1e4-40d1-bb5c-a7f3bc7391bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:26.112984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c8cd1e38-f1e4-40d1-bb5c-a7f3bc7391bd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.159272 Jul 27 23:14:26.113744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1391/2972] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:26.373326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-62ba7140-5ec4-4486-bb29-28587976acfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:26.373832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-62ba7140-5ec4-4486-bb29-28587976acfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:26.379773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62ba7140-5ec4-4486-bb29-28587976acfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:26.380227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62ba7140-5ec4-4486-bb29-28587976acfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:26.381015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62ba7140-5ec4-4486-bb29-28587976acfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:26.381452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-62ba7140-5ec4-4486-bb29-28587976acfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:26.444747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-62ba7140-5ec4-4486-bb29-28587976acfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:26.452923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-62ba7140-5ec4-4486-bb29-28587976acfc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083439 Jul 27 23:14:26.453484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1582/2973] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:26 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:27.004415 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5a3ff3ec-c627-4db8-ba0b-eca02d97fa22 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:27.005170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5a3ff3ec-c627-4db8-ba0b-eca02d97fa22 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:27.011571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a3ff3ec-c627-4db8-ba0b-eca02d97fa22 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:27.011992 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a3ff3ec-c627-4db8-ba0b-eca02d97fa22 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:27.012771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a3ff3ec-c627-4db8-ba0b-eca02d97fa22 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:27.013200 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a3ff3ec-c627-4db8-ba0b-eca02d97fa22 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:27.134684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-98550ce1-d077-4d4a-a58e-f39b0be880a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:27.135293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-98550ce1-d077-4d4a-a58e-f39b0be880a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:27.142125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98550ce1-d077-4d4a-a58e-f39b0be880a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:27.142448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5a3ff3ec-c627-4db8-ba0b-eca02d97fa22 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:27.142595 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98550ce1-d077-4d4a-a58e-f39b0be880a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:27.143319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98550ce1-d077-4d4a-a58e-f39b0be880a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:27.143751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-98550ce1-d077-4d4a-a58e-f39b0be880a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:27.150580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5a3ff3ec-c627-4db8-ba0b-eca02d97fa22 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.149971 Jul 27 23:14:27.151435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1392/2974] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:26 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:27.272861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-98550ce1-d077-4d4a-a58e-f39b0be880a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:27.280681 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-98550ce1-d077-4d4a-a58e-f39b0be880a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.149841 Jul 27 23:14:27.281753 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1583/2975] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:27 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:27.474168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-19956b06-682d-4cd4-a520-f38f5f7338ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:27.474769 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-19956b06-682d-4cd4-a520-f38f5f7338ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:27.480750 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19956b06-682d-4cd4-a520-f38f5f7338ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:27.481190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19956b06-682d-4cd4-a520-f38f5f7338ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:27.481942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19956b06-682d-4cd4-a520-f38f5f7338ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:27.482370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19956b06-682d-4cd4-a520-f38f5f7338ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:27.544843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-19956b06-682d-4cd4-a520-f38f5f7338ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:27.552721 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-19956b06-682d-4cd4-a520-f38f5f7338ee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082382 Jul 27 23:14:27.553264 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1393/2976] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:27 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:28.173091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6cc4f68e-86c1-4d6b-85bd-5b1e0491ea7d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:28.173645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6cc4f68e-86c1-4d6b-85bd-5b1e0491ea7d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:28.179979 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6cc4f68e-86c1-4d6b-85bd-5b1e0491ea7d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:28.180425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6cc4f68e-86c1-4d6b-85bd-5b1e0491ea7d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:28.181246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6cc4f68e-86c1-4d6b-85bd-5b1e0491ea7d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:28.181677 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6cc4f68e-86c1-4d6b-85bd-5b1e0491ea7d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:28.308142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6cc4f68e-86c1-4d6b-85bd-5b1e0491ea7d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:28.313616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-496f405c-6b3a-4662-9e21-957b5d798323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:28.314526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-496f405c-6b3a-4662-9e21-957b5d798323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:28.320792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6cc4f68e-86c1-4d6b-85bd-5b1e0491ea7d tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.152122 Jul 27 23:14:28.321369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1584/2977] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:28 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:28.321502 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-496f405c-6b3a-4662-9e21-957b5d798323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:28.321972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-496f405c-6b3a-4662-9e21-957b5d798323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:28.322735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-496f405c-6b3a-4662-9e21-957b5d798323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:28.323165 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-496f405c-6b3a-4662-9e21-957b5d798323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:28.450400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-496f405c-6b3a-4662-9e21-957b5d798323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:28.458243 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-496f405c-6b3a-4662-9e21-957b5d798323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.149257 Jul 27 23:14:28.458789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1394/2978] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:28 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:28.572757 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a77f2dd5-66a8-4ab3-9f06-3360c6f275d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:28.573369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a77f2dd5-66a8-4ab3-9f06-3360c6f275d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:28.580257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a77f2dd5-66a8-4ab3-9f06-3360c6f275d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:28.581083 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a77f2dd5-66a8-4ab3-9f06-3360c6f275d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:28.581904 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a77f2dd5-66a8-4ab3-9f06-3360c6f275d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:28.582544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a77f2dd5-66a8-4ab3-9f06-3360c6f275d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:28.656617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a77f2dd5-66a8-4ab3-9f06-3360c6f275d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:28.664411 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a77f2dd5-66a8-4ab3-9f06-3360c6f275d8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.095503 Jul 27 23:14:28.665009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1585/2979] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:28 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:29.342011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-83676576-d51e-41f1-9695-40cd6b213d95 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:29.342622 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-83676576-d51e-41f1-9695-40cd6b213d95 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:29.349597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83676576-d51e-41f1-9695-40cd6b213d95 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:29.350044 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83676576-d51e-41f1-9695-40cd6b213d95 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:29.350809 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83676576-d51e-41f1-9695-40cd6b213d95 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:29.351243 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83676576-d51e-41f1-9695-40cd6b213d95 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:29.366266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:29.479826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a71161bb-5c4e-4d56-ba8d-44e31b17a05f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:29.480565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a71161bb-5c4e-4d56-ba8d-44e31b17a05f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:29.487735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a71161bb-5c4e-4d56-ba8d-44e31b17a05f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:29.488178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a71161bb-5c4e-4d56-ba8d-44e31b17a05f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:29.488963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a71161bb-5c4e-4d56-ba8d-44e31b17a05f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:29.489388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a71161bb-5c4e-4d56-ba8d-44e31b17a05f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:29.497905 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-83676576-d51e-41f1-9695-40cd6b213d95 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:29.506367 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-83676576-d51e-41f1-9695-40cd6b213d95 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.168161 Jul 27 23:14:29.506925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1395/2980] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:29 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:29.622008 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a71161bb-5c4e-4d56-ba8d-44e31b17a05f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:29.630578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a71161bb-5c4e-4d56-ba8d-44e31b17a05f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.155202 Jul 27 23:14:29.631178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1586/2981] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:29 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:29.686050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a2fd5a41-2b34-4dfa-a65f-cfdc911cfbb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:29.686610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a2fd5a41-2b34-4dfa-a65f-cfdc911cfbb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:29.693251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a2fd5a41-2b34-4dfa-a65f-cfdc911cfbb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:29.693701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a2fd5a41-2b34-4dfa-a65f-cfdc911cfbb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:29.694461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a2fd5a41-2b34-4dfa-a65f-cfdc911cfbb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:29.694897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a2fd5a41-2b34-4dfa-a65f-cfdc911cfbb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:29.759280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a2fd5a41-2b34-4dfa-a65f-cfdc911cfbb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:29.767118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a2fd5a41-2b34-4dfa-a65f-cfdc911cfbb3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.084956 Jul 27 23:14:29.767681 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1396/2982] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:29 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:30.528655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5e2789bd-c68f-4d1e-9da6-86e19dc052e7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:30.529204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5e2789bd-c68f-4d1e-9da6-86e19dc052e7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:30.535606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5e2789bd-c68f-4d1e-9da6-86e19dc052e7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:30.536056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5e2789bd-c68f-4d1e-9da6-86e19dc052e7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:30.536832 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5e2789bd-c68f-4d1e-9da6-86e19dc052e7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:30.537265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5e2789bd-c68f-4d1e-9da6-86e19dc052e7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:30.652697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d778898a-8f1a-4924-8327-39bc3ae12b29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:30.653312 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d778898a-8f1a-4924-8327-39bc3ae12b29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:30.659671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d778898a-8f1a-4924-8327-39bc3ae12b29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:30.660117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d778898a-8f1a-4924-8327-39bc3ae12b29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:30.660898 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d778898a-8f1a-4924-8327-39bc3ae12b29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:30.661331 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d778898a-8f1a-4924-8327-39bc3ae12b29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:30.665208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5e2789bd-c68f-4d1e-9da6-86e19dc052e7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:30.673705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5e2789bd-c68f-4d1e-9da6-86e19dc052e7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.149053 Jul 27 23:14:30.674260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1587/2983] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:30 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:30.786009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d778898a-8f1a-4924-8327-39bc3ae12b29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:30.787785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b3493a5e-265b-49f3-97ad-c92201bf868b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:30.788389 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b3493a5e-265b-49f3-97ad-c92201bf868b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:30.793969 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d778898a-8f1a-4924-8327-39bc3ae12b29 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.145118 Jul 27 23:14:30.794275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3493a5e-265b-49f3-97ad-c92201bf868b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:30.794539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1397/2984] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:30 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:30.794748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3493a5e-265b-49f3-97ad-c92201bf868b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:30.795534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3493a5e-265b-49f3-97ad-c92201bf868b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:30.795971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b3493a5e-265b-49f3-97ad-c92201bf868b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:30.857932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b3493a5e-265b-49f3-97ad-c92201bf868b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:30.866573 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b3493a5e-265b-49f3-97ad-c92201bf868b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082707 Jul 27 23:14:30.867118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1588/2985] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:30 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:31.695093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-630a8783-58a7-4d01-ace5-d61bc233387e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:31.695706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-630a8783-58a7-4d01-ace5-d61bc233387e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:31.702214 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-630a8783-58a7-4d01-ace5-d61bc233387e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:31.702642 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-630a8783-58a7-4d01-ace5-d61bc233387e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:31.703997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-630a8783-58a7-4d01-ace5-d61bc233387e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:31.704427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-630a8783-58a7-4d01-ace5-d61bc233387e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:31.816394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0cdfc090-1ae3-4ca9-a266-68dbdc650c30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:31.817134 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0cdfc090-1ae3-4ca9-a266-68dbdc650c30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:31.823576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0cdfc090-1ae3-4ca9-a266-68dbdc650c30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:31.824018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0cdfc090-1ae3-4ca9-a266-68dbdc650c30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:31.824788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0cdfc090-1ae3-4ca9-a266-68dbdc650c30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:31.825217 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0cdfc090-1ae3-4ca9-a266-68dbdc650c30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:31.830821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-630a8783-58a7-4d01-ace5-d61bc233387e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:31.838701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-630a8783-58a7-4d01-ace5-d61bc233387e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.147489 Jul 27 23:14:31.839266 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1398/2986] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:31 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:31.887198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-873d16d7-93f7-4443-8721-f16de1c6bf2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:31.887798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-873d16d7-93f7-4443-8721-f16de1c6bf2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:31.893719 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-873d16d7-93f7-4443-8721-f16de1c6bf2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:31.894161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-873d16d7-93f7-4443-8721-f16de1c6bf2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:31.894912 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-873d16d7-93f7-4443-8721-f16de1c6bf2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:31.895348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-873d16d7-93f7-4443-8721-f16de1c6bf2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:31.965847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-873d16d7-93f7-4443-8721-f16de1c6bf2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:31.973831 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-873d16d7-93f7-4443-8721-f16de1c6bf2a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.090538 Jul 27 23:14:31.974402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1399/2987] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:31 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:31.980508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0cdfc090-1ae3-4ca9-a266-68dbdc650c30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:31.989442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0cdfc090-1ae3-4ca9-a266-68dbdc650c30 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.177396 Jul 27 23:14:31.989984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1589/2988] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:31 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:32.859856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-05912c6d-ef4d-4577-9b4a-f92ee6ed0a3c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:32.860775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-05912c6d-ef4d-4577-9b4a-f92ee6ed0a3c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:32.867172 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05912c6d-ef4d-4577-9b4a-f92ee6ed0a3c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:32.867624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05912c6d-ef4d-4577-9b4a-f92ee6ed0a3c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:32.868383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05912c6d-ef4d-4577-9b4a-f92ee6ed0a3c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:32.868850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-05912c6d-ef4d-4577-9b4a-f92ee6ed0a3c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:32.995180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-77f12a47-3ab1-449f-9f55-f95a448160d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:32.996641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-77f12a47-3ab1-449f-9f55-f95a448160d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:32.998422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-05912c6d-ef4d-4577-9b4a-f92ee6ed0a3c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:33.003693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-77f12a47-3ab1-449f-9f55-f95a448160d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:33.004133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-77f12a47-3ab1-449f-9f55-f95a448160d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:33.006780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-77f12a47-3ab1-449f-9f55-f95a448160d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:33.006918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-77f12a47-3ab1-449f-9f55-f95a448160d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:33.007361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-05912c6d-ef4d-4577-9b4a-f92ee6ed0a3c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.151348 Jul 27 23:14:33.008159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1400/2989] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:32 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:33.022226 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4e39b16f-a911-43f1-a5ad-1045d82d8fe2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:33.023543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4e39b16f-a911-43f1-a5ad-1045d82d8fe2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:33.029692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4e39b16f-a911-43f1-a5ad-1045d82d8fe2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:33.030227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4e39b16f-a911-43f1-a5ad-1045d82d8fe2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:33.031025 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4e39b16f-a911-43f1-a5ad-1045d82d8fe2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:33.031461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4e39b16f-a911-43f1-a5ad-1045d82d8fe2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:33.070747 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-77f12a47-3ab1-449f-9f55-f95a448160d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:33.079854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-77f12a47-3ab1-449f-9f55-f95a448160d1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.088449 Jul 27 23:14:33.092574 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1590/2990] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:32 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:33.169437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4e39b16f-a911-43f1-a5ad-1045d82d8fe2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:33.178089 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4e39b16f-a911-43f1-a5ad-1045d82d8fe2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.159999 Jul 27 23:14:33.178652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1401/2991] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:33 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:34.029226 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2b93a7a6-0e97-454b-99f6-969f0ac31be0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:34.029868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2b93a7a6-0e97-454b-99f6-969f0ac31be0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:34.036462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b93a7a6-0e97-454b-99f6-969f0ac31be0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:34.036943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b93a7a6-0e97-454b-99f6-969f0ac31be0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:34.037696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b93a7a6-0e97-454b-99f6-969f0ac31be0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:34.038128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b93a7a6-0e97-454b-99f6-969f0ac31be0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:34.101137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f5f7d02f-b232-4265-a3bc-fb8ad5aa6d94 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:34.101753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f5f7d02f-b232-4265-a3bc-fb8ad5aa6d94 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:34.108149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5f7d02f-b232-4265-a3bc-fb8ad5aa6d94 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:34.108631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5f7d02f-b232-4265-a3bc-fb8ad5aa6d94 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:34.109907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5f7d02f-b232-4265-a3bc-fb8ad5aa6d94 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:34.110602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5f7d02f-b232-4265-a3bc-fb8ad5aa6d94 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:34.183039 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f5f7d02f-b232-4265-a3bc-fb8ad5aa6d94 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:34.190438 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2b93a7a6-0e97-454b-99f6-969f0ac31be0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:34.191736 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f5f7d02f-b232-4265-a3bc-fb8ad5aa6d94 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.094404 Jul 27 23:14:34.192504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1402/2992] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:34 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:34.200211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a49a4149-4090-4e7d-9b00-d7f39cd9fe3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:34.200379 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2b93a7a6-0e97-454b-99f6-969f0ac31be0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.174936 Jul 27 23:14:34.200850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a49a4149-4090-4e7d-9b00-d7f39cd9fe3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:34.201228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1591/2993] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:34 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:34.207580 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a49a4149-4090-4e7d-9b00-d7f39cd9fe3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:34.208036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a49a4149-4090-4e7d-9b00-d7f39cd9fe3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:34.208832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a49a4149-4090-4e7d-9b00-d7f39cd9fe3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:34.209270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a49a4149-4090-4e7d-9b00-d7f39cd9fe3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:34.340333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a49a4149-4090-4e7d-9b00-d7f39cd9fe3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:34.348116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a49a4149-4090-4e7d-9b00-d7f39cd9fe3e tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.151512 Jul 27 23:14:34.348694 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1403/2994] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:34 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:35.215101 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-18a7b58a-d801-4c1d-b030-21cc201eb51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:35.215741 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-18a7b58a-d801-4c1d-b030-21cc201eb51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:35.221485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-60b20623-1e00-4406-9aff-92cd107f2986 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:35.222092 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-60b20623-1e00-4406-9aff-92cd107f2986 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:35.222859 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18a7b58a-d801-4c1d-b030-21cc201eb51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:35.223354 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18a7b58a-d801-4c1d-b030-21cc201eb51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:35.224113 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18a7b58a-d801-4c1d-b030-21cc201eb51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:35.224545 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18a7b58a-d801-4c1d-b030-21cc201eb51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:35.228185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60b20623-1e00-4406-9aff-92cd107f2986 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:35.228657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60b20623-1e00-4406-9aff-92cd107f2986 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:35.229423 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60b20623-1e00-4406-9aff-92cd107f2986 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:35.229856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60b20623-1e00-4406-9aff-92cd107f2986 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:35.310352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-18a7b58a-d801-4c1d-b030-21cc201eb51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:35.318742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-18a7b58a-d801-4c1d-b030-21cc201eb51c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.107475 Jul 27 23:14:35.319361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1592/2995] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:35 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:35.369416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4554f03a-d2b6-4df4-bb79-2fbf15805b5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:35.370048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4554f03a-d2b6-4df4-bb79-2fbf15805b5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:35.376546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4554f03a-d2b6-4df4-bb79-2fbf15805b5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:35.377016 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4554f03a-d2b6-4df4-bb79-2fbf15805b5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:35.377769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4554f03a-d2b6-4df4-bb79-2fbf15805b5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:35.378195 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4554f03a-d2b6-4df4-bb79-2fbf15805b5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:35.378655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-60b20623-1e00-4406-9aff-92cd107f2986 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:35.386563 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-60b20623-1e00-4406-9aff-92cd107f2986 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.169514 Jul 27 23:14:35.387125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1404/2996] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:35 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:35.506578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4554f03a-d2b6-4df4-bb79-2fbf15805b5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:35.514533 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4554f03a-d2b6-4df4-bb79-2fbf15805b5b tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.149089 Jul 27 23:14:35.515096 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1593/2997] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:35 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:36.339159 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9dbc2f89-d989-4472-a761-576f3bc74143 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:36.339772 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9dbc2f89-d989-4472-a761-576f3bc74143 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:36.347090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9dbc2f89-d989-4472-a761-576f3bc74143 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:36.347537 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9dbc2f89-d989-4472-a761-576f3bc74143 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:36.348291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9dbc2f89-d989-4472-a761-576f3bc74143 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:36.348757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9dbc2f89-d989-4472-a761-576f3bc74143 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:36.409179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-102be6f3-9b35-4c9d-bc40-e15f1a410148 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:36.409592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9dbc2f89-d989-4472-a761-576f3bc74143 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:36.410015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-102be6f3-9b35-4c9d-bc40-e15f1a410148 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:36.417123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-102be6f3-9b35-4c9d-bc40-e15f1a410148 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:36.417384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9dbc2f89-d989-4472-a761-576f3bc74143 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082034 Jul 27 23:14:36.417715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-102be6f3-9b35-4c9d-bc40-e15f1a410148 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:36.418597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-102be6f3-9b35-4c9d-bc40-e15f1a410148 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:36.419073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-102be6f3-9b35-4c9d-bc40-e15f1a410148 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:36.423415 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1405/2998] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:36 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:36.535946 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-07de481e-9d99-4d6a-87c0-5df1122e2bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:36.536573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-07de481e-9d99-4d6a-87c0-5df1122e2bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:36.542635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07de481e-9d99-4d6a-87c0-5df1122e2bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:36.543078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07de481e-9d99-4d6a-87c0-5df1122e2bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:36.543840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07de481e-9d99-4d6a-87c0-5df1122e2bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:36.544274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07de481e-9d99-4d6a-87c0-5df1122e2bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:36.548068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-102be6f3-9b35-4c9d-bc40-e15f1a410148 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:36.556924 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-102be6f3-9b35-4c9d-bc40-e15f1a410148 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.152373 Jul 27 23:14:36.557491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1594/2999] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:36 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:36.675711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-07de481e-9d99-4d6a-87c0-5df1122e2bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:36.683530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-07de481e-9d99-4d6a-87c0-5df1122e2bf3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.151565 Jul 27 23:14:36.684086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1406/3000] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:36 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:37.438566 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-739f07f4-c6d4-4f3d-aa04-e4e76bacfa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:37.439119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-739f07f4-c6d4-4f3d-aa04-e4e76bacfa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:37.445549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-739f07f4-c6d4-4f3d-aa04-e4e76bacfa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:37.445987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-739f07f4-c6d4-4f3d-aa04-e4e76bacfa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:37.446729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-739f07f4-c6d4-4f3d-aa04-e4e76bacfa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:37.447158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-739f07f4-c6d4-4f3d-aa04-e4e76bacfa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:37.508208 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-739f07f4-c6d4-4f3d-aa04-e4e76bacfa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:37.516508 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-739f07f4-c6d4-4f3d-aa04-e4e76bacfa25 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082442 Jul 27 23:14:37.517072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1595/3001] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:37 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:37.578655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a994970b-d20e-4cc8-b263-ce0d0c6cc12b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:37.579303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a994970b-d20e-4cc8-b263-ce0d0c6cc12b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:37.586023 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a994970b-d20e-4cc8-b263-ce0d0c6cc12b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:37.586469 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a994970b-d20e-4cc8-b263-ce0d0c6cc12b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:37.587235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a994970b-d20e-4cc8-b263-ce0d0c6cc12b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:37.587669 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a994970b-d20e-4cc8-b263-ce0d0c6cc12b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:37.705075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6a4fd565-cf06-4f3b-98b9-f91423ff5495 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:37.705609 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6a4fd565-cf06-4f3b-98b9-f91423ff5495 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:37.711493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6a4fd565-cf06-4f3b-98b9-f91423ff5495 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:37.711936 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6a4fd565-cf06-4f3b-98b9-f91423ff5495 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:37.712742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6a4fd565-cf06-4f3b-98b9-f91423ff5495 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:37.713179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6a4fd565-cf06-4f3b-98b9-f91423ff5495 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:37.725016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a994970b-d20e-4cc8-b263-ce0d0c6cc12b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:37.732868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a994970b-d20e-4cc8-b263-ce0d0c6cc12b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.158663 Jul 27 23:14:37.733430 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1407/3002] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:37 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:37.837161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6a4fd565-cf06-4f3b-98b9-f91423ff5495 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:37.844996 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6a4fd565-cf06-4f3b-98b9-f91423ff5495 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.144427 Jul 27 23:14:37.845610 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1596/3003] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:37 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:38.537278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4b9d3d97-9edd-40fd-b3ff-31d52f995139 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:38.537888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4b9d3d97-9edd-40fd-b3ff-31d52f995139 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:38.543874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b9d3d97-9edd-40fd-b3ff-31d52f995139 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:38.544307 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b9d3d97-9edd-40fd-b3ff-31d52f995139 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:38.545075 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b9d3d97-9edd-40fd-b3ff-31d52f995139 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:38.545503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4b9d3d97-9edd-40fd-b3ff-31d52f995139 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:38.605933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4b9d3d97-9edd-40fd-b3ff-31d52f995139 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:38.614787 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4b9d3d97-9edd-40fd-b3ff-31d52f995139 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.081415 Jul 27 23:14:38.615336 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1408/3004] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:38 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:38.754541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0ea1c061-9fb0-492e-9445-fddb3f4d55da tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:38.755174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0ea1c061-9fb0-492e-9445-fddb3f4d55da tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:38.761763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0ea1c061-9fb0-492e-9445-fddb3f4d55da tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:38.762197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0ea1c061-9fb0-492e-9445-fddb3f4d55da tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:38.762944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0ea1c061-9fb0-492e-9445-fddb3f4d55da tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:38.763370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0ea1c061-9fb0-492e-9445-fddb3f4d55da tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:38.765881 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:38.866673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-22672e40-cb97-45e8-a16d-f20cc22d1f20 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:38.867281 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-22672e40-cb97-45e8-a16d-f20cc22d1f20 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:38.873614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-22672e40-cb97-45e8-a16d-f20cc22d1f20 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:38.874063 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-22672e40-cb97-45e8-a16d-f20cc22d1f20 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:38.874819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-22672e40-cb97-45e8-a16d-f20cc22d1f20 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:38.875249 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-22672e40-cb97-45e8-a16d-f20cc22d1f20 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:38.894795 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0ea1c061-9fb0-492e-9445-fddb3f4d55da tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:38.902878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0ea1c061-9fb0-492e-9445-fddb3f4d55da tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.152773 Jul 27 23:14:38.903440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1597/3005] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:38 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:39.003361 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-22672e40-cb97-45e8-a16d-f20cc22d1f20 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:39.011280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-22672e40-cb97-45e8-a16d-f20cc22d1f20 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148421 Jul 27 23:14:39.011842 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1409/3006] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:38 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:39.635136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b2462288-676b-4e7e-8983-2fd89bf429b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:39.635756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b2462288-676b-4e7e-8983-2fd89bf429b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:39.642476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2462288-676b-4e7e-8983-2fd89bf429b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:39.642925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2462288-676b-4e7e-8983-2fd89bf429b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:39.643676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2462288-676b-4e7e-8983-2fd89bf429b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:39.644110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b2462288-676b-4e7e-8983-2fd89bf429b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:39.704736 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b2462288-676b-4e7e-8983-2fd89bf429b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:39.712528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b2462288-676b-4e7e-8983-2fd89bf429b3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.081284 Jul 27 23:14:39.713107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1598/3007] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:39 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:39.923664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8066b64a-f0db-4a38-bdc9-2a61819c3ddf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:39.924196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8066b64a-f0db-4a38-bdc9-2a61819c3ddf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:39.930697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8066b64a-f0db-4a38-bdc9-2a61819c3ddf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:39.931135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8066b64a-f0db-4a38-bdc9-2a61819c3ddf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:39.931880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8066b64a-f0db-4a38-bdc9-2a61819c3ddf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:39.932305 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8066b64a-f0db-4a38-bdc9-2a61819c3ddf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:40.031262 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8f5c29f6-ffaf-4071-ac59-fe962b680859 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:40.033295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8f5c29f6-ffaf-4071-ac59-fe962b680859 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:40.039372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f5c29f6-ffaf-4071-ac59-fe962b680859 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:40.039949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f5c29f6-ffaf-4071-ac59-fe962b680859 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:40.040828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f5c29f6-ffaf-4071-ac59-fe962b680859 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:40.041344 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f5c29f6-ffaf-4071-ac59-fe962b680859 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:40.063779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8066b64a-f0db-4a38-bdc9-2a61819c3ddf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:40.071638 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8066b64a-f0db-4a38-bdc9-2a61819c3ddf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.152387 Jul 27 23:14:40.072194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1410/3008] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:39 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:40.168377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8f5c29f6-ffaf-4071-ac59-fe962b680859 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:40.176340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8f5c29f6-ffaf-4071-ac59-fe962b680859 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148916 Jul 27 23:14:40.176878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1599/3009] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:40 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:40.733788 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-342a0455-62ab-4d97-9014-0696b4679e7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:40.734397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-342a0455-62ab-4d97-9014-0696b4679e7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:40.740712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-342a0455-62ab-4d97-9014-0696b4679e7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:40.741161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-342a0455-62ab-4d97-9014-0696b4679e7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:40.741910 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-342a0455-62ab-4d97-9014-0696b4679e7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:40.742341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-342a0455-62ab-4d97-9014-0696b4679e7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:40.803908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-342a0455-62ab-4d97-9014-0696b4679e7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:40.811685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-342a0455-62ab-4d97-9014-0696b4679e7f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.081741 Jul 27 23:14:40.812236 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1411/3010] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:40 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:41.093556 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8c4c6b4d-ca7d-41b9-8397-ec0f6f36221c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:41.094168 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8c4c6b4d-ca7d-41b9-8397-ec0f6f36221c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:41.100646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c4c6b4d-ca7d-41b9-8397-ec0f6f36221c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:41.101098 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c4c6b4d-ca7d-41b9-8397-ec0f6f36221c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:41.101856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c4c6b4d-ca7d-41b9-8397-ec0f6f36221c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:41.102292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c4c6b4d-ca7d-41b9-8397-ec0f6f36221c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:41.197524 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7f26f7e8-25f8-40a3-9669-d5c5bde2846c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:41.198203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7f26f7e8-25f8-40a3-9669-d5c5bde2846c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:41.205031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f26f7e8-25f8-40a3-9669-d5c5bde2846c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:41.205473 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f26f7e8-25f8-40a3-9669-d5c5bde2846c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:41.206218 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f26f7e8-25f8-40a3-9669-d5c5bde2846c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:41.206644 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f26f7e8-25f8-40a3-9669-d5c5bde2846c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:41.210501 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:41.232789 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8c4c6b4d-ca7d-41b9-8397-ec0f6f36221c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:41.241601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8c4c6b4d-ca7d-41b9-8397-ec0f6f36221c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.151896 Jul 27 23:14:41.242164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1600/3011] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:41 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:41.331426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7f26f7e8-25f8-40a3-9669-d5c5bde2846c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:41.339291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7f26f7e8-25f8-40a3-9669-d5c5bde2846c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.145716 Jul 27 23:14:41.339848 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1412/3012] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:41 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:41.832425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1cd33276-d091-45a4-a4f0-25d76e6fc30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:41.833094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1cd33276-d091-45a4-a4f0-25d76e6fc30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:41.839095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1cd33276-d091-45a4-a4f0-25d76e6fc30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:41.839542 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1cd33276-d091-45a4-a4f0-25d76e6fc30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:41.840295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1cd33276-d091-45a4-a4f0-25d76e6fc30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:41.840765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1cd33276-d091-45a4-a4f0-25d76e6fc30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:41.903727 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1cd33276-d091-45a4-a4f0-25d76e6fc30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:41.912189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1cd33276-d091-45a4-a4f0-25d76e6fc30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.084132 Jul 27 23:14:41.912791 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1601/3013] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:41 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:42.262879 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0973e3f2-6f64-4889-ab30-a18c6e930433 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:42.263489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0973e3f2-6f64-4889-ab30-a18c6e930433 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:42.270584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0973e3f2-6f64-4889-ab30-a18c6e930433 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:42.271036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0973e3f2-6f64-4889-ab30-a18c6e930433 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:42.271786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0973e3f2-6f64-4889-ab30-a18c6e930433 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:42.272218 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0973e3f2-6f64-4889-ab30-a18c6e930433 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:42.360254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9f0d52ba-8c3f-491e-8174-248e961d66a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:42.361135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9f0d52ba-8c3f-491e-8174-248e961d66a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:42.367057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f0d52ba-8c3f-491e-8174-248e961d66a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:42.367500 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f0d52ba-8c3f-491e-8174-248e961d66a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:42.368249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f0d52ba-8c3f-491e-8174-248e961d66a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:42.368711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f0d52ba-8c3f-491e-8174-248e961d66a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:42.399379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0973e3f2-6f64-4889-ab30-a18c6e930433 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:42.407482 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0973e3f2-6f64-4889-ab30-a18c6e930433 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.148341 Jul 27 23:14:42.407978 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1413/3014] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:42 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:42.492794 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9f0d52ba-8c3f-491e-8174-248e961d66a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:42.501275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9f0d52ba-8c3f-491e-8174-248e961d66a7 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.144876 Jul 27 23:14:42.501840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1602/3015] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:42 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:42.933037 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-42703452-5faa-4139-bfdf-2024eec0853f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:42.933654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-42703452-5faa-4139-bfdf-2024eec0853f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:42.939640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42703452-5faa-4139-bfdf-2024eec0853f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:42.940090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42703452-5faa-4139-bfdf-2024eec0853f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:42.940875 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42703452-5faa-4139-bfdf-2024eec0853f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:42.941316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-42703452-5faa-4139-bfdf-2024eec0853f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:43.003652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-42703452-5faa-4139-bfdf-2024eec0853f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:43.012080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-42703452-5faa-4139-bfdf-2024eec0853f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082907 Jul 27 23:14:43.012654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1414/3016] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:42 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:43.428249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7accfa30-4027-404d-84fd-cba515577b2f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:43.428880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7accfa30-4027-404d-84fd-cba515577b2f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:43.435247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7accfa30-4027-404d-84fd-cba515577b2f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:43.435687 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7accfa30-4027-404d-84fd-cba515577b2f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:43.436424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7accfa30-4027-404d-84fd-cba515577b2f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:43.436883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7accfa30-4027-404d-84fd-cba515577b2f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:43.522726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2dc92c87-1409-4de7-a72a-125c0c1bdb65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:43.523425 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2dc92c87-1409-4de7-a72a-125c0c1bdb65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:43.529912 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2dc92c87-1409-4de7-a72a-125c0c1bdb65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:43.530364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2dc92c87-1409-4de7-a72a-125c0c1bdb65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:43.531123 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2dc92c87-1409-4de7-a72a-125c0c1bdb65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:43.531592 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2dc92c87-1409-4de7-a72a-125c0c1bdb65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:43.563931 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7accfa30-4027-404d-84fd-cba515577b2f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:43.571819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7accfa30-4027-404d-84fd-cba515577b2f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.147357 Jul 27 23:14:43.572387 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1603/3017] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:43 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:43.658488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2dc92c87-1409-4de7-a72a-125c0c1bdb65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:43.666321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2dc92c87-1409-4de7-a72a-125c0c1bdb65 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147458 Jul 27 23:14:43.666861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1415/3018] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:43 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:44.038266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7d56ae42-d148-4cbf-9243-9f15408722e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:44.038867 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7d56ae42-d148-4cbf-9243-9f15408722e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:44.044890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7d56ae42-d148-4cbf-9243-9f15408722e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:44.045336 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7d56ae42-d148-4cbf-9243-9f15408722e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:44.046079 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7d56ae42-d148-4cbf-9243-9f15408722e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:44.046509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7d56ae42-d148-4cbf-9243-9f15408722e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:44.109971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7d56ae42-d148-4cbf-9243-9f15408722e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:44.118010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7d56ae42-d148-4cbf-9243-9f15408722e3 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083586 Jul 27 23:14:44.118567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1604/3019] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:44 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:44.594080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9f6178c7-4f40-4d9d-936b-f65e6e618edb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:44.595347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9f6178c7-4f40-4d9d-936b-f65e6e618edb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:44.601897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9f6178c7-4f40-4d9d-936b-f65e6e618edb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:44.602341 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9f6178c7-4f40-4d9d-936b-f65e6e618edb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:44.603090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9f6178c7-4f40-4d9d-936b-f65e6e618edb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:44.603518 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9f6178c7-4f40-4d9d-936b-f65e6e618edb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:44.687450 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6ebc3407-a9f3-49b2-94d4-fc61f550bb89 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:44.688224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6ebc3407-a9f3-49b2-94d4-fc61f550bb89 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:44.694911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6ebc3407-a9f3-49b2-94d4-fc61f550bb89 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:44.695352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6ebc3407-a9f3-49b2-94d4-fc61f550bb89 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:44.696114 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6ebc3407-a9f3-49b2-94d4-fc61f550bb89 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:44.696546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6ebc3407-a9f3-49b2-94d4-fc61f550bb89 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:44.731684 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9f6178c7-4f40-4d9d-936b-f65e6e618edb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:44.739890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9f6178c7-4f40-4d9d-936b-f65e6e618edb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.149717 Jul 27 23:14:44.740463 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1416/3020] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:44 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:44.823710 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6ebc3407-a9f3-49b2-94d4-fc61f550bb89 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:44.832001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6ebc3407-a9f3-49b2-94d4-fc61f550bb89 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148443 Jul 27 23:14:44.832571 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1605/3021] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:44 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:45.139203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5a46ecf5-94b9-4156-82b9-ad565159aad7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:45.139942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5a46ecf5-94b9-4156-82b9-ad565159aad7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:45.146606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a46ecf5-94b9-4156-82b9-ad565159aad7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:45.147048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a46ecf5-94b9-4156-82b9-ad565159aad7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:45.147798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a46ecf5-94b9-4156-82b9-ad565159aad7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:45.148237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a46ecf5-94b9-4156-82b9-ad565159aad7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:45.212398 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5a46ecf5-94b9-4156-82b9-ad565159aad7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:45.220298 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5a46ecf5-94b9-4156-82b9-ad565159aad7 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.085008 Jul 27 23:14:45.220883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1417/3022] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:45 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:45.761479 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-29b59e29-993c-42a7-b86b-37248faaa304 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:45.762021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-29b59e29-993c-42a7-b86b-37248faaa304 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:45.768498 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29b59e29-993c-42a7-b86b-37248faaa304 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:45.768975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29b59e29-993c-42a7-b86b-37248faaa304 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:45.769734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29b59e29-993c-42a7-b86b-37248faaa304 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:45.770172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-29b59e29-993c-42a7-b86b-37248faaa304 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:45.853494 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e4e056a5-8b0d-47ba-8abd-88bfe6702005 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:45.854219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e4e056a5-8b0d-47ba-8abd-88bfe6702005 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:45.861717 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4e056a5-8b0d-47ba-8abd-88bfe6702005 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:45.862240 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4e056a5-8b0d-47ba-8abd-88bfe6702005 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:45.863075 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4e056a5-8b0d-47ba-8abd-88bfe6702005 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:45.863574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e4e056a5-8b0d-47ba-8abd-88bfe6702005 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:45.896576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-29b59e29-993c-42a7-b86b-37248faaa304 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:45.904534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-29b59e29-993c-42a7-b86b-37248faaa304 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.146982 Jul 27 23:14:45.905123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1606/3023] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:45 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:45.990650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e4e056a5-8b0d-47ba-8abd-88bfe6702005 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:45.998461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e4e056a5-8b0d-47ba-8abd-88bfe6702005 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148843 Jul 27 23:14:45.999029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1418/3024] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:45 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:46.240813 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-da6a5a14-15aa-4fde-a966-9683f7b57f0a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:46.241426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-da6a5a14-15aa-4fde-a966-9683f7b57f0a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:46.247428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da6a5a14-15aa-4fde-a966-9683f7b57f0a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:46.247874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da6a5a14-15aa-4fde-a966-9683f7b57f0a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:46.248650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da6a5a14-15aa-4fde-a966-9683f7b57f0a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:46.249084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da6a5a14-15aa-4fde-a966-9683f7b57f0a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:46.313019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-da6a5a14-15aa-4fde-a966-9683f7b57f0a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:46.320810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-da6a5a14-15aa-4fde-a966-9683f7b57f0a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083795 Jul 27 23:14:46.321371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1607/3025] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:46 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:46.926639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-58d842d4-79ea-4658-8330-ded71e9f56bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:46.927237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-58d842d4-79ea-4658-8330-ded71e9f56bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:46.933652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58d842d4-79ea-4658-8330-ded71e9f56bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:46.934087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58d842d4-79ea-4658-8330-ded71e9f56bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:46.934831 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58d842d4-79ea-4658-8330-ded71e9f56bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:46.935259 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-58d842d4-79ea-4658-8330-ded71e9f56bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:47.019335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e40c871c-b7bb-439f-97d3-c7f730b68224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:47.019943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e40c871c-b7bb-439f-97d3-c7f730b68224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:47.026596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e40c871c-b7bb-439f-97d3-c7f730b68224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:47.027043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e40c871c-b7bb-439f-97d3-c7f730b68224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:47.027815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e40c871c-b7bb-439f-97d3-c7f730b68224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:47.028242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e40c871c-b7bb-439f-97d3-c7f730b68224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:47.075451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-58d842d4-79ea-4658-8330-ded71e9f56bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:47.083269 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-58d842d4-79ea-4658-8330-ded71e9f56bc tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.161066 Jul 27 23:14:47.083893 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1419/3026] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:46 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:47.156448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e40c871c-b7bb-439f-97d3-c7f730b68224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:47.164370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e40c871c-b7bb-439f-97d3-c7f730b68224 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148967 Jul 27 23:14:47.164946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1608/3027] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:47 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:47.341205 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c38b18d3-8e29-4616-b5ce-cc89b8af3677 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:47.341811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c38b18d3-8e29-4616-b5ce-cc89b8af3677 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:47.348255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c38b18d3-8e29-4616-b5ce-cc89b8af3677 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:47.348773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c38b18d3-8e29-4616-b5ce-cc89b8af3677 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:47.349527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c38b18d3-8e29-4616-b5ce-cc89b8af3677 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:47.349960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c38b18d3-8e29-4616-b5ce-cc89b8af3677 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:47.412778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c38b18d3-8e29-4616-b5ce-cc89b8af3677 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:47.420611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c38b18d3-8e29-4616-b5ce-cc89b8af3677 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083180 Jul 27 23:14:47.421167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1420/3028] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:47 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:48.104576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a1c79b28-80f4-4ecf-b336-12dc0c751b64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:48.105199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a1c79b28-80f4-4ecf-b336-12dc0c751b64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:48.107493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=75 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:48.113973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1c79b28-80f4-4ecf-b336-12dc0c751b64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:48.114409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1c79b28-80f4-4ecf-b336-12dc0c751b64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:48.115146 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1c79b28-80f4-4ecf-b336-12dc0c751b64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:48.115569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a1c79b28-80f4-4ecf-b336-12dc0c751b64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:48.185419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b528d7ec-1f23-4517-a4df-ef41cf3be0df tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:48.186181 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b528d7ec-1f23-4517-a4df-ef41cf3be0df tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:48.192484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b528d7ec-1f23-4517-a4df-ef41cf3be0df tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:48.192965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b528d7ec-1f23-4517-a4df-ef41cf3be0df tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:48.193729 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b528d7ec-1f23-4517-a4df-ef41cf3be0df tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:48.194162 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b528d7ec-1f23-4517-a4df-ef41cf3be0df tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:48.270977 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a1c79b28-80f4-4ecf-b336-12dc0c751b64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:48.278797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a1c79b28-80f4-4ecf-b336-12dc0c751b64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.178137 Jul 27 23:14:48.279353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1609/3029] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:48 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:48.332869 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b528d7ec-1f23-4517-a4df-ef41cf3be0df tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:48.340665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b528d7ec-1f23-4517-a4df-ef41cf3be0df tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.159181 Jul 27 23:14:48.341225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1421/3030] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:48 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:48.441774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-81f435fe-7dad-424b-a8b3-aaa7cc66c637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:48.442312 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-81f435fe-7dad-424b-a8b3-aaa7cc66c637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:48.448193 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-81f435fe-7dad-424b-a8b3-aaa7cc66c637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:48.448669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-81f435fe-7dad-424b-a8b3-aaa7cc66c637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:48.449419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-81f435fe-7dad-424b-a8b3-aaa7cc66c637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:48.449849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-81f435fe-7dad-424b-a8b3-aaa7cc66c637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:48.512723 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-81f435fe-7dad-424b-a8b3-aaa7cc66c637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:48.521074 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-81f435fe-7dad-424b-a8b3-aaa7cc66c637 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083194 Jul 27 23:14:48.521628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1610/3031] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:48 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:49.301242 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7f0946b7-0b6a-4fb8-8a61-7875c12b761e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:49.301855 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7f0946b7-0b6a-4fb8-8a61-7875c12b761e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:49.307879 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f0946b7-0b6a-4fb8-8a61-7875c12b761e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:49.308329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f0946b7-0b6a-4fb8-8a61-7875c12b761e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:49.309120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f0946b7-0b6a-4fb8-8a61-7875c12b761e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:49.309561 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7f0946b7-0b6a-4fb8-8a61-7875c12b761e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:49.362967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a0995153-0938-4ff5-afc6-e26331b94f99 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:49.363579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a0995153-0938-4ff5-afc6-e26331b94f99 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:49.369937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0995153-0938-4ff5-afc6-e26331b94f99 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:49.370377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0995153-0938-4ff5-afc6-e26331b94f99 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:49.371124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0995153-0938-4ff5-afc6-e26331b94f99 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:49.371549 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0995153-0938-4ff5-afc6-e26331b94f99 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:49.477951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7f0946b7-0b6a-4fb8-8a61-7875c12b761e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:49.486867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7f0946b7-0b6a-4fb8-8a61-7875c12b761e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.190062 Jul 27 23:14:49.487436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1422/3032] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:49 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:49.521721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a0995153-0938-4ff5-afc6-e26331b94f99 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:49.529594 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a0995153-0938-4ff5-afc6-e26331b94f99 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.171196 Jul 27 23:14:49.530158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1611/3033] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:49 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:49.542169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ff86f500-2dc2-4bee-b737-c8373f26cca8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:49.542882 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ff86f500-2dc2-4bee-b737-c8373f26cca8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:49.549370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff86f500-2dc2-4bee-b737-c8373f26cca8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:49.549842 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff86f500-2dc2-4bee-b737-c8373f26cca8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:49.550589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff86f500-2dc2-4bee-b737-c8373f26cca8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:49.551017 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ff86f500-2dc2-4bee-b737-c8373f26cca8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:49.613333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ff86f500-2dc2-4bee-b737-c8373f26cca8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:49.621052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ff86f500-2dc2-4bee-b737-c8373f26cca8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082626 Jul 27 23:14:49.621631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1423/3034] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:49 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:50.507650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f978408d-5ec6-47ee-baa9-d38048f38d6e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:50.508178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f978408d-5ec6-47ee-baa9-d38048f38d6e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:50.515139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f978408d-5ec6-47ee-baa9-d38048f38d6e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:50.515591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f978408d-5ec6-47ee-baa9-d38048f38d6e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:50.516973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f978408d-5ec6-47ee-baa9-d38048f38d6e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:50.517410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f978408d-5ec6-47ee-baa9-d38048f38d6e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:50.551303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6bad449b-c4fb-4f8a-ae08-9a52f0bece1c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:50.552040 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6bad449b-c4fb-4f8a-ae08-9a52f0bece1c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:50.554557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=82 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:50.560072 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6bad449b-c4fb-4f8a-ae08-9a52f0bece1c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:50.560643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6bad449b-c4fb-4f8a-ae08-9a52f0bece1c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:50.561505 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6bad449b-c4fb-4f8a-ae08-9a52f0bece1c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:50.562018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6bad449b-c4fb-4f8a-ae08-9a52f0bece1c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:50.694703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f978408d-5ec6-47ee-baa9-d38048f38d6e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:50.702511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f978408d-5ec6-47ee-baa9-d38048f38d6e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.198784 Jul 27 23:14:50.703268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1612/3035] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:50 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:50.708718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-83f9cc96-fd99-4a23-86b5-e60bba663dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:50.709790 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-83f9cc96-fd99-4a23-86b5-e60bba663dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:50.716734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-83f9cc96-fd99-4a23-86b5-e60bba663dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:50.717183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-83f9cc96-fd99-4a23-86b5-e60bba663dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:50.718178 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-83f9cc96-fd99-4a23-86b5-e60bba663dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:50.718781 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-83f9cc96-fd99-4a23-86b5-e60bba663dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:50.723537 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6bad449b-c4fb-4f8a-ae08-9a52f0bece1c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:50.731351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6bad449b-c4fb-4f8a-ae08-9a52f0bece1c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.184402 Jul 27 23:14:50.731914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1424/3036] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:50.779200 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-83f9cc96-fd99-4a23-86b5-e60bba663dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:50.781342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:50.788343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-83f9cc96-fd99-4a23-86b5-e60bba663dee tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.084353 Jul 27 23:14:50.788927 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1613/3037] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:50 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:51.724435 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b77b2dbf-6bc5-4a7b-8b9d-8192c34009a4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:51.725090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b77b2dbf-6bc5-4a7b-8b9d-8192c34009a4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:51.731557 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b77b2dbf-6bc5-4a7b-8b9d-8192c34009a4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:51.732003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b77b2dbf-6bc5-4a7b-8b9d-8192c34009a4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:51.732797 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b77b2dbf-6bc5-4a7b-8b9d-8192c34009a4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:51.733235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b77b2dbf-6bc5-4a7b-8b9d-8192c34009a4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:51.753117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c8ac9405-81f3-43dc-bc18-1923c924cfc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:51.753726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c8ac9405-81f3-43dc-bc18-1923c924cfc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:51.760132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8ac9405-81f3-43dc-bc18-1923c924cfc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:51.760601 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8ac9405-81f3-43dc-bc18-1923c924cfc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:51.761380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8ac9405-81f3-43dc-bc18-1923c924cfc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:51.761806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c8ac9405-81f3-43dc-bc18-1923c924cfc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:51.924936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b77b2dbf-6bc5-4a7b-8b9d-8192c34009a4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:51.932800 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b77b2dbf-6bc5-4a7b-8b9d-8192c34009a4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.212159 Jul 27 23:14:51.933362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1425/3038] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:51 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:51.935440 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c8ac9405-81f3-43dc-bc18-1923c924cfc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:51.937922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f1674396-fd59-4f34-b23a-9975b0993706 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:51.938622 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f1674396-fd59-4f34-b23a-9975b0993706 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:51.943671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c8ac9405-81f3-43dc-bc18-1923c924cfc0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.194391 Jul 27 23:14:51.944396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1614/3039] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:51 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:51.944544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1674396-fd59-4f34-b23a-9975b0993706 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:51.944996 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1674396-fd59-4f34-b23a-9975b0993706 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:51.945742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1674396-fd59-4f34-b23a-9975b0993706 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:51.946187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f1674396-fd59-4f34-b23a-9975b0993706 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:52.006272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f1674396-fd59-4f34-b23a-9975b0993706 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:52.014016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f1674396-fd59-4f34-b23a-9975b0993706 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.079734 Jul 27 23:14:52.014566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1426/3040] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:51 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:52.954267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-41870aaf-ddfa-42ba-8f97-4f12a7861d64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:52.954879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-41870aaf-ddfa-42ba-8f97-4f12a7861d64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:52.961393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-41870aaf-ddfa-42ba-8f97-4f12a7861d64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:52.961843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-41870aaf-ddfa-42ba-8f97-4f12a7861d64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:52.962635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-41870aaf-ddfa-42ba-8f97-4f12a7861d64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:52.963070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-41870aaf-ddfa-42ba-8f97-4f12a7861d64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:52.964610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-477671d8-53db-45e7-8ec0-cbe8068e4680 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:52.965220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-477671d8-53db-45e7-8ec0-cbe8068e4680 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:52.972219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-477671d8-53db-45e7-8ec0-cbe8068e4680 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:52.972690 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-477671d8-53db-45e7-8ec0-cbe8068e4680 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:52.973445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-477671d8-53db-45e7-8ec0-cbe8068e4680 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:52.973877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-477671d8-53db-45e7-8ec0-cbe8068e4680 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:53.155520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-41870aaf-ddfa-42ba-8f97-4f12a7861d64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:53.162952 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-477671d8-53db-45e7-8ec0-cbe8068e4680 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:53.163997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-41870aaf-ddfa-42ba-8f97-4f12a7861d64 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.213943 Jul 27 23:14:53.164570 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1615/3041] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:52 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:53.168995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e2ee5095-ce8f-481d-8e59-33ceeaaaa545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:53.169547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e2ee5095-ce8f-481d-8e59-33ceeaaaa545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:53.174955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-477671d8-53db-45e7-8ec0-cbe8068e4680 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.214258 Jul 27 23:14:53.175675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1427/3042] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:52 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:53.176301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2ee5095-ce8f-481d-8e59-33ceeaaaa545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:53.176810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2ee5095-ce8f-481d-8e59-33ceeaaaa545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:53.177617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2ee5095-ce8f-481d-8e59-33ceeaaaa545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:53.178035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e2ee5095-ce8f-481d-8e59-33ceeaaaa545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:53.238766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e2ee5095-ce8f-481d-8e59-33ceeaaaa545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:53.246596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e2ee5095-ce8f-481d-8e59-33ceeaaaa545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.081103 Jul 27 23:14:53.247153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1616/3043] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:53 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:54.186428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-63c29659-36b6-4bc9-8f9c-7ba7dfcfabb0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:54.186428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-63c29659-36b6-4bc9-8f9c-7ba7dfcfabb0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:54.193107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63c29659-36b6-4bc9-8f9c-7ba7dfcfabb0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:54.193555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63c29659-36b6-4bc9-8f9c-7ba7dfcfabb0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:54.194315 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63c29659-36b6-4bc9-8f9c-7ba7dfcfabb0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:54.194748 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-63c29659-36b6-4bc9-8f9c-7ba7dfcfabb0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:54.196058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bfe8431c-c823-4940-bac8-93e7acefa5cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:54.196717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bfe8431c-c823-4940-bac8-93e7acefa5cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:54.203060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bfe8431c-c823-4940-bac8-93e7acefa5cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:54.203501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bfe8431c-c823-4940-bac8-93e7acefa5cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:54.204250 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bfe8431c-c823-4940-bac8-93e7acefa5cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:54.204714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bfe8431c-c823-4940-bac8-93e7acefa5cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:54.386152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bfe8431c-c823-4940-bac8-93e7acefa5cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:54.389275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-63c29659-36b6-4bc9-8f9c-7ba7dfcfabb0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:54.391984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:14:54.394927 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bfe8431c-c823-4940-bac8-93e7acefa5cd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.202470 Jul 27 23:14:54.395583 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1617/3044] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:54 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:54.400027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1f51c141-288a-4753-9fb7-c6515095d30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:54.400753 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1f51c141-288a-4753-9fb7-c6515095d30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:54.406692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f51c141-288a-4753-9fb7-c6515095d30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:54.407370 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-63c29659-36b6-4bc9-8f9c-7ba7dfcfabb0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.224800 Jul 27 23:14:54.407676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f51c141-288a-4753-9fb7-c6515095d30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:54.408231 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1428/3045] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:54 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:54.408451 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f51c141-288a-4753-9fb7-c6515095d30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:54.408898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1f51c141-288a-4753-9fb7-c6515095d30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:54.467828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1f51c141-288a-4753-9fb7-c6515095d30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:54.476169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1f51c141-288a-4753-9fb7-c6515095d30c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.079601 Jul 27 23:14:54.476759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1618/3046] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:54 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:55.416771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5a8f231e-8344-4f59-93ce-2833246ef386 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:55.417332 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5a8f231e-8344-4f59-93ce-2833246ef386 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:55.424310 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a8f231e-8344-4f59-93ce-2833246ef386 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:55.424778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a8f231e-8344-4f59-93ce-2833246ef386 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:55.425537 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a8f231e-8344-4f59-93ce-2833246ef386 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:55.425962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a8f231e-8344-4f59-93ce-2833246ef386 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:55.429070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-003b2d06-8492-434e-93f3-776f3748bde7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:55.429673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-003b2d06-8492-434e-93f3-776f3748bde7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:55.436012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-003b2d06-8492-434e-93f3-776f3748bde7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:55.436453 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-003b2d06-8492-434e-93f3-776f3748bde7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:55.437233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-003b2d06-8492-434e-93f3-776f3748bde7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:55.437678 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-003b2d06-8492-434e-93f3-776f3748bde7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:55.619643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5a8f231e-8344-4f59-93ce-2833246ef386 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:55.623506 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-003b2d06-8492-434e-93f3-776f3748bde7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:55.627618 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5a8f231e-8344-4f59-93ce-2833246ef386 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.214764 Jul 27 23:14:55.628184 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1429/3047] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:55 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:55.631301 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-003b2d06-8492-434e-93f3-776f3748bde7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.205949 Jul 27 23:14:55.632029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1619/3048] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:55 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:55.632767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-34c36427-9eb3-4e12-a3ba-2d9896a94418 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:55.633369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-34c36427-9eb3-4e12-a3ba-2d9896a94418 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:55.639110 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-34c36427-9eb3-4e12-a3ba-2d9896a94418 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:55.639546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-34c36427-9eb3-4e12-a3ba-2d9896a94418 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:55.640289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-34c36427-9eb3-4e12-a3ba-2d9896a94418 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:55.640743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-34c36427-9eb3-4e12-a3ba-2d9896a94418 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:55.700794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-34c36427-9eb3-4e12-a3ba-2d9896a94418 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:55.708460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-34c36427-9eb3-4e12-a3ba-2d9896a94418 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.079328 Jul 27 23:14:55.709040 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1430/3049] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:55 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:56.649225 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-35d567c3-95a3-4179-ad98-675908f992f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:56.649846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-35d567c3-95a3-4179-ad98-675908f992f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:56.653371 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6b0cc2c8-1b8d-4d36-8315-429bef6a778a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:56.653980 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6b0cc2c8-1b8d-4d36-8315-429bef6a778a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:56.656405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d567c3-95a3-4179-ad98-675908f992f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:56.657472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d567c3-95a3-4179-ad98-675908f992f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:56.658229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d567c3-95a3-4179-ad98-675908f992f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:56.658662 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35d567c3-95a3-4179-ad98-675908f992f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:56.660839 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b0cc2c8-1b8d-4d36-8315-429bef6a778a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:56.661278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b0cc2c8-1b8d-4d36-8315-429bef6a778a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:56.662042 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b0cc2c8-1b8d-4d36-8315-429bef6a778a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:56.662457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6b0cc2c8-1b8d-4d36-8315-429bef6a778a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:56.852648 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-35d567c3-95a3-4179-ad98-675908f992f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:56.856663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6b0cc2c8-1b8d-4d36-8315-429bef6a778a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:56.860764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-35d567c3-95a3-4179-ad98-675908f992f3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.215204 Jul 27 23:14:56.861322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1620/3050] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:56 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:56.864994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6b0cc2c8-1b8d-4d36-8315-429bef6a778a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215395 Jul 27 23:14:56.865689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1431/3051] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:56 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:56.865959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3756909b-244f-4d32-a4c9-7e981f8b6337 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:56.866625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3756909b-244f-4d32-a4c9-7e981f8b6337 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:56.872327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3756909b-244f-4d32-a4c9-7e981f8b6337 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:56.872806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3756909b-244f-4d32-a4c9-7e981f8b6337 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:56.873550 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3756909b-244f-4d32-a4c9-7e981f8b6337 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:56.873977 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3756909b-244f-4d32-a4c9-7e981f8b6337 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:56.936404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3756909b-244f-4d32-a4c9-7e981f8b6337 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:56.944800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3756909b-244f-4d32-a4c9-7e981f8b6337 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082525 Jul 27 23:14:56.945353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1621/3052] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:56 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:57.881793 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a37a45ab-71ad-4f85-8a91-f314cbe9cb60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:57.882407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a37a45ab-71ad-4f85-8a91-f314cbe9cb60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:57.885860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4df5ac2a-f280-4779-8e6b-c76ffdecf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:57.886502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4df5ac2a-f280-4779-8e6b-c76ffdecf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:57.888916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a37a45ab-71ad-4f85-8a91-f314cbe9cb60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:57.889357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a37a45ab-71ad-4f85-8a91-f314cbe9cb60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:57.890102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a37a45ab-71ad-4f85-8a91-f314cbe9cb60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:57.890530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a37a45ab-71ad-4f85-8a91-f314cbe9cb60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:57.892993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4df5ac2a-f280-4779-8e6b-c76ffdecf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:57.893441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4df5ac2a-f280-4779-8e6b-c76ffdecf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:57.894199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4df5ac2a-f280-4779-8e6b-c76ffdecf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:57.894632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4df5ac2a-f280-4779-8e6b-c76ffdecf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:58.082477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a37a45ab-71ad-4f85-8a91-f314cbe9cb60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:58.087435 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4df5ac2a-f280-4779-8e6b-c76ffdecf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:58.091776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a37a45ab-71ad-4f85-8a91-f314cbe9cb60 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.213790 Jul 27 23:14:58.092350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1432/3053] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:57 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:58.097182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4df5ac2a-f280-4779-8e6b-c76ffdecf453 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215094 Jul 27 23:14:58.097756 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bf381911-f39b-4975-8c9c-8d30c104ced2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:58.098445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bf381911-f39b-4975-8c9c-8d30c104ced2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:58.104519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf381911-f39b-4975-8c9c-8d30c104ced2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:58.105279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf381911-f39b-4975-8c9c-8d30c104ced2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:58.106278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf381911-f39b-4975-8c9c-8d30c104ced2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:58.106920 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bf381911-f39b-4975-8c9c-8d30c104ced2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:58.109096 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1622/3054] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:57 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:58.172267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bf381911-f39b-4975-8c9c-8d30c104ced2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:58.180191 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bf381911-f39b-4975-8c9c-8d30c104ced2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.086644 Jul 27 23:14:58.180774 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1433/3055] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:58 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:59.113787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4042082f-03a7-445c-9474-c8f525ecd0a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:59.114405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4042082f-03a7-445c-9474-c8f525ecd0a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:59.119074 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-62cad73f-c961-4fff-b52c-170e4235fbdb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:59.119678 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-62cad73f-c961-4fff-b52c-170e4235fbdb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:59.120898 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4042082f-03a7-445c-9474-c8f525ecd0a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:59.121342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4042082f-03a7-445c-9474-c8f525ecd0a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:59.122090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4042082f-03a7-445c-9474-c8f525ecd0a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:59.122518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4042082f-03a7-445c-9474-c8f525ecd0a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:59.126433 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-62cad73f-c961-4fff-b52c-170e4235fbdb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:59.126879 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-62cad73f-c961-4fff-b52c-170e4235fbdb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:59.127630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-62cad73f-c961-4fff-b52c-170e4235fbdb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:59.128062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-62cad73f-c961-4fff-b52c-170e4235fbdb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:59.522185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4042082f-03a7-445c-9474-c8f525ecd0a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:59.526268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-62cad73f-c961-4fff-b52c-170e4235fbdb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:59.530138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4042082f-03a7-445c-9474-c8f525ecd0a8 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.420946 Jul 27 23:14:59.537833 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1623/3056] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:59 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:14:59.537999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-62cad73f-c961-4fff-b52c-170e4235fbdb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.419332 Jul 27 23:14:59.537999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1434/3057] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:59 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:14:59.538190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0620a52d-4668-4229-b165-01ff93707a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:14:59.538190 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0620a52d-4668-4229-b165-01ff93707a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:14:59.542137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0620a52d-4668-4229-b165-01ff93707a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:59.542577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0620a52d-4668-4229-b165-01ff93707a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:59.543326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0620a52d-4668-4229-b165-01ff93707a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:14:59.543756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0620a52d-4668-4229-b165-01ff93707a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:14:59.603925 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0620a52d-4668-4229-b165-01ff93707a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:14:59.611921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0620a52d-4668-4229-b165-01ff93707a5b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.080310 Jul 27 23:14:59.612474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1624/3058] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:14:59 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:00.551642 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b3d35677-211f-4030-8d9d-e768a24a659d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:00.552241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b3d35677-211f-4030-8d9d-e768a24a659d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:00.556028 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4cd06432-a005-4913-9298-761b02277fd2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:00.556664 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4cd06432-a005-4913-9298-761b02277fd2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:00.559067 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3d35677-211f-4030-8d9d-e768a24a659d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:00.559512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3d35677-211f-4030-8d9d-e768a24a659d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:00.560284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3d35677-211f-4030-8d9d-e768a24a659d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:00.560814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b3d35677-211f-4030-8d9d-e768a24a659d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:00.563075 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4cd06432-a005-4913-9298-761b02277fd2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:00.563515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4cd06432-a005-4913-9298-761b02277fd2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:00.564259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4cd06432-a005-4913-9298-761b02277fd2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:00.564715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4cd06432-a005-4913-9298-761b02277fd2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:00.748625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b3d35677-211f-4030-8d9d-e768a24a659d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:00.756994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b3d35677-211f-4030-8d9d-e768a24a659d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.209206 Jul 27 23:15:00.757561 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1435/3059] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:00 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:00.758147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4cd06432-a005-4913-9298-761b02277fd2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:00.762145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8ffe1e4f-f205-402e-ba83-0a1c42b6d466 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:00.762722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8ffe1e4f-f205-402e-ba83-0a1c42b6d466 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:00.768293 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4cd06432-a005-4913-9298-761b02277fd2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215754 Jul 27 23:15:00.769107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1625/3060] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:00 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:00.769246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8ffe1e4f-f205-402e-ba83-0a1c42b6d466 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:00.769667 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8ffe1e4f-f205-402e-ba83-0a1c42b6d466 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:00.770427 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8ffe1e4f-f205-402e-ba83-0a1c42b6d466 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:00.770854 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8ffe1e4f-f205-402e-ba83-0a1c42b6d466 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:00.830510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8ffe1e4f-f205-402e-ba83-0a1c42b6d466 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:00.838573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8ffe1e4f-f205-402e-ba83-0a1c42b6d466 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.080064 Jul 27 23:15:00.839132 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1436/3061] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:00 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:01.779181 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-05b3e36e-6bd2-418d-a096-7956323784a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:01.779782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-05b3e36e-6bd2-418d-a096-7956323784a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:01.786503 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05b3e36e-6bd2-418d-a096-7956323784a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:01.786949 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05b3e36e-6bd2-418d-a096-7956323784a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:01.787743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05b3e36e-6bd2-418d-a096-7956323784a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:01.788209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05b3e36e-6bd2-418d-a096-7956323784a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:01.789395 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-00436a49-8b57-4675-85de-88cb3656f6d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:01.790008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-00436a49-8b57-4675-85de-88cb3656f6d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:01.796364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-00436a49-8b57-4675-85de-88cb3656f6d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:01.796844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-00436a49-8b57-4675-85de-88cb3656f6d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:01.798113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-00436a49-8b57-4675-85de-88cb3656f6d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:01.798547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-00436a49-8b57-4675-85de-88cb3656f6d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:01.977449 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-05b3e36e-6bd2-418d-a096-7956323784a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:01.984396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-00436a49-8b57-4675-85de-88cb3656f6d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:01.986100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-05b3e36e-6bd2-418d-a096-7956323784a0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.210515 Jul 27 23:15:01.986666 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1626/3062] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:01 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:01.991116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-97cf04a8-d023-4a46-aac5-2c6312ace65e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:01.991715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-97cf04a8-d023-4a46-aac5-2c6312ace65e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:01.993166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-00436a49-8b57-4675-85de-88cb3656f6d8 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.207566 Jul 27 23:15:01.993849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1437/3063] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:01 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:01.997565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97cf04a8-d023-4a46-aac5-2c6312ace65e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:01.998019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97cf04a8-d023-4a46-aac5-2c6312ace65e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:01.998767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97cf04a8-d023-4a46-aac5-2c6312ace65e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:01.999199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-97cf04a8-d023-4a46-aac5-2c6312ace65e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:02.059213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-97cf04a8-d023-4a46-aac5-2c6312ace65e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:02.067709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-97cf04a8-d023-4a46-aac5-2c6312ace65e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.080114 Jul 27 23:15:02.068265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1627/3064] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:01 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:03.007333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9a9ba5fa-134b-4704-b55d-42c7431e3bd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:03.007939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9a9ba5fa-134b-4704-b55d-42c7431e3bd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:03.014651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a9ba5fa-134b-4704-b55d-42c7431e3bd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:03.014872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-982a726d-fa19-498e-a1ec-7814ad32f7ad tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:03.015317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a9ba5fa-134b-4704-b55d-42c7431e3bd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:03.015452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-982a726d-fa19-498e-a1ec-7814ad32f7ad tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:03.015845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a9ba5fa-134b-4704-b55d-42c7431e3bd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:03.016875 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a9ba5fa-134b-4704-b55d-42c7431e3bd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:03.022328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-982a726d-fa19-498e-a1ec-7814ad32f7ad tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:03.022797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-982a726d-fa19-498e-a1ec-7814ad32f7ad tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:03.023578 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-982a726d-fa19-498e-a1ec-7814ad32f7ad tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:03.024015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-982a726d-fa19-498e-a1ec-7814ad32f7ad tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:03.203059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9a9ba5fa-134b-4704-b55d-42c7431e3bd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:03.210287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-982a726d-fa19-498e-a1ec-7814ad32f7ad tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:03.211588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9a9ba5fa-134b-4704-b55d-42c7431e3bd1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.208116 Jul 27 23:15:03.212414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1438/3065] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:03 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:03.216520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9e88f152-32bc-4579-927d-0d4c33031ad1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:03.217139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9e88f152-32bc-4579-927d-0d4c33031ad1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:03.218530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-982a726d-fa19-498e-a1ec-7814ad32f7ad tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.207547 Jul 27 23:15:03.219137 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1628/3066] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:03 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:03.224625 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e88f152-32bc-4579-927d-0d4c33031ad1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:03.225104 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e88f152-32bc-4579-927d-0d4c33031ad1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:03.225870 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e88f152-32bc-4579-927d-0d4c33031ad1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:03.226326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e88f152-32bc-4579-927d-0d4c33031ad1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:03.286351 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9e88f152-32bc-4579-927d-0d4c33031ad1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:03.294183 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9e88f152-32bc-4579-927d-0d4c33031ad1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.081071 Jul 27 23:15:03.294744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1439/3067] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:03 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:04.232544 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-66647acc-c79b-48fd-85d3-fa3dec2ead81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:04.233162 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-66647acc-c79b-48fd-85d3-fa3dec2ead81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:04.239276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-19487a79-07a9-4b61-b4f9-454e8d23cb96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:04.239877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-19487a79-07a9-4b61-b4f9-454e8d23cb96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:04.239994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66647acc-c79b-48fd-85d3-fa3dec2ead81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:04.240385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66647acc-c79b-48fd-85d3-fa3dec2ead81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:04.241185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66647acc-c79b-48fd-85d3-fa3dec2ead81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:04.241620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-66647acc-c79b-48fd-85d3-fa3dec2ead81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:04.245993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19487a79-07a9-4b61-b4f9-454e8d23cb96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:04.246440 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19487a79-07a9-4b61-b4f9-454e8d23cb96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:04.247194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19487a79-07a9-4b61-b4f9-454e8d23cb96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:04.247630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-19487a79-07a9-4b61-b4f9-454e8d23cb96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:04.436094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-66647acc-c79b-48fd-85d3-fa3dec2ead81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:04.439683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-19487a79-07a9-4b61-b4f9-454e8d23cb96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:04.444732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-66647acc-c79b-48fd-85d3-fa3dec2ead81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.216010 Jul 27 23:15:04.445320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1629/3068] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:04 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:04.448118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-19487a79-07a9-4b61-b4f9-454e8d23cb96 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.212954 Jul 27 23:15:04.448843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1440/3069] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:04 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:04.456622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b9da7361-b9b1-4d60-9ff8-666d570a4273 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:04.457227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b9da7361-b9b1-4d60-9ff8-666d570a4273 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:04.462984 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b9da7361-b9b1-4d60-9ff8-666d570a4273 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:04.463425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b9da7361-b9b1-4d60-9ff8-666d570a4273 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:04.464167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b9da7361-b9b1-4d60-9ff8-666d570a4273 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:04.464615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b9da7361-b9b1-4d60-9ff8-666d570a4273 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:04.478818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:04.528819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b9da7361-b9b1-4d60-9ff8-666d570a4273 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:04.536655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b9da7361-b9b1-4d60-9ff8-666d570a4273 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.090384 Jul 27 23:15:04.537214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1630/3070] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:04 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:05.466387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-028df913-aece-4ac3-9c9c-7e6810bed0e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:05.466942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-028df913-aece-4ac3-9c9c-7e6810bed0e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:05.470298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4088bcf4-0610-462f-a9a3-674da0bdba18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:05.470908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4088bcf4-0610-462f-a9a3-674da0bdba18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:05.474261 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-028df913-aece-4ac3-9c9c-7e6810bed0e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:05.474418 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-028df913-aece-4ac3-9c9c-7e6810bed0e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:05.475171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-028df913-aece-4ac3-9c9c-7e6810bed0e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:05.475609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-028df913-aece-4ac3-9c9c-7e6810bed0e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:05.477448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4088bcf4-0610-462f-a9a3-674da0bdba18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:05.477904 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4088bcf4-0610-462f-a9a3-674da0bdba18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:05.478675 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4088bcf4-0610-462f-a9a3-674da0bdba18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:05.479108 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4088bcf4-0610-462f-a9a3-674da0bdba18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:05.665896 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-028df913-aece-4ac3-9c9c-7e6810bed0e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:05.669061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4088bcf4-0610-462f-a9a3-674da0bdba18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:05.673966 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-028df913-aece-4ac3-9c9c-7e6810bed0e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.211748 Jul 27 23:15:05.674695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1441/3071] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:05 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:05.676792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4088bcf4-0610-462f-a9a3-674da0bdba18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.210866 Jul 27 23:15:05.686412 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1631/3072] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:05 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:05.686589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6c5b523c-4bfc-48de-b665-cb0e135d0be8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:05.686589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6c5b523c-4bfc-48de-b665-cb0e135d0be8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:05.687858 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c5b523c-4bfc-48de-b665-cb0e135d0be8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:05.688299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c5b523c-4bfc-48de-b665-cb0e135d0be8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:05.689079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c5b523c-4bfc-48de-b665-cb0e135d0be8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:05.689509 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6c5b523c-4bfc-48de-b665-cb0e135d0be8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:05.755128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6c5b523c-4bfc-48de-b665-cb0e135d0be8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:05.767338 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6c5b523c-4bfc-48de-b665-cb0e135d0be8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.089716 Jul 27 23:15:05.768008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1442/3073] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:05 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:06.695315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ceb0383d-369d-4146-adf4-a190d8fe5219 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:06.695917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ceb0383d-369d-4146-adf4-a190d8fe5219 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:06.697532 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-abe3d945-1d86-4130-9f48-70d65ec33bb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:06.698141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-abe3d945-1d86-4130-9f48-70d65ec33bb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:06.702415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ceb0383d-369d-4146-adf4-a190d8fe5219 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:06.702852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ceb0383d-369d-4146-adf4-a190d8fe5219 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:06.703608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ceb0383d-369d-4146-adf4-a190d8fe5219 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:06.704033 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ceb0383d-369d-4146-adf4-a190d8fe5219 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:06.704449 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-abe3d945-1d86-4130-9f48-70d65ec33bb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:06.704918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-abe3d945-1d86-4130-9f48-70d65ec33bb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:06.705674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-abe3d945-1d86-4130-9f48-70d65ec33bb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:06.706099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-abe3d945-1d86-4130-9f48-70d65ec33bb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:06.900807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ceb0383d-369d-4146-adf4-a190d8fe5219 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:06.903609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-abe3d945-1d86-4130-9f48-70d65ec33bb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:06.909147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ceb0383d-369d-4146-adf4-a190d8fe5219 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.217631 Jul 27 23:15:06.909708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1632/3074] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:06 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:06.912029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-abe3d945-1d86-4130-9f48-70d65ec33bb7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.218349 Jul 27 23:15:06.912761 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1443/3075] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:06 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:06.914003 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ff3d2377-2c40-4511-b6f7-e04548119007 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:06.914599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ff3d2377-2c40-4511-b6f7-e04548119007 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:06.920124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff3d2377-2c40-4511-b6f7-e04548119007 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:06.920591 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff3d2377-2c40-4511-b6f7-e04548119007 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:06.921346 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff3d2377-2c40-4511-b6f7-e04548119007 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:06.921776 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ff3d2377-2c40-4511-b6f7-e04548119007 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:06.981674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ff3d2377-2c40-4511-b6f7-e04548119007 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:06.990455 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ff3d2377-2c40-4511-b6f7-e04548119007 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.079796 Jul 27 23:15:06.991019 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1633/3076] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:06 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:07.930972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-29871b46-15db-48c9-b9e6-6f8075a62124 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:07.931584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-29871b46-15db-48c9-b9e6-6f8075a62124 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:07.933978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-72db62f5-aa49-49ec-9a2e-0d36443d145e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:07.935061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-72db62f5-aa49-49ec-9a2e-0d36443d145e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:07.938180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-29871b46-15db-48c9-b9e6-6f8075a62124 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:07.938635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-29871b46-15db-48c9-b9e6-6f8075a62124 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:07.939396 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-29871b46-15db-48c9-b9e6-6f8075a62124 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:07.939828 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-29871b46-15db-48c9-b9e6-6f8075a62124 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:07.941598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72db62f5-aa49-49ec-9a2e-0d36443d145e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:07.942049 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72db62f5-aa49-49ec-9a2e-0d36443d145e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:07.943004 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72db62f5-aa49-49ec-9a2e-0d36443d145e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:07.943448 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72db62f5-aa49-49ec-9a2e-0d36443d145e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:08.134198 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-29871b46-15db-48c9-b9e6-6f8075a62124 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:08.138290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-72db62f5-aa49-49ec-9a2e-0d36443d145e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:08.143654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-29871b46-15db-48c9-b9e6-6f8075a62124 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.216717 Jul 27 23:15:08.144428 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1444/3077] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:07 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:08.146711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-72db62f5-aa49-49ec-9a2e-0d36443d145e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.216572 Jul 27 23:15:08.147527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1634/3078] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:07 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:08.152455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-eb5387bd-a9bb-40bb-8940-a230fae197fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:08.152455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-eb5387bd-a9bb-40bb-8940-a230fae197fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:08.155304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb5387bd-a9bb-40bb-8940-a230fae197fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:08.155749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb5387bd-a9bb-40bb-8940-a230fae197fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:08.157148 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb5387bd-a9bb-40bb-8940-a230fae197fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:08.157961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb5387bd-a9bb-40bb-8940-a230fae197fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:08.173543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:08.221714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eb5387bd-a9bb-40bb-8940-a230fae197fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:08.229658 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-eb5387bd-a9bb-40bb-8940-a230fae197fd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.084464 Jul 27 23:15:08.230252 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1445/3079] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:08 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:09.165618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-263e4d6d-72ef-453b-9785-6d954dd2ed44 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:09.166227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-263e4d6d-72ef-453b-9785-6d954dd2ed44 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:09.167578 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9e20a0b0-3685-43c1-a0e5-e0ac11e4120e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:09.168189 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9e20a0b0-3685-43c1-a0e5-e0ac11e4120e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:09.172947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-263e4d6d-72ef-453b-9785-6d954dd2ed44 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:09.173394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-263e4d6d-72ef-453b-9785-6d954dd2ed44 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:09.174147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-263e4d6d-72ef-453b-9785-6d954dd2ed44 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:09.174580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-263e4d6d-72ef-453b-9785-6d954dd2ed44 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:09.174721 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e20a0b0-3685-43c1-a0e5-e0ac11e4120e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:09.175033 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e20a0b0-3685-43c1-a0e5-e0ac11e4120e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:09.175773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e20a0b0-3685-43c1-a0e5-e0ac11e4120e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:09.176196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e20a0b0-3685-43c1-a0e5-e0ac11e4120e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:09.359271 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-263e4d6d-72ef-453b-9785-6d954dd2ed44 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:09.368006 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-263e4d6d-72ef-453b-9785-6d954dd2ed44 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.206325 Jul 27 23:15:09.368801 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1635/3080] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:09 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:09.370670 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9e20a0b0-3685-43c1-a0e5-e0ac11e4120e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:09.372940 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-7a51c636-823f-471c-9c99-9e1f424ddb5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:09.373541 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-7a51c636-823f-471c-9c99-9e1f424ddb5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:09.379274 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9e20a0b0-3685-43c1-a0e5-e0ac11e4120e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215432 Jul 27 23:15:09.380090 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1446/3081] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:09 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:09.380230 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a51c636-823f-471c-9c99-9e1f424ddb5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:09.380393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a51c636-823f-471c-9c99-9e1f424ddb5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:09.381172 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a51c636-823f-471c-9c99-9e1f424ddb5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:09.381603 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-7a51c636-823f-471c-9c99-9e1f424ddb5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:09.441866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-7a51c636-823f-471c-9c99-9e1f424ddb5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:09.449647 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-7a51c636-823f-471c-9c99-9e1f424ddb5f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.080145 Jul 27 23:15:09.450204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1636/3082] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:09 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:10.390639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5ea6bf69-63ce-4cd7-b507-21fa43702176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:10.391712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5ea6bf69-63ce-4cd7-b507-21fa43702176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:10.398217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5ea6bf69-63ce-4cd7-b507-21fa43702176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:10.398683 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5ea6bf69-63ce-4cd7-b507-21fa43702176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:10.399361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-15364591-1c85-4617-9d64-d604b725256e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:10.399754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5ea6bf69-63ce-4cd7-b507-21fa43702176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:10.399859 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5ea6bf69-63ce-4cd7-b507-21fa43702176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:10.399955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-15364591-1c85-4617-9d64-d604b725256e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:10.407207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15364591-1c85-4617-9d64-d604b725256e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:10.407655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15364591-1c85-4617-9d64-d604b725256e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:10.408407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15364591-1c85-4617-9d64-d604b725256e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:10.408865 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15364591-1c85-4617-9d64-d604b725256e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:10.592149 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5ea6bf69-63ce-4cd7-b507-21fa43702176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:10.595210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-15364591-1c85-4617-9d64-d604b725256e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:10.600128 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5ea6bf69-63ce-4cd7-b507-21fa43702176 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.213375 Jul 27 23:15:10.600810 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1447/3083] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:10 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:10.603350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-15364591-1c85-4617-9d64-d604b725256e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.207725 Jul 27 23:15:10.604037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1637/3084] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:10 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:10.608418 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-96c9d23c-c89a-4cf0-94d2-7ae50c750e17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:10.609118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-96c9d23c-c89a-4cf0-94d2-7ae50c750e17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:10.615221 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-96c9d23c-c89a-4cf0-94d2-7ae50c750e17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:10.615689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-96c9d23c-c89a-4cf0-94d2-7ae50c750e17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:10.616467 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-96c9d23c-c89a-4cf0-94d2-7ae50c750e17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:10.616919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-96c9d23c-c89a-4cf0-94d2-7ae50c750e17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:10.679630 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-96c9d23c-c89a-4cf0-94d2-7ae50c750e17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:10.687484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-96c9d23c-c89a-4cf0-94d2-7ae50c750e17 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.085750 Jul 27 23:15:10.688594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1448/3085] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:10 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:11.621701 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-47950a46-e166-4eef-946f-48e148314e90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:11.622322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-47950a46-e166-4eef-946f-48e148314e90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:11.624339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-601054b2-84fe-4496-8562-fb4a7a660eac tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:11.624973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-601054b2-84fe-4496-8562-fb4a7a660eac tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:11.628955 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-47950a46-e166-4eef-946f-48e148314e90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:11.629413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-47950a46-e166-4eef-946f-48e148314e90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:11.630180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-47950a46-e166-4eef-946f-48e148314e90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:11.630619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-47950a46-e166-4eef-946f-48e148314e90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:11.631358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-601054b2-84fe-4496-8562-fb4a7a660eac tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:11.631820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-601054b2-84fe-4496-8562-fb4a7a660eac tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:11.632582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-601054b2-84fe-4496-8562-fb4a7a660eac tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:11.633137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-601054b2-84fe-4496-8562-fb4a7a660eac tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:11.823281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-47950a46-e166-4eef-946f-48e148314e90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:11.827460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-601054b2-84fe-4496-8562-fb4a7a660eac tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:11.831770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-47950a46-e166-4eef-946f-48e148314e90 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.213912 Jul 27 23:15:11.832338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1638/3086] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:11 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:11.836212 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-601054b2-84fe-4496-8562-fb4a7a660eac tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.215603 Jul 27 23:15:11.836719 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-19550bbe-f0fb-427d-82f0-17360c0b8508 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:11.837320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-19550bbe-f0fb-427d-82f0-17360c0b8508 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:11.843104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19550bbe-f0fb-427d-82f0-17360c0b8508 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:11.843556 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19550bbe-f0fb-427d-82f0-17360c0b8508 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:11.844963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19550bbe-f0fb-427d-82f0-17360c0b8508 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:11.845400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-19550bbe-f0fb-427d-82f0-17360c0b8508 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:11.846270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1449/3087] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:11 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:11.905150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-19550bbe-f0fb-427d-82f0-17360c0b8508 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:11.913638 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-19550bbe-f0fb-427d-82f0-17360c0b8508 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.080352 Jul 27 23:15:11.914184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1639/3088] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:11 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:12.853583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0271f94d-a4e1-4ca4-b2c9-fb21a0c7824d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:12.854269 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0271f94d-a4e1-4ca4-b2c9-fb21a0c7824d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:12.861583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0271f94d-a4e1-4ca4-b2c9-fb21a0c7824d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:12.862019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0271f94d-a4e1-4ca4-b2c9-fb21a0c7824d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:12.862770 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0271f94d-a4e1-4ca4-b2c9-fb21a0c7824d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:12.863195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0271f94d-a4e1-4ca4-b2c9-fb21a0c7824d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:12.988363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-35b5c2b5-99da-46fe-915d-507d949219d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:12.989058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-35b5c2b5-99da-46fe-915d-507d949219d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:12.992206 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0271f94d-a4e1-4ca4-b2c9-fb21a0c7824d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:12.995089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35b5c2b5-99da-46fe-915d-507d949219d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:12.995540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35b5c2b5-99da-46fe-915d-507d949219d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:12.996298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35b5c2b5-99da-46fe-915d-507d949219d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:12.996763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-35b5c2b5-99da-46fe-915d-507d949219d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:13.000246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0271f94d-a4e1-4ca4-b2c9-fb21a0c7824d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.150635 Jul 27 23:15:13.000922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1450/3089] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:12 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:13.005519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7b6869c8-a7ad-4f67-a2d0-9c2de25f8b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:13.006196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7b6869c8-a7ad-4f67-a2d0-9c2de25f8b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:13.012107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7b6869c8-a7ad-4f67-a2d0-9c2de25f8b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:13.012656 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7b6869c8-a7ad-4f67-a2d0-9c2de25f8b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:13.013475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7b6869c8-a7ad-4f67-a2d0-9c2de25f8b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:13.013973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7b6869c8-a7ad-4f67-a2d0-9c2de25f8b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:13.096052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7b6869c8-a7ad-4f67-a2d0-9c2de25f8b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:13.104228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7b6869c8-a7ad-4f67-a2d0-9c2de25f8b59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.102228 Jul 27 23:15:13.104771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1451/3090] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:13 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:13.152092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-35b5c2b5-99da-46fe-915d-507d949219d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:13.160828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-35b5c2b5-99da-46fe-915d-507d949219d0 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.307752 Jul 27 23:15:13.161385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1640/3091] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:12 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:14.021958 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cffbd930-4f3b-477f-a7a4-d6aa5787780c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:14.022798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cffbd930-4f3b-477f-a7a4-d6aa5787780c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:14.029609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cffbd930-4f3b-477f-a7a4-d6aa5787780c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:14.030046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cffbd930-4f3b-477f-a7a4-d6aa5787780c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:14.030792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cffbd930-4f3b-477f-a7a4-d6aa5787780c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:14.031216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cffbd930-4f3b-477f-a7a4-d6aa5787780c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:14.124842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5c1430d5-fe32-4c83-a5f0-68c4b5ec67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:14.125519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5c1430d5-fe32-4c83-a5f0-68c4b5ec67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:14.131767 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c1430d5-fe32-4c83-a5f0-68c4b5ec67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:14.132210 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c1430d5-fe32-4c83-a5f0-68c4b5ec67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:14.137032 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c1430d5-fe32-4c83-a5f0-68c4b5ec67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:14.137032 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c1430d5-fe32-4c83-a5f0-68c4b5ec67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:14.159791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cffbd930-4f3b-477f-a7a4-d6aa5787780c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:14.167836 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cffbd930-4f3b-477f-a7a4-d6aa5787780c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.149704 Jul 27 23:15:14.168426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1452/3092] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:14 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:14.181826 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-391bab5b-28f7-4da2-81ae-c1c9d0c10c66 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:14.182429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-391bab5b-28f7-4da2-81ae-c1c9d0c10c66 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:14.188842 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-391bab5b-28f7-4da2-81ae-c1c9d0c10c66 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:14.189284 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-391bab5b-28f7-4da2-81ae-c1c9d0c10c66 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:14.190032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-391bab5b-28f7-4da2-81ae-c1c9d0c10c66 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:14.190456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-391bab5b-28f7-4da2-81ae-c1c9d0c10c66 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:14.197993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5c1430d5-fe32-4c83-a5f0-68c4b5ec67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:14.206741 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5c1430d5-fe32-4c83-a5f0-68c4b5ec67f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.085681 Jul 27 23:15:14.207493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1641/3093] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:14 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:14.318328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-391bab5b-28f7-4da2-81ae-c1c9d0c10c66 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:14.326246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-391bab5b-28f7-4da2-81ae-c1c9d0c10c66 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.148243 Jul 27 23:15:14.326802 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1453/3094] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:14 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:15.188658 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-39fa0390-2538-4d59-923b-5348bfb13197 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:15.189270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-39fa0390-2538-4d59-923b-5348bfb13197 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:15.195813 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39fa0390-2538-4d59-923b-5348bfb13197 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:15.196265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39fa0390-2538-4d59-923b-5348bfb13197 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:15.197043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39fa0390-2538-4d59-923b-5348bfb13197 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:15.197482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39fa0390-2538-4d59-923b-5348bfb13197 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:15.227593 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c6f54880-9f1e-4ce5-bbe8-ad2f793579bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:15.228187 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c6f54880-9f1e-4ce5-bbe8-ad2f793579bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:15.235540 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c6f54880-9f1e-4ce5-bbe8-ad2f793579bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:15.236231 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c6f54880-9f1e-4ce5-bbe8-ad2f793579bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:15.237027 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c6f54880-9f1e-4ce5-bbe8-ad2f793579bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:15.237461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c6f54880-9f1e-4ce5-bbe8-ad2f793579bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:15.315250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c6f54880-9f1e-4ce5-bbe8-ad2f793579bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:15.323163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c6f54880-9f1e-4ce5-bbe8-ad2f793579bf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.099890 Jul 27 23:15:15.323727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1454/3095] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:15 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:15.347574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-50056bd2-8eaf-4b7c-985f-d236191072a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:15.348188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-50056bd2-8eaf-4b7c-985f-d236191072a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:15.349116 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-39fa0390-2538-4d59-923b-5348bfb13197 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:15.354260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50056bd2-8eaf-4b7c-985f-d236191072a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:15.354706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50056bd2-8eaf-4b7c-985f-d236191072a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:15.355464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50056bd2-8eaf-4b7c-985f-d236191072a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:15.355898 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-50056bd2-8eaf-4b7c-985f-d236191072a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:15.357216 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-39fa0390-2538-4d59-923b-5348bfb13197 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.172400 Jul 27 23:15:15.357784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1642/3096] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:15 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:15.483196 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-50056bd2-8eaf-4b7c-985f-d236191072a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:15.491213 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-50056bd2-8eaf-4b7c-985f-d236191072a7 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.147982 Jul 27 23:15:15.491768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1455/3097] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:15 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:16.344224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-eb80d552-cc5b-4138-ac24-9066f6cf9190 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:16.344856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-eb80d552-cc5b-4138-ac24-9066f6cf9190 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:16.351392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb80d552-cc5b-4138-ac24-9066f6cf9190 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:16.351835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb80d552-cc5b-4138-ac24-9066f6cf9190 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:16.352596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb80d552-cc5b-4138-ac24-9066f6cf9190 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:16.353030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-eb80d552-cc5b-4138-ac24-9066f6cf9190 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:16.379060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fbf85ae9-f145-4654-a9d7-31aaf6911499 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:16.379662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fbf85ae9-f145-4654-a9d7-31aaf6911499 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:16.386256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fbf85ae9-f145-4654-a9d7-31aaf6911499 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:16.386688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fbf85ae9-f145-4654-a9d7-31aaf6911499 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:16.387436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fbf85ae9-f145-4654-a9d7-31aaf6911499 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:16.387861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fbf85ae9-f145-4654-a9d7-31aaf6911499 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:16.413555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-eb80d552-cc5b-4138-ac24-9066f6cf9190 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:16.421368 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-eb80d552-cc5b-4138-ac24-9066f6cf9190 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.080912 Jul 27 23:15:16.422423 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1643/3098] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:16 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:16.512345 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-720d0432-0170-4102-95e0-d13e77e3d0bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:16.512972 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-720d0432-0170-4102-95e0-d13e77e3d0bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:16.515601 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fbf85ae9-f145-4654-a9d7-31aaf6911499 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:16.518952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-720d0432-0170-4102-95e0-d13e77e3d0bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:16.519476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-720d0432-0170-4102-95e0-d13e77e3d0bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:16.520232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-720d0432-0170-4102-95e0-d13e77e3d0bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:16.520694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-720d0432-0170-4102-95e0-d13e77e3d0bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:16.523947 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fbf85ae9-f145-4654-a9d7-31aaf6911499 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.149238 Jul 27 23:15:16.524515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1456/3099] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:16 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:16.645834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-720d0432-0170-4102-95e0-d13e77e3d0bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:16.653550 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-720d0432-0170-4102-95e0-d13e77e3d0bb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.145141 Jul 27 23:15:16.654103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1644/3100] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:16 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:17.443169 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ad3ac51b-bdc6-44d4-a751-4544d7ed932d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:17.443715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ad3ac51b-bdc6-44d4-a751-4544d7ed932d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:17.450134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad3ac51b-bdc6-44d4-a751-4544d7ed932d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:17.450571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad3ac51b-bdc6-44d4-a751-4544d7ed932d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:17.451318 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad3ac51b-bdc6-44d4-a751-4544d7ed932d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:17.451745 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad3ac51b-bdc6-44d4-a751-4544d7ed932d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:17.512682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ad3ac51b-bdc6-44d4-a751-4544d7ed932d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:17.520407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ad3ac51b-bdc6-44d4-a751-4544d7ed932d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.081271 Jul 27 23:15:17.520993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1457/3101] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:17 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:17.544874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c6031570-7cb4-4376-abef-50447f486326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:17.545487 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c6031570-7cb4-4376-abef-50447f486326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:17.552535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c6031570-7cb4-4376-abef-50447f486326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:17.553013 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c6031570-7cb4-4376-abef-50447f486326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:17.553764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c6031570-7cb4-4376-abef-50447f486326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:17.554199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c6031570-7cb4-4376-abef-50447f486326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:17.675190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-eb327084-1b2c-41b7-a81a-6e06cb143835 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:17.675798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-eb327084-1b2c-41b7-a81a-6e06cb143835 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:17.681850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb327084-1b2c-41b7-a81a-6e06cb143835 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:17.682297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb327084-1b2c-41b7-a81a-6e06cb143835 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:17.682711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c6031570-7cb4-4376-abef-50447f486326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:17.683056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb327084-1b2c-41b7-a81a-6e06cb143835 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:17.683491 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-eb327084-1b2c-41b7-a81a-6e06cb143835 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:17.690622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c6031570-7cb4-4376-abef-50447f486326 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.149493 Jul 27 23:15:17.691192 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1645/3102] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:17 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:17.807689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-eb327084-1b2c-41b7-a81a-6e06cb143835 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:17.815550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-eb327084-1b2c-41b7-a81a-6e06cb143835 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.144239 Jul 27 23:15:17.816132 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1458/3103] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:17 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:18.541726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e89bad75-643c-47af-8f5f-cdd8426939f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:18.542334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e89bad75-643c-47af-8f5f-cdd8426939f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:18.544152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=74 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:18.550489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e89bad75-643c-47af-8f5f-cdd8426939f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:18.551073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e89bad75-643c-47af-8f5f-cdd8426939f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:18.551688 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e89bad75-643c-47af-8f5f-cdd8426939f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:18.552112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e89bad75-643c-47af-8f5f-cdd8426939f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:18.612995 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e89bad75-643c-47af-8f5f-cdd8426939f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:18.620735 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e89bad75-643c-47af-8f5f-cdd8426939f2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083123 Jul 27 23:15:18.621320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1646/3104] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:18 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:18.713250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-10b8525f-4581-4a50-bf02-5f7eb645e5eb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:18.713890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-10b8525f-4581-4a50-bf02-5f7eb645e5eb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:18.720319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10b8525f-4581-4a50-bf02-5f7eb645e5eb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:18.720784 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10b8525f-4581-4a50-bf02-5f7eb645e5eb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:18.721526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10b8525f-4581-4a50-bf02-5f7eb645e5eb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:18.721952 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10b8525f-4581-4a50-bf02-5f7eb645e5eb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:18.838197 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-aaff0f76-8485-4414-b77b-8c601a9f69dd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:18.838831 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-aaff0f76-8485-4414-b77b-8c601a9f69dd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:18.845304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aaff0f76-8485-4414-b77b-8c601a9f69dd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:18.845745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aaff0f76-8485-4414-b77b-8c601a9f69dd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:18.846495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aaff0f76-8485-4414-b77b-8c601a9f69dd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:18.846923 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-aaff0f76-8485-4414-b77b-8c601a9f69dd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:18.851774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:18.854451 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-10b8525f-4581-4a50-bf02-5f7eb645e5eb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:18.863382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-10b8525f-4581-4a50-bf02-5f7eb645e5eb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.154141 Jul 27 23:15:18.863948 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1459/3105] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:18 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:18.974595 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-aaff0f76-8485-4414-b77b-8c601a9f69dd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:18.982422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-aaff0f76-8485-4414-b77b-8c601a9f69dd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.148033 Jul 27 23:15:18.982976 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1647/3106] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:18 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:19.642297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-db549aa3-23bb-4ebc-b4ac-2d1357237fb1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:19.642894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-db549aa3-23bb-4ebc-b4ac-2d1357237fb1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:19.648926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db549aa3-23bb-4ebc-b4ac-2d1357237fb1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:19.649364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db549aa3-23bb-4ebc-b4ac-2d1357237fb1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:19.650108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db549aa3-23bb-4ebc-b4ac-2d1357237fb1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:19.650539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-db549aa3-23bb-4ebc-b4ac-2d1357237fb1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:19.711564 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-db549aa3-23bb-4ebc-b4ac-2d1357237fb1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:19.719768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-db549aa3-23bb-4ebc-b4ac-2d1357237fb1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.081969 Jul 27 23:15:19.720319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1460/3107] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:19 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:19.884343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1fbf7f2f-e0de-4217-8fa9-5c87d22de021 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:19.884912 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1fbf7f2f-e0de-4217-8fa9-5c87d22de021 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:19.891414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1fbf7f2f-e0de-4217-8fa9-5c87d22de021 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:19.891866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1fbf7f2f-e0de-4217-8fa9-5c87d22de021 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:19.892653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1fbf7f2f-e0de-4217-8fa9-5c87d22de021 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:19.893091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1fbf7f2f-e0de-4217-8fa9-5c87d22de021 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:20.004982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9c763eb0-6a44-4b51-abc2-073c08c2eae4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:20.005586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9c763eb0-6a44-4b51-abc2-073c08c2eae4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:20.011651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c763eb0-6a44-4b51-abc2-073c08c2eae4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:20.012091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c763eb0-6a44-4b51-abc2-073c08c2eae4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:20.012856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c763eb0-6a44-4b51-abc2-073c08c2eae4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:20.013283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c763eb0-6a44-4b51-abc2-073c08c2eae4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:20.021167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1fbf7f2f-e0de-4217-8fa9-5c87d22de021 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:20.028944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1fbf7f2f-e0de-4217-8fa9-5c87d22de021 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148527 Jul 27 23:15:20.029509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1648/3108] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:19 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:20.143914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9c763eb0-6a44-4b51-abc2-073c08c2eae4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:20.151948 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9c763eb0-6a44-4b51-abc2-073c08c2eae4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.150756 Jul 27 23:15:20.152506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1461/3109] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:19 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:20.740723 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4e26d9b4-3600-4c48-a165-13c6cfcc73b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:20.741336 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4e26d9b4-3600-4c48-a165-13c6cfcc73b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:20.747495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4e26d9b4-3600-4c48-a165-13c6cfcc73b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:20.747944 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4e26d9b4-3600-4c48-a165-13c6cfcc73b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:20.748731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4e26d9b4-3600-4c48-a165-13c6cfcc73b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:20.749173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4e26d9b4-3600-4c48-a165-13c6cfcc73b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:20.816848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4e26d9b4-3600-4c48-a165-13c6cfcc73b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:20.824705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4e26d9b4-3600-4c48-a165-13c6cfcc73b8 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.087852 Jul 27 23:15:20.825268 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1649/3110] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:20 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:21.050012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-80cb3a62-7b1c-4362-9423-9142adf2cb5d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:21.050620 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-80cb3a62-7b1c-4362-9423-9142adf2cb5d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:21.053058 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=76 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:21.058452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80cb3a62-7b1c-4362-9423-9142adf2cb5d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:21.058887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80cb3a62-7b1c-4362-9423-9142adf2cb5d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:21.059634 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80cb3a62-7b1c-4362-9423-9142adf2cb5d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:21.060066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-80cb3a62-7b1c-4362-9423-9142adf2cb5d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:21.064539 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:21.173133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-08ba2297-02ba-4e81-bd16-ffb36dab9947 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:21.173857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-08ba2297-02ba-4e81-bd16-ffb36dab9947 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:21.180184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08ba2297-02ba-4e81-bd16-ffb36dab9947 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:21.180657 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08ba2297-02ba-4e81-bd16-ffb36dab9947 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:21.181416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08ba2297-02ba-4e81-bd16-ffb36dab9947 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:21.181850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-08ba2297-02ba-4e81-bd16-ffb36dab9947 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:21.187869 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-80cb3a62-7b1c-4362-9423-9142adf2cb5d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:21.195728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-80cb3a62-7b1c-4362-9423-9142adf2cb5d tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.149575 Jul 27 23:15:21.196506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1462/3111] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:21 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:21.311987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-08ba2297-02ba-4e81-bd16-ffb36dab9947 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:21.320568 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-08ba2297-02ba-4e81-bd16-ffb36dab9947 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.151293 Jul 27 23:15:21.321133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1650/3112] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:21 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:21.845182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f5c9b34b-4d99-4326-a507-fa99bc19c648 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:21.845791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f5c9b34b-4d99-4326-a507-fa99bc19c648 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:21.851782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5c9b34b-4d99-4326-a507-fa99bc19c648 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:21.852227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5c9b34b-4d99-4326-a507-fa99bc19c648 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:21.853015 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5c9b34b-4d99-4326-a507-fa99bc19c648 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:21.853447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f5c9b34b-4d99-4326-a507-fa99bc19c648 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:21.916388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f5c9b34b-4d99-4326-a507-fa99bc19c648 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:21.924899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f5c9b34b-4d99-4326-a507-fa99bc19c648 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.084111 Jul 27 23:15:21.925442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1463/3113] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:21 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:22.216410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-df91027d-4d24-4251-b66e-3554e85f3eee tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:22.217043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-df91027d-4d24-4251-b66e-3554e85f3eee tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:22.224934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df91027d-4d24-4251-b66e-3554e85f3eee tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:22.225400 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df91027d-4d24-4251-b66e-3554e85f3eee tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:22.226150 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df91027d-4d24-4251-b66e-3554e85f3eee tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:22.226579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-df91027d-4d24-4251-b66e-3554e85f3eee tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:22.341542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f48cfb10-66c0-48af-b69b-a7c73d1ab6ef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:22.342154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f48cfb10-66c0-48af-b69b-a7c73d1ab6ef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:22.349141 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f48cfb10-66c0-48af-b69b-a7c73d1ab6ef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:22.349586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f48cfb10-66c0-48af-b69b-a7c73d1ab6ef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:22.350343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f48cfb10-66c0-48af-b69b-a7c73d1ab6ef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:22.350775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f48cfb10-66c0-48af-b69b-a7c73d1ab6ef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:22.350902 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-df91027d-4d24-4251-b66e-3554e85f3eee tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:22.358818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-df91027d-4d24-4251-b66e-3554e85f3eee tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146214 Jul 27 23:15:22.359374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1651/3114] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:22 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:22.476446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f48cfb10-66c0-48af-b69b-a7c73d1ab6ef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:22.484267 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f48cfb10-66c0-48af-b69b-a7c73d1ab6ef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.146477 Jul 27 23:15:22.484865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1464/3115] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:22 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:22.945424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-075e3d54-7c75-43f4-bec3-97ee70223f3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:22.946021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-075e3d54-7c75-43f4-bec3-97ee70223f3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:22.951942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-075e3d54-7c75-43f4-bec3-97ee70223f3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:22.952383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-075e3d54-7c75-43f4-bec3-97ee70223f3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:22.953709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-075e3d54-7c75-43f4-bec3-97ee70223f3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:22.954141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-075e3d54-7c75-43f4-bec3-97ee70223f3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:23.016961 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-075e3d54-7c75-43f4-bec3-97ee70223f3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:23.024706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-075e3d54-7c75-43f4-bec3-97ee70223f3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083109 Jul 27 23:15:23.025254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1652/3116] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:22 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:23.379781 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0d2771a8-5a7e-4931-a16f-4bc6fbc60936 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:23.380398 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0d2771a8-5a7e-4931-a16f-4bc6fbc60936 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:23.387042 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0d2771a8-5a7e-4931-a16f-4bc6fbc60936 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:23.387478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0d2771a8-5a7e-4931-a16f-4bc6fbc60936 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:23.388264 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0d2771a8-5a7e-4931-a16f-4bc6fbc60936 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:23.388726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0d2771a8-5a7e-4931-a16f-4bc6fbc60936 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:23.506705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6e06a04e-7470-4126-bbba-3638b51a4adb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:23.507309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6e06a04e-7470-4126-bbba-3638b51a4adb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:23.513706 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e06a04e-7470-4126-bbba-3638b51a4adb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:23.514151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e06a04e-7470-4126-bbba-3638b51a4adb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:23.514895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e06a04e-7470-4126-bbba-3638b51a4adb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:23.515324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e06a04e-7470-4126-bbba-3638b51a4adb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:23.521085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0d2771a8-5a7e-4931-a16f-4bc6fbc60936 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:23.528951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0d2771a8-5a7e-4931-a16f-4bc6fbc60936 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.153105 Jul 27 23:15:23.529514 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1465/3117] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:23 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:23.643705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6e06a04e-7470-4126-bbba-3638b51a4adb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:23.651494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6e06a04e-7470-4126-bbba-3638b51a4adb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.148594 Jul 27 23:15:23.652055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1653/3118] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:23 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:24.045733 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8fa8d0ee-5c42-443a-afd4-a4330579fc7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:24.046346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8fa8d0ee-5c42-443a-afd4-a4330579fc7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:24.052469 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8fa8d0ee-5c42-443a-afd4-a4330579fc7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:24.052945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8fa8d0ee-5c42-443a-afd4-a4330579fc7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:24.053703 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8fa8d0ee-5c42-443a-afd4-a4330579fc7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:24.054138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8fa8d0ee-5c42-443a-afd4-a4330579fc7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:24.117799 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8fa8d0ee-5c42-443a-afd4-a4330579fc7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:24.126163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8fa8d0ee-5c42-443a-afd4-a4330579fc7b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.084277 Jul 27 23:15:24.126722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1466/3119] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:24 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:24.550797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-999d509d-04c5-4713-8c18-9c06c9df5a4a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:24.551442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-999d509d-04c5-4713-8c18-9c06c9df5a4a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:24.557919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-999d509d-04c5-4713-8c18-9c06c9df5a4a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:24.558369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-999d509d-04c5-4713-8c18-9c06c9df5a4a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:24.559122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-999d509d-04c5-4713-8c18-9c06c9df5a4a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:24.559559 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-999d509d-04c5-4713-8c18-9c06c9df5a4a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:24.671658 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9c9b4f0e-5eca-4364-aeb1-93ded5a902a6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:24.672201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9c9b4f0e-5eca-4364-aeb1-93ded5a902a6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:24.678789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c9b4f0e-5eca-4364-aeb1-93ded5a902a6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:24.679224 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c9b4f0e-5eca-4364-aeb1-93ded5a902a6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:24.679975 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c9b4f0e-5eca-4364-aeb1-93ded5a902a6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:24.680401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c9b4f0e-5eca-4364-aeb1-93ded5a902a6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:24.689048 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-999d509d-04c5-4713-8c18-9c06c9df5a4a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:24.697044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-999d509d-04c5-4713-8c18-9c06c9df5a4a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.150576 Jul 27 23:15:24.697604 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1654/3120] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:24 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:24.807391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9c9b4f0e-5eca-4364-aeb1-93ded5a902a6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:24.815727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9c9b4f0e-5eca-4364-aeb1-93ded5a902a6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.147960 Jul 27 23:15:24.816276 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1467/3121] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:24 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:25.146874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-421efd1b-8998-4f25-afc7-b92fd87d0941 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:25.147427 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-421efd1b-8998-4f25-afc7-b92fd87d0941 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:25.153496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-421efd1b-8998-4f25-afc7-b92fd87d0941 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:25.153937 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-421efd1b-8998-4f25-afc7-b92fd87d0941 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:25.154785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-421efd1b-8998-4f25-afc7-b92fd87d0941 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:25.155095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-421efd1b-8998-4f25-afc7-b92fd87d0941 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:25.217567 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-421efd1b-8998-4f25-afc7-b92fd87d0941 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:25.225489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-421efd1b-8998-4f25-afc7-b92fd87d0941 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082600 Jul 27 23:15:25.226050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1655/3122] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:25 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:25.719301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e01e4f63-c2c6-4659-a4c7-a5d88421cee0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:25.719912 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e01e4f63-c2c6-4659-a4c7-a5d88421cee0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:25.726416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e01e4f63-c2c6-4659-a4c7-a5d88421cee0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:25.726861 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e01e4f63-c2c6-4659-a4c7-a5d88421cee0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:25.727610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e01e4f63-c2c6-4659-a4c7-a5d88421cee0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:25.728044 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e01e4f63-c2c6-4659-a4c7-a5d88421cee0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:25.837217 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-20b9fdaf-e205-48ad-a3be-54b530587689 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:25.837829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-20b9fdaf-e205-48ad-a3be-54b530587689 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:25.844627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20b9fdaf-e205-48ad-a3be-54b530587689 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:25.845078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20b9fdaf-e205-48ad-a3be-54b530587689 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:25.845839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20b9fdaf-e205-48ad-a3be-54b530587689 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:25.846273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20b9fdaf-e205-48ad-a3be-54b530587689 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:25.853512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e01e4f63-c2c6-4659-a4c7-a5d88421cee0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:25.861577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e01e4f63-c2c6-4659-a4c7-a5d88421cee0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146661 Jul 27 23:15:25.862144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1468/3123] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:25 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:25.972124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-20b9fdaf-e205-48ad-a3be-54b530587689 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:25.979986 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-20b9fdaf-e205-48ad-a3be-54b530587689 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.146586 Jul 27 23:15:25.980560 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1656/3124] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:25 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:26.247194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ca13e4e7-bac9-47cf-9b31-60a77e8aad5c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:26.247749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ca13e4e7-bac9-47cf-9b31-60a77e8aad5c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:26.253726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca13e4e7-bac9-47cf-9b31-60a77e8aad5c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:26.254175 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca13e4e7-bac9-47cf-9b31-60a77e8aad5c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:26.254926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca13e4e7-bac9-47cf-9b31-60a77e8aad5c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:26.255358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ca13e4e7-bac9-47cf-9b31-60a77e8aad5c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:26.319697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ca13e4e7-bac9-47cf-9b31-60a77e8aad5c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:26.327549 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ca13e4e7-bac9-47cf-9b31-60a77e8aad5c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.084310 Jul 27 23:15:26.328134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1469/3125] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:26 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:26.883363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5c432db2-2669-4487-8ef0-f55c9eec5c31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:26.883967 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5c432db2-2669-4487-8ef0-f55c9eec5c31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:26.890717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c432db2-2669-4487-8ef0-f55c9eec5c31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:26.891159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c432db2-2669-4487-8ef0-f55c9eec5c31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:26.891908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c432db2-2669-4487-8ef0-f55c9eec5c31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:26.892340 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5c432db2-2669-4487-8ef0-f55c9eec5c31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:27.001465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2fe2a538-4872-4787-b52a-8dfd089d7522 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:27.002081 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2fe2a538-4872-4787-b52a-8dfd089d7522 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:27.008477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2fe2a538-4872-4787-b52a-8dfd089d7522 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:27.008951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2fe2a538-4872-4787-b52a-8dfd089d7522 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:27.009711 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2fe2a538-4872-4787-b52a-8dfd089d7522 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:27.010142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2fe2a538-4872-4787-b52a-8dfd089d7522 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:27.016818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5c432db2-2669-4487-8ef0-f55c9eec5c31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:27.025046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5c432db2-2669-4487-8ef0-f55c9eec5c31 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.145644 Jul 27 23:15:27.025607 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1657/3126] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:26 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:27.135681 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2fe2a538-4872-4787-b52a-8dfd089d7522 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:27.143633 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2fe2a538-4872-4787-b52a-8dfd089d7522 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.146081 Jul 27 23:15:27.144190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1470/3127] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:26 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:27.453916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b7880e83-1bc3-498f-b93b-42d451d326c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:27.454535 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b7880e83-1bc3-498f-b93b-42d451d326c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:27.460589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7880e83-1bc3-498f-b93b-42d451d326c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:27.461036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7880e83-1bc3-498f-b93b-42d451d326c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:27.461788 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7880e83-1bc3-498f-b93b-42d451d326c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:27.462220 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b7880e83-1bc3-498f-b93b-42d451d326c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:27.525286 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b7880e83-1bc3-498f-b93b-42d451d326c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:27.533760 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b7880e83-1bc3-498f-b93b-42d451d326c2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.188499 Jul 27 23:15:27.534510 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1658/3128] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:27 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:28.049571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1a8d8296-a457-47e7-97fd-cd92764df822 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:28.050190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1a8d8296-a457-47e7-97fd-cd92764df822 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:28.056675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1a8d8296-a457-47e7-97fd-cd92764df822 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:28.057127 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1a8d8296-a457-47e7-97fd-cd92764df822 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:28.057886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1a8d8296-a457-47e7-97fd-cd92764df822 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:28.058323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1a8d8296-a457-47e7-97fd-cd92764df822 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:28.165547 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c38afa39-4db1-4ef7-a8de-6a37258badef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:28.166119 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c38afa39-4db1-4ef7-a8de-6a37258badef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:28.173068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c38afa39-4db1-4ef7-a8de-6a37258badef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:28.173515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c38afa39-4db1-4ef7-a8de-6a37258badef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:28.174280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c38afa39-4db1-4ef7-a8de-6a37258badef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:28.174722 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c38afa39-4db1-4ef7-a8de-6a37258badef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:28.184724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1a8d8296-a457-47e7-97fd-cd92764df822 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:28.193350 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1a8d8296-a457-47e7-97fd-cd92764df822 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148125 Jul 27 23:15:28.194001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1471/3129] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:28 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:28.304807 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c38afa39-4db1-4ef7-a8de-6a37258badef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:28.312978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c38afa39-4db1-4ef7-a8de-6a37258badef tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.151139 Jul 27 23:15:28.314073 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1659/3130] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:28 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:28.554511 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d1ac49d2-424c-4dd0-951d-feade52aacbd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:28.555142 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d1ac49d2-424c-4dd0-951d-feade52aacbd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:28.561174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1ac49d2-424c-4dd0-951d-feade52aacbd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:28.561609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1ac49d2-424c-4dd0-951d-feade52aacbd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:28.562353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1ac49d2-424c-4dd0-951d-feade52aacbd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:28.562780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d1ac49d2-424c-4dd0-951d-feade52aacbd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:28.626116 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d1ac49d2-424c-4dd0-951d-feade52aacbd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:28.633972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d1ac49d2-424c-4dd0-951d-feade52aacbd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083322 Jul 27 23:15:28.634522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1472/3131] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:28 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:29.214633 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-da31efe2-f172-4650-a9dc-aa5dc241716a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:29.215242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-da31efe2-f172-4650-a9dc-aa5dc241716a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:29.221813 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da31efe2-f172-4650-a9dc-aa5dc241716a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:29.222252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da31efe2-f172-4650-a9dc-aa5dc241716a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:29.222994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da31efe2-f172-4650-a9dc-aa5dc241716a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:29.223419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-da31efe2-f172-4650-a9dc-aa5dc241716a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:29.335674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a9e57e23-fe2d-47df-b975-1f05b6fdf7c1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:29.336275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a9e57e23-fe2d-47df-b975-1f05b6fdf7c1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:29.342749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9e57e23-fe2d-47df-b975-1f05b6fdf7c1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:29.343188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9e57e23-fe2d-47df-b975-1f05b6fdf7c1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:29.343945 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9e57e23-fe2d-47df-b975-1f05b6fdf7c1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:29.344431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a9e57e23-fe2d-47df-b975-1f05b6fdf7c1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:29.349467 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-da31efe2-f172-4650-a9dc-aa5dc241716a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:29.357325 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-da31efe2-f172-4650-a9dc-aa5dc241716a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146551 Jul 27 23:15:29.357886 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1660/3132] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:29 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:29.468843 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a9e57e23-fe2d-47df-b975-1f05b6fdf7c1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:29.476790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a9e57e23-fe2d-47df-b975-1f05b6fdf7c1 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.144950 Jul 27 23:15:29.477347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1473/3133] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:29 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:29.653654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-80af8e52-030d-413d-ac18-cc4e3022b546 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:29.654260 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-80af8e52-030d-413d-ac18-cc4e3022b546 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:29.660272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-80af8e52-030d-413d-ac18-cc4e3022b546 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:29.660751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-80af8e52-030d-413d-ac18-cc4e3022b546 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:29.661501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-80af8e52-030d-413d-ac18-cc4e3022b546 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:29.661943 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-80af8e52-030d-413d-ac18-cc4e3022b546 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:29.724717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-80af8e52-030d-413d-ac18-cc4e3022b546 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:29.732491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-80af8e52-030d-413d-ac18-cc4e3022b546 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082775 Jul 27 23:15:29.733072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1661/3134] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:29 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:30.379389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-935efb75-8a9e-45d7-ab17-cedf4cdc1bdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:30.379951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-935efb75-8a9e-45d7-ab17-cedf4cdc1bdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:30.386653 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-935efb75-8a9e-45d7-ab17-cedf4cdc1bdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:30.387122 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-935efb75-8a9e-45d7-ab17-cedf4cdc1bdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:30.387865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-935efb75-8a9e-45d7-ab17-cedf4cdc1bdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:30.388302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-935efb75-8a9e-45d7-ab17-cedf4cdc1bdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:30.498189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ccd272b0-1aeb-4915-9cab-a93b29ad56e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:30.498813 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ccd272b0-1aeb-4915-9cab-a93b29ad56e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:30.506083 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccd272b0-1aeb-4915-9cab-a93b29ad56e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:30.506521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccd272b0-1aeb-4915-9cab-a93b29ad56e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:30.507276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccd272b0-1aeb-4915-9cab-a93b29ad56e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:30.507699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ccd272b0-1aeb-4915-9cab-a93b29ad56e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:30.530399 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-935efb75-8a9e-45d7-ab17-cedf4cdc1bdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:30.540121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-935efb75-8a9e-45d7-ab17-cedf4cdc1bdf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.164945 Jul 27 23:15:30.540754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1474/3135] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:30 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:30.635227 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ccd272b0-1aeb-4915-9cab-a93b29ad56e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:30.643592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ccd272b0-1aeb-4915-9cab-a93b29ad56e2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.149224 Jul 27 23:15:30.644148 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1662/3136] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:30 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:30.754371 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-648895cc-48bc-4c2c-b4c3-9ecff5d019a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:30.754988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-648895cc-48bc-4c2c-b4c3-9ecff5d019a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:30.761012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-648895cc-48bc-4c2c-b4c3-9ecff5d019a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:30.761463 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-648895cc-48bc-4c2c-b4c3-9ecff5d019a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:30.762219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-648895cc-48bc-4c2c-b4c3-9ecff5d019a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:30.762655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-648895cc-48bc-4c2c-b4c3-9ecff5d019a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:30.826516 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-648895cc-48bc-4c2c-b4c3-9ecff5d019a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:30.837373 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-648895cc-48bc-4c2c-b4c3-9ecff5d019a9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.087450 Jul 27 23:15:30.837949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1475/3137] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:30 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:31.561215 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f45ecb20-85fe-471c-be9b-9fd0b8272cdd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:31.561828 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f45ecb20-85fe-471c-be9b-9fd0b8272cdd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:31.568361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f45ecb20-85fe-471c-be9b-9fd0b8272cdd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:31.568834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f45ecb20-85fe-471c-be9b-9fd0b8272cdd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:31.569593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f45ecb20-85fe-471c-be9b-9fd0b8272cdd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:31.570025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f45ecb20-85fe-471c-be9b-9fd0b8272cdd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:31.665127 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2f179e17-4f80-4cdf-b078-dc15455c2c5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:31.665739 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2f179e17-4f80-4cdf-b078-dc15455c2c5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:31.672955 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f179e17-4f80-4cdf-b078-dc15455c2c5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:31.673409 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f179e17-4f80-4cdf-b078-dc15455c2c5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:31.674170 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f179e17-4f80-4cdf-b078-dc15455c2c5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:31.674599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2f179e17-4f80-4cdf-b078-dc15455c2c5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:31.694696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f45ecb20-85fe-471c-be9b-9fd0b8272cdd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:31.696945 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:31.703933 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f45ecb20-85fe-471c-be9b-9fd0b8272cdd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146537 Jul 27 23:15:31.704500 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1663/3138] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:31 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:31.799322 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-2f179e17-4f80-4cdf-b078-dc15455c2c5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:31.807081 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2f179e17-4f80-4cdf-b078-dc15455c2c5a tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.145824 Jul 27 23:15:31.807635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1476/3139] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:31 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:31.856998 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-10c6d98b-4ce6-41a7-863e-cc4514df2248 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:31.857540 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-10c6d98b-4ce6-41a7-863e-cc4514df2248 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:31.863893 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10c6d98b-4ce6-41a7-863e-cc4514df2248 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:31.864338 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10c6d98b-4ce6-41a7-863e-cc4514df2248 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:31.865117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10c6d98b-4ce6-41a7-863e-cc4514df2248 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:31.865553 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-10c6d98b-4ce6-41a7-863e-cc4514df2248 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:31.927553 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-10c6d98b-4ce6-41a7-863e-cc4514df2248 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:31.935417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-10c6d98b-4ce6-41a7-863e-cc4514df2248 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082321 Jul 27 23:15:31.935969 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1664/3140] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:31 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:32.724993 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0d2a1882-12b3-4eff-b419-5130f7f4b5f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:32.725606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0d2a1882-12b3-4eff-b419-5130f7f4b5f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:32.732216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0d2a1882-12b3-4eff-b419-5130f7f4b5f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:32.732696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0d2a1882-12b3-4eff-b419-5130f7f4b5f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:32.733455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0d2a1882-12b3-4eff-b419-5130f7f4b5f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:32.733888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0d2a1882-12b3-4eff-b419-5130f7f4b5f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:32.828218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-43ac2ac8-759f-49bb-a62b-51239ad661f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:32.828989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-43ac2ac8-759f-49bb-a62b-51239ad661f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:32.835551 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43ac2ac8-759f-49bb-a62b-51239ad661f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:32.835992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43ac2ac8-759f-49bb-a62b-51239ad661f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:32.836777 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43ac2ac8-759f-49bb-a62b-51239ad661f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:32.837198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-43ac2ac8-759f-49bb-a62b-51239ad661f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:32.865060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0d2a1882-12b3-4eff-b419-5130f7f4b5f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:32.873057 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0d2a1882-12b3-4eff-b419-5130f7f4b5f0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.151919 Jul 27 23:15:32.873620 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1477/3141] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:32 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:32.955372 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1b9450e5-490b-4038-95bd-5238e263372d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:32.955976 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1b9450e5-490b-4038-95bd-5238e263372d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:32.961762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b9450e5-490b-4038-95bd-5238e263372d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:32.962202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b9450e5-490b-4038-95bd-5238e263372d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:32.963333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b9450e5-490b-4038-95bd-5238e263372d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:32.963460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1b9450e5-490b-4038-95bd-5238e263372d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:32.965521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-43ac2ac8-759f-49bb-a62b-51239ad661f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:32.973913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-43ac2ac8-759f-49bb-a62b-51239ad661f4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.149491 Jul 27 23:15:32.974470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1665/3142] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:32 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:33.026939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-1b9450e5-490b-4038-95bd-5238e263372d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:33.029114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:33.036675 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1b9450e5-490b-4038-95bd-5238e263372d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.085251 Jul 27 23:15:33.037233 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1478/3143] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:32 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:33.895430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e8f41e0d-fd3b-4244-bfa9-c841ab8063a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:33.896018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e8f41e0d-fd3b-4244-bfa9-c841ab8063a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:33.902489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8f41e0d-fd3b-4244-bfa9-c841ab8063a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:33.902929 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8f41e0d-fd3b-4244-bfa9-c841ab8063a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:33.903668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8f41e0d-fd3b-4244-bfa9-c841ab8063a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:33.904092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e8f41e0d-fd3b-4244-bfa9-c841ab8063a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:33.995207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a345d8a6-eb68-46aa-8646-d41fabf58a0f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:33.995820 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a345d8a6-eb68-46aa-8646-d41fabf58a0f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:34.002822 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a345d8a6-eb68-46aa-8646-d41fabf58a0f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:34.003272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a345d8a6-eb68-46aa-8646-d41fabf58a0f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:34.004031 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a345d8a6-eb68-46aa-8646-d41fabf58a0f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:34.004466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a345d8a6-eb68-46aa-8646-d41fabf58a0f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:34.034793 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e8f41e0d-fd3b-4244-bfa9-c841ab8063a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:34.042772 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e8f41e0d-fd3b-4244-bfa9-c841ab8063a1 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.151739 Jul 27 23:15:34.043328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1666/3144] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:33 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:34.057474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6c1dd730-f6fd-4b14-812f-3b2f7aaf223d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:34.058071 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6c1dd730-f6fd-4b14-812f-3b2f7aaf223d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:34.064691 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c1dd730-f6fd-4b14-812f-3b2f7aaf223d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:34.065129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c1dd730-f6fd-4b14-812f-3b2f7aaf223d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:34.065879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c1dd730-f6fd-4b14-812f-3b2f7aaf223d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:34.066309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6c1dd730-f6fd-4b14-812f-3b2f7aaf223d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:34.141437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6c1dd730-f6fd-4b14-812f-3b2f7aaf223d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:34.149314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6c1dd730-f6fd-4b14-812f-3b2f7aaf223d tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.095458 Jul 27 23:15:34.150009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1667/3145] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:34 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:34.163172 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a345d8a6-eb68-46aa-8646-d41fabf58a0f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:34.171163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a345d8a6-eb68-46aa-8646-d41fabf58a0f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.179804 Jul 27 23:15:34.171726 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1479/3146] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:33 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:35.064072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8aba64e9-5aaf-43d5-b49a-37c2c2135e81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:35.064721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8aba64e9-5aaf-43d5-b49a-37c2c2135e81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:35.071163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8aba64e9-5aaf-43d5-b49a-37c2c2135e81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:35.071605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8aba64e9-5aaf-43d5-b49a-37c2c2135e81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:35.072348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8aba64e9-5aaf-43d5-b49a-37c2c2135e81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:35.072802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8aba64e9-5aaf-43d5-b49a-37c2c2135e81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:35.170375 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9c156a98-9a22-427b-ad03-cab159343545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:35.171011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9c156a98-9a22-427b-ad03-cab159343545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:35.178119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c156a98-9a22-427b-ad03-cab159343545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:35.178551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c156a98-9a22-427b-ad03-cab159343545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:35.179307 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c156a98-9a22-427b-ad03-cab159343545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:35.179773 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9c156a98-9a22-427b-ad03-cab159343545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:35.202112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8aba64e9-5aaf-43d5-b49a-37c2c2135e81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:35.212975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8aba64e9-5aaf-43d5-b49a-37c2c2135e81 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.153317 Jul 27 23:15:35.213580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1668/3147] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:35 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:35.220205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-90c09197-6505-4a92-84f2-f56a8bac8faf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:35.220983 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-90c09197-6505-4a92-84f2-f56a8bac8faf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:35.226950 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90c09197-6505-4a92-84f2-f56a8bac8faf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:35.227414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90c09197-6505-4a92-84f2-f56a8bac8faf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:35.228185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90c09197-6505-4a92-84f2-f56a8bac8faf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:35.228652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90c09197-6505-4a92-84f2-f56a8bac8faf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:35.245785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9c156a98-9a22-427b-ad03-cab159343545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:35.255613 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9c156a98-9a22-427b-ad03-cab159343545 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.088986 Jul 27 23:15:35.256401 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1480/3148] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:35 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:35.563045 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-90c09197-6505-4a92-84f2-f56a8bac8faf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:35.571045 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-90c09197-6505-4a92-84f2-f56a8bac8faf tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.356544 Jul 27 23:15:35.571599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1669/3149] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:35 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:36.234431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e0023e6f-a433-48fe-9b91-a5fd4a428abd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:36.235041 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e0023e6f-a433-48fe-9b91-a5fd4a428abd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:36.242084 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e0023e6f-a433-48fe-9b91-a5fd4a428abd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:36.242520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e0023e6f-a433-48fe-9b91-a5fd4a428abd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:36.243298 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e0023e6f-a433-48fe-9b91-a5fd4a428abd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:36.243722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e0023e6f-a433-48fe-9b91-a5fd4a428abd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:36.276217 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4b33e3b7-a730-4a0b-a5ca-4a2e0d16be84 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:36.276895 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4b33e3b7-a730-4a0b-a5ca-4a2e0d16be84 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:36.283363 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4b33e3b7-a730-4a0b-a5ca-4a2e0d16be84 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:36.283810 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4b33e3b7-a730-4a0b-a5ca-4a2e0d16be84 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:36.284587 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4b33e3b7-a730-4a0b-a5ca-4a2e0d16be84 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:36.285025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4b33e3b7-a730-4a0b-a5ca-4a2e0d16be84 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:36.360090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4b33e3b7-a730-4a0b-a5ca-4a2e0d16be84 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:36.368255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4b33e3b7-a730-4a0b-a5ca-4a2e0d16be84 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.095793 Jul 27 23:15:36.368846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1670/3150] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:36 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:36.388932 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e0023e6f-a433-48fe-9b91-a5fd4a428abd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:36.396722 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e0023e6f-a433-48fe-9b91-a5fd4a428abd tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.166121 Jul 27 23:15:36.397273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1481/3151] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:36 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:36.592047 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b176ab0c-67ad-4628-8eb2-d600cf4c1766 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:36.592686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b176ab0c-67ad-4628-8eb2-d600cf4c1766 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:36.598682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b176ab0c-67ad-4628-8eb2-d600cf4c1766 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:36.599124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b176ab0c-67ad-4628-8eb2-d600cf4c1766 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:36.599870 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b176ab0c-67ad-4628-8eb2-d600cf4c1766 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:36.600305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b176ab0c-67ad-4628-8eb2-d600cf4c1766 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:36.728679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b176ab0c-67ad-4628-8eb2-d600cf4c1766 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:36.737349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b176ab0c-67ad-4628-8eb2-d600cf4c1766 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.149189 Jul 27 23:15:36.737905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1671/3152] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:36 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:37.389333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8136cbd9-b2a6-454c-8da8-f3fe6d0cd16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:37.389934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-8136cbd9-b2a6-454c-8da8-f3fe6d0cd16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:37.396850 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8136cbd9-b2a6-454c-8da8-f3fe6d0cd16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:37.397290 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8136cbd9-b2a6-454c-8da8-f3fe6d0cd16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:37.398033 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8136cbd9-b2a6-454c-8da8-f3fe6d0cd16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:37.398456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-8136cbd9-b2a6-454c-8da8-f3fe6d0cd16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:37.417482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-5ef40db8-5627-4085-a0aa-f265b1c1374a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:37.418182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-5ef40db8-5627-4085-a0aa-f265b1c1374a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:37.424614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ef40db8-5627-4085-a0aa-f265b1c1374a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:37.425066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ef40db8-5627-4085-a0aa-f265b1c1374a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:37.425817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ef40db8-5627-4085-a0aa-f265b1c1374a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:37.426251 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-5ef40db8-5627-4085-a0aa-f265b1c1374a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:37.459456 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-8136cbd9-b2a6-454c-8da8-f3fe6d0cd16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:37.467333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8136cbd9-b2a6-454c-8da8-f3fe6d0cd16b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.081837 Jul 27 23:15:37.467897 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1482/3153] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:37 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:37.552232 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-5ef40db8-5627-4085-a0aa-f265b1c1374a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:37.560169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-5ef40db8-5627-4085-a0aa-f265b1c1374a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146609 Jul 27 23:15:37.560756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1672/3154] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:37 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:37.758297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b5be80a5-a4ff-486c-a1ad-eccafaa93502 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:37.758827 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b5be80a5-a4ff-486c-a1ad-eccafaa93502 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:37.764752 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b5be80a5-a4ff-486c-a1ad-eccafaa93502 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:37.765194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b5be80a5-a4ff-486c-a1ad-eccafaa93502 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:37.766544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b5be80a5-a4ff-486c-a1ad-eccafaa93502 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:37.766971 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b5be80a5-a4ff-486c-a1ad-eccafaa93502 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:37.894812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b5be80a5-a4ff-486c-a1ad-eccafaa93502 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:37.902612 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b5be80a5-a4ff-486c-a1ad-eccafaa93502 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.148194 Jul 27 23:15:37.903176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1483/3155] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:37 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:38.489752 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-013f95fa-19bb-462b-92ee-e33af0c5675a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:38.490372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-013f95fa-19bb-462b-92ee-e33af0c5675a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:38.496933 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-013f95fa-19bb-462b-92ee-e33af0c5675a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:38.497384 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-013f95fa-19bb-462b-92ee-e33af0c5675a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:38.498147 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-013f95fa-19bb-462b-92ee-e33af0c5675a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:38.498584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-013f95fa-19bb-462b-92ee-e33af0c5675a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:38.559377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-013f95fa-19bb-462b-92ee-e33af0c5675a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:38.567145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-013f95fa-19bb-462b-92ee-e33af0c5675a tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.081516 Jul 27 23:15:38.567699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1673/3156] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:38 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:38.582073 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b809d1ba-3efa-4ab5-b98e-45a8a82cf762 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:38.582674 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b809d1ba-3efa-4ab5-b98e-45a8a82cf762 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:38.589210 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b809d1ba-3efa-4ab5-b98e-45a8a82cf762 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:38.589652 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b809d1ba-3efa-4ab5-b98e-45a8a82cf762 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:38.590399 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b809d1ba-3efa-4ab5-b98e-45a8a82cf762 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:38.590851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b809d1ba-3efa-4ab5-b98e-45a8a82cf762 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:38.718052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b809d1ba-3efa-4ab5-b98e-45a8a82cf762 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:38.726541 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b809d1ba-3efa-4ab5-b98e-45a8a82cf762 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148797 Jul 27 23:15:38.727099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1484/3157] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:38 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:38.923722 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9a780a65-5679-4845-bac0-cb3cf936b941 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:38.924335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9a780a65-5679-4845-bac0-cb3cf936b941 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:38.930369 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a780a65-5679-4845-bac0-cb3cf936b941 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:38.930821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a780a65-5679-4845-bac0-cb3cf936b941 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:38.931576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a780a65-5679-4845-bac0-cb3cf936b941 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:38.932012 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9a780a65-5679-4845-bac0-cb3cf936b941 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:39.063532 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9a780a65-5679-4845-bac0-cb3cf936b941 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:39.071422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9a780a65-5679-4845-bac0-cb3cf936b941 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.151574 Jul 27 23:15:39.071982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1674/3158] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:38 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:39.588300 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-be291ec0-9e9a-471d-afde-072d2e923b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:39.588960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-be291ec0-9e9a-471d-afde-072d2e923b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:39.595445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-be291ec0-9e9a-471d-afde-072d2e923b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:39.595885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-be291ec0-9e9a-471d-afde-072d2e923b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:39.596665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-be291ec0-9e9a-471d-afde-072d2e923b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:39.597687 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-be291ec0-9e9a-471d-afde-072d2e923b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:39.660380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-be291ec0-9e9a-471d-afde-072d2e923b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:39.668333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-be291ec0-9e9a-471d-afde-072d2e923b96 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083891 Jul 27 23:15:39.668922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1485/3159] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:39 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:39.748088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ec8f8401-cdf2-41fd-8e78-069d0a36c01f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:39.748725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ec8f8401-cdf2-41fd-8e78-069d0a36c01f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:39.755738 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ec8f8401-cdf2-41fd-8e78-069d0a36c01f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:39.756182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ec8f8401-cdf2-41fd-8e78-069d0a36c01f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:39.756969 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ec8f8401-cdf2-41fd-8e78-069d0a36c01f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:39.757403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ec8f8401-cdf2-41fd-8e78-069d0a36c01f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:39.884824 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ec8f8401-cdf2-41fd-8e78-069d0a36c01f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:39.892818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ec8f8401-cdf2-41fd-8e78-069d0a36c01f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148537 Jul 27 23:15:39.893376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1675/3160] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:39 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:40.092818 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-39272572-41f1-4693-856e-bae1aeae2356 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:40.093686 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-39272572-41f1-4693-856e-bae1aeae2356 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:40.099693 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-39272572-41f1-4693-856e-bae1aeae2356 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:40.100136 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-39272572-41f1-4693-856e-bae1aeae2356 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:40.100915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-39272572-41f1-4693-856e-bae1aeae2356 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:40.101347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-39272572-41f1-4693-856e-bae1aeae2356 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:40.231295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-39272572-41f1-4693-856e-bae1aeae2356 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:40.239462 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-39272572-41f1-4693-856e-bae1aeae2356 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.151191 Jul 27 23:15:40.240019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1486/3161] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:40 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:40.688857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4562d318-73f7-4edf-88e5-ad11b9226a46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:40.689463 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4562d318-73f7-4edf-88e5-ad11b9226a46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:40.695953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4562d318-73f7-4edf-88e5-ad11b9226a46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:40.696398 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4562d318-73f7-4edf-88e5-ad11b9226a46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:40.697175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4562d318-73f7-4edf-88e5-ad11b9226a46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:40.697627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4562d318-73f7-4edf-88e5-ad11b9226a46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:40.757875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4562d318-73f7-4edf-88e5-ad11b9226a46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:40.765830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4562d318-73f7-4edf-88e5-ad11b9226a46 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.080924 Jul 27 23:15:40.766390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1676/3162] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:40 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:40.914526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b7a49c69-aad4-4596-933a-f1c0da74e067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:40.915126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b7a49c69-aad4-4596-933a-f1c0da74e067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:40.921588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7a49c69-aad4-4596-933a-f1c0da74e067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:40.922059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7a49c69-aad4-4596-933a-f1c0da74e067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:40.922805 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7a49c69-aad4-4596-933a-f1c0da74e067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:40.923232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7a49c69-aad4-4596-933a-f1c0da74e067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:41.049640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b7a49c69-aad4-4596-933a-f1c0da74e067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:41.057941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b7a49c69-aad4-4596-933a-f1c0da74e067 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147264 Jul 27 23:15:41.058513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1487/3163] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:40 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:41.260650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9f8df9cd-ced1-410f-a14d-3546069a5507 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:41.261221 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9f8df9cd-ced1-410f-a14d-3546069a5507 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:41.267213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f8df9cd-ced1-410f-a14d-3546069a5507 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:41.267653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f8df9cd-ced1-410f-a14d-3546069a5507 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:41.268403 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f8df9cd-ced1-410f-a14d-3546069a5507 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:41.268874 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9f8df9cd-ced1-410f-a14d-3546069a5507 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:41.393833 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9f8df9cd-ced1-410f-a14d-3546069a5507 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:41.401668 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9f8df9cd-ced1-410f-a14d-3546069a5507 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.145082 Jul 27 23:15:41.402231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1677/3164] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:41 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:41.786317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-afb2f122-0205-4a87-a777-1a0cc5fe6204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:41.786918 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-afb2f122-0205-4a87-a777-1a0cc5fe6204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:41.793751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-afb2f122-0205-4a87-a777-1a0cc5fe6204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:41.794190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-afb2f122-0205-4a87-a777-1a0cc5fe6204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:41.794939 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-afb2f122-0205-4a87-a777-1a0cc5fe6204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:41.795362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-afb2f122-0205-4a87-a777-1a0cc5fe6204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:41.854863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-afb2f122-0205-4a87-a777-1a0cc5fe6204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:41.863134 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-afb2f122-0205-4a87-a777-1a0cc5fe6204 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.080440 Jul 27 23:15:41.863688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1488/3165] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:41 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:42.079329 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-17b6cbcf-3bff-4387-8041-1fc161dcf414 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:42.079938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-17b6cbcf-3bff-4387-8041-1fc161dcf414 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:42.087115 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17b6cbcf-3bff-4387-8041-1fc161dcf414 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:42.087787 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17b6cbcf-3bff-4387-8041-1fc161dcf414 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:42.088754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17b6cbcf-3bff-4387-8041-1fc161dcf414 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:42.089228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-17b6cbcf-3bff-4387-8041-1fc161dcf414 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:42.218323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-17b6cbcf-3bff-4387-8041-1fc161dcf414 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:42.226167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-17b6cbcf-3bff-4387-8041-1fc161dcf414 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.150639 Jul 27 23:15:42.226718 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1678/3166] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:42 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:42.423216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-78de46e7-2eea-4ad3-a722-96d5f3defead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:42.423724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-78de46e7-2eea-4ad3-a722-96d5f3defead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:42.430576 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78de46e7-2eea-4ad3-a722-96d5f3defead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:42.431013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78de46e7-2eea-4ad3-a722-96d5f3defead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:42.431753 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78de46e7-2eea-4ad3-a722-96d5f3defead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:42.432179 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-78de46e7-2eea-4ad3-a722-96d5f3defead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:42.558060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-78de46e7-2eea-4ad3-a722-96d5f3defead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:42.566646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-78de46e7-2eea-4ad3-a722-96d5f3defead tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.146666 Jul 27 23:15:42.567246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1489/3167] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:42 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:42.883647 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-92651ec6-146b-40a1-8c66-1bd301d1fbc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:42.884249 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-92651ec6-146b-40a1-8c66-1bd301d1fbc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:42.890289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-92651ec6-146b-40a1-8c66-1bd301d1fbc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:42.890730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-92651ec6-146b-40a1-8c66-1bd301d1fbc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:42.891474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-92651ec6-146b-40a1-8c66-1bd301d1fbc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:42.891902 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-92651ec6-146b-40a1-8c66-1bd301d1fbc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:42.954653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-92651ec6-146b-40a1-8c66-1bd301d1fbc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:42.963037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-92651ec6-146b-40a1-8c66-1bd301d1fbc2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083289 Jul 27 23:15:42.963598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1679/3168] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:42 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:43.247702 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-641f31d9-c95b-4c31-97dc-64551457b9d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:43.248345 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-641f31d9-c95b-4c31-97dc-64551457b9d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:43.254673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-641f31d9-c95b-4c31-97dc-64551457b9d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:43.255123 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-641f31d9-c95b-4c31-97dc-64551457b9d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:43.255915 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-641f31d9-c95b-4c31-97dc-64551457b9d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:43.256348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-641f31d9-c95b-4c31-97dc-64551457b9d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:43.388982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-641f31d9-c95b-4c31-97dc-64551457b9d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:43.401056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-641f31d9-c95b-4c31-97dc-64551457b9d2 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.157138 Jul 27 23:15:43.401610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1490/3169] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:43 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:43.587766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-af750c17-0471-48cf-bfc5-b5288839ebae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:43.588376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-af750c17-0471-48cf-bfc5-b5288839ebae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:43.594922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-af750c17-0471-48cf-bfc5-b5288839ebae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:43.595364 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-af750c17-0471-48cf-bfc5-b5288839ebae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:43.596112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-af750c17-0471-48cf-bfc5-b5288839ebae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:43.596543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-af750c17-0471-48cf-bfc5-b5288839ebae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:43.611334 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:43.723405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-af750c17-0471-48cf-bfc5-b5288839ebae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:43.731311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-af750c17-0471-48cf-bfc5-b5288839ebae tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.147406 Jul 27 23:15:43.731882 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1680/3170] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:43 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:43.984133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e1e972c0-1fab-41bf-b664-c2f4231a23d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:43.984697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e1e972c0-1fab-41bf-b664-c2f4231a23d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:43.991894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1e972c0-1fab-41bf-b664-c2f4231a23d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:43.992333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1e972c0-1fab-41bf-b664-c2f4231a23d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:43.993121 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1e972c0-1fab-41bf-b664-c2f4231a23d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:43.993554 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e1e972c0-1fab-41bf-b664-c2f4231a23d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:44.054486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e1e972c0-1fab-41bf-b664-c2f4231a23d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:44.062543 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e1e972c0-1fab-41bf-b664-c2f4231a23d4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082332 Jul 27 23:15:44.063097 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1491/3171] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:43 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:44.422091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bee26dfd-7595-47d8-92f2-b557042e1b74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:44.422703 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bee26dfd-7595-47d8-92f2-b557042e1b74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:44.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bee26dfd-7595-47d8-92f2-b557042e1b74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:44.429991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bee26dfd-7595-47d8-92f2-b557042e1b74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:44.430762 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bee26dfd-7595-47d8-92f2-b557042e1b74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:44.431167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bee26dfd-7595-47d8-92f2-b557042e1b74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:44.561892 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bee26dfd-7595-47d8-92f2-b557042e1b74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:44.569784 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bee26dfd-7595-47d8-92f2-b557042e1b74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.151591 Jul 27 23:15:44.570349 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1681/3172] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:44 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:44.753475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-68a7e93f-b9fe-43e7-9e3e-e89327ec3791 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:44.754005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-68a7e93f-b9fe-43e7-9e3e-e89327ec3791 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:44.760667 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-68a7e93f-b9fe-43e7-9e3e-e89327ec3791 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:44.761114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-68a7e93f-b9fe-43e7-9e3e-e89327ec3791 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:44.761959 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-68a7e93f-b9fe-43e7-9e3e-e89327ec3791 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:44.762388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-68a7e93f-b9fe-43e7-9e3e-e89327ec3791 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:44.893523 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-68a7e93f-b9fe-43e7-9e3e-e89327ec3791 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:44.901507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-68a7e93f-b9fe-43e7-9e3e-e89327ec3791 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.152032 Jul 27 23:15:44.902068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1492/3173] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:44 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:45.083502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8c8795cb-ef36-41a6-a1e0-122fd40a92c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:45.084222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8c8795cb-ef36-41a6-a1e0-122fd40a92c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:45.091733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c8795cb-ef36-41a6-a1e0-122fd40a92c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:45.092174 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c8795cb-ef36-41a6-a1e0-122fd40a92c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:45.092990 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c8795cb-ef36-41a6-a1e0-122fd40a92c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:45.093422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8c8795cb-ef36-41a6-a1e0-122fd40a92c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:45.157929 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8c8795cb-ef36-41a6-a1e0-122fd40a92c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:45.168987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8c8795cb-ef36-41a6-a1e0-122fd40a92c4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.089204 Jul 27 23:15:45.169559 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1682/3174] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:45 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:45.591168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0a34157d-cba9-4925-9b95-e13cf8216ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:45.591782 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0a34157d-cba9-4925-9b95-e13cf8216ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:45.598869 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a34157d-cba9-4925-9b95-e13cf8216ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:45.599304 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a34157d-cba9-4925-9b95-e13cf8216ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:45.600046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a34157d-cba9-4925-9b95-e13cf8216ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:45.600478 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0a34157d-cba9-4925-9b95-e13cf8216ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:45.727379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0a34157d-cba9-4925-9b95-e13cf8216ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:45.735219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0a34157d-cba9-4925-9b95-e13cf8216ae6 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147906 Jul 27 23:15:45.735769 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1493/3175] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:45 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:45.926043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d2c99984-636d-4fbc-81c3-6f69f2990191 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:45.926673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d2c99984-636d-4fbc-81c3-6f69f2990191 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:45.933406 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2c99984-636d-4fbc-81c3-6f69f2990191 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:45.933849 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2c99984-636d-4fbc-81c3-6f69f2990191 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:45.934598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2c99984-636d-4fbc-81c3-6f69f2990191 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:45.935026 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d2c99984-636d-4fbc-81c3-6f69f2990191 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:46.059322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d2c99984-636d-4fbc-81c3-6f69f2990191 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:46.067714 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d2c99984-636d-4fbc-81c3-6f69f2990191 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.145472 Jul 27 23:15:46.068266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1683/3176] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:45 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:46.197288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-43c195ec-1460-408f-b0ce-30bedb0f5160 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:46.197929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-43c195ec-1460-408f-b0ce-30bedb0f5160 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:46.204015 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43c195ec-1460-408f-b0ce-30bedb0f5160 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:46.204457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43c195ec-1460-408f-b0ce-30bedb0f5160 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:46.205245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43c195ec-1460-408f-b0ce-30bedb0f5160 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:46.205677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-43c195ec-1460-408f-b0ce-30bedb0f5160 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:46.269296 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-43c195ec-1460-408f-b0ce-30bedb0f5160 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:46.277137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-43c195ec-1460-408f-b0ce-30bedb0f5160 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.085030 Jul 27 23:15:46.277699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1494/3177] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:46 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:46.756359 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-cf083b24-9a14-4968-9f20-377ae2def154 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:46.756994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-cf083b24-9a14-4968-9f20-377ae2def154 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:46.763514 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf083b24-9a14-4968-9f20-377ae2def154 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:46.763956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf083b24-9a14-4968-9f20-377ae2def154 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:46.764748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf083b24-9a14-4968-9f20-377ae2def154 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:46.765184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-cf083b24-9a14-4968-9f20-377ae2def154 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:46.901603 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-cf083b24-9a14-4968-9f20-377ae2def154 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:46.909442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-cf083b24-9a14-4968-9f20-377ae2def154 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.156963 Jul 27 23:15:46.909999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1684/3178] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:46 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:47.088965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3609ce7a-5c72-42b2-82d6-c6de0abb688e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:47.089672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3609ce7a-5c72-42b2-82d6-c6de0abb688e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:47.096328 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3609ce7a-5c72-42b2-82d6-c6de0abb688e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:47.097323 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3609ce7a-5c72-42b2-82d6-c6de0abb688e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:47.098087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3609ce7a-5c72-42b2-82d6-c6de0abb688e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:47.098518 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3609ce7a-5c72-42b2-82d6-c6de0abb688e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:47.114077 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:47.225758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3609ce7a-5c72-42b2-82d6-c6de0abb688e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:47.233696 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3609ce7a-5c72-42b2-82d6-c6de0abb688e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.148919 Jul 27 23:15:47.234247 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1495/3179] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:47 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:47.297319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1e35e316-9372-4066-8788-2343e6469739 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:47.297922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1e35e316-9372-4066-8788-2343e6469739 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:47.304445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e35e316-9372-4066-8788-2343e6469739 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:47.304914 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e35e316-9372-4066-8788-2343e6469739 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:47.305661 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e35e316-9372-4066-8788-2343e6469739 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:47.306090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e35e316-9372-4066-8788-2343e6469739 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:47.369739 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1e35e316-9372-4066-8788-2343e6469739 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:47.377670 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1e35e316-9372-4066-8788-2343e6469739 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.084152 Jul 27 23:15:47.378229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1685/3180] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:47 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:47.930254 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-10c686bf-eed1-4b7c-9591-fc658bd98ccb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:47.930864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-10c686bf-eed1-4b7c-9591-fc658bd98ccb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:47.936919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10c686bf-eed1-4b7c-9591-fc658bd98ccb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:47.937365 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10c686bf-eed1-4b7c-9591-fc658bd98ccb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:47.938118 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10c686bf-eed1-4b7c-9591-fc658bd98ccb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:47.938550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10c686bf-eed1-4b7c-9591-fc658bd98ccb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:48.066764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-10c686bf-eed1-4b7c-9591-fc658bd98ccb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:48.074591 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-10c686bf-eed1-4b7c-9591-fc658bd98ccb tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148268 Jul 27 23:15:48.075140 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1496/3181] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:47 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:48.255989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-70090e7e-7361-419a-81f0-a9ace5506c47 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:48.256625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-70090e7e-7361-419a-81f0-a9ace5506c47 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:48.263145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70090e7e-7361-419a-81f0-a9ace5506c47 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:48.263592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70090e7e-7361-419a-81f0-a9ace5506c47 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:48.264347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70090e7e-7361-419a-81f0-a9ace5506c47 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:48.264804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70090e7e-7361-419a-81f0-a9ace5506c47 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:48.389651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-70090e7e-7361-419a-81f0-a9ace5506c47 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:48.397687 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-70090e7e-7361-419a-81f0-a9ace5506c47 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.146232 Jul 27 23:15:48.398216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d8accdc6-c3c6-41a1-b719-52474dfad0f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:48.398684 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1686/3182] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:48 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:48.399103 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d8accdc6-c3c6-41a1-b719-52474dfad0f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:48.405182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8accdc6-c3c6-41a1-b719-52474dfad0f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:48.405622 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8accdc6-c3c6-41a1-b719-52474dfad0f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:48.406364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8accdc6-c3c6-41a1-b719-52474dfad0f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:48.406789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d8accdc6-c3c6-41a1-b719-52474dfad0f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:48.469593 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d8accdc6-c3c6-41a1-b719-52474dfad0f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:48.477343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d8accdc6-c3c6-41a1-b719-52474dfad0f4 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082981 Jul 27 23:15:48.477901 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1497/3183] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:48 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:49.095907 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2e3fd31c-a636-43bf-8e42-d1ebf24adac9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:49.096509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2e3fd31c-a636-43bf-8e42-d1ebf24adac9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:49.098991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=82 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:49.104124 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e3fd31c-a636-43bf-8e42-d1ebf24adac9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:49.104584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e3fd31c-a636-43bf-8e42-d1ebf24adac9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:49.105335 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e3fd31c-a636-43bf-8e42-d1ebf24adac9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:49.105763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2e3fd31c-a636-43bf-8e42-d1ebf24adac9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:49.232823 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2e3fd31c-a636-43bf-8e42-d1ebf24adac9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:49.241040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2e3fd31c-a636-43bf-8e42-d1ebf24adac9 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148934 Jul 27 23:15:49.241600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1687/3184] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:49 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:49.418747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-52803f60-847f-46d1-b2c1-a04874b5c597 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:49.419278 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-52803f60-847f-46d1-b2c1-a04874b5c597 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:49.425855 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52803f60-847f-46d1-b2c1-a04874b5c597 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:49.426305 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52803f60-847f-46d1-b2c1-a04874b5c597 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:49.427062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52803f60-847f-46d1-b2c1-a04874b5c597 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:49.427501 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-52803f60-847f-46d1-b2c1-a04874b5c597 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:49.553388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-67872a40-605a-41dc-877f-d6b142d34fcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:49.554011 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-67872a40-605a-41dc-877f-d6b142d34fcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:49.554333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-52803f60-847f-46d1-b2c1-a04874b5c597 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:49.561165 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-67872a40-605a-41dc-877f-d6b142d34fcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:49.561612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-67872a40-605a-41dc-877f-d6b142d34fcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:49.562378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-67872a40-605a-41dc-877f-d6b142d34fcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:49.562493 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-52803f60-847f-46d1-b2c1-a04874b5c597 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.147672 Jul 27 23:15:49.562811 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-67872a40-605a-41dc-877f-d6b142d34fcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:49.568916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1498/3185] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:49 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:49.628036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-67872a40-605a-41dc-877f-d6b142d34fcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:49.637914 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-67872a40-605a-41dc-877f-d6b142d34fcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.088983 Jul 27 23:15:49.638474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1688/3186] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:49 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:50.262382 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d702f177-b785-4040-a8eb-63d006725b19 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:50.262998 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d702f177-b785-4040-a8eb-63d006725b19 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:50.269794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d702f177-b785-4040-a8eb-63d006725b19 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:50.270246 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d702f177-b785-4040-a8eb-63d006725b19 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:50.271003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d702f177-b785-4040-a8eb-63d006725b19 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:50.271441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d702f177-b785-4040-a8eb-63d006725b19 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:50.395707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d702f177-b785-4040-a8eb-63d006725b19 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:50.403611 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d702f177-b785-4040-a8eb-63d006725b19 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.145099 Jul 27 23:15:50.404220 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1499/3187] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:50 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:50.583089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bef66990-004c-422b-8a67-c709caceeec2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:50.583693 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bef66990-004c-422b-8a67-c709caceeec2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:50.590142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bef66990-004c-422b-8a67-c709caceeec2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:50.590581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bef66990-004c-422b-8a67-c709caceeec2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:50.591329 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bef66990-004c-422b-8a67-c709caceeec2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:50.591754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bef66990-004c-422b-8a67-c709caceeec2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:50.658442 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ed395faa-6553-4a3b-b8d6-42e14f453f59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:50.658988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ed395faa-6553-4a3b-b8d6-42e14f453f59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:50.665383 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed395faa-6553-4a3b-b8d6-42e14f453f59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:50.665823 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed395faa-6553-4a3b-b8d6-42e14f453f59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:50.666569 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed395faa-6553-4a3b-b8d6-42e14f453f59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:50.666995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ed395faa-6553-4a3b-b8d6-42e14f453f59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:50.742061 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ed395faa-6553-4a3b-b8d6-42e14f453f59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:50.746272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bef66990-004c-422b-8a67-c709caceeec2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:50.749832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ed395faa-6553-4a3b-b8d6-42e14f453f59 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.095269 Jul 27 23:15:50.750393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1500/3188] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:50 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:50.754708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bef66990-004c-422b-8a67-c709caceeec2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.175388 Jul 27 23:15:50.755265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1689/3189] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:50 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:51.424803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3d28a500-ba92-47b5-bc7e-0be63fa103db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:51.425329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3d28a500-ba92-47b5-bc7e-0be63fa103db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:51.427153 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=78 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:51.432308 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d28a500-ba92-47b5-bc7e-0be63fa103db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:51.432786 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d28a500-ba92-47b5-bc7e-0be63fa103db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:51.433561 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d28a500-ba92-47b5-bc7e-0be63fa103db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:51.433990 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3d28a500-ba92-47b5-bc7e-0be63fa103db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:51.562791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-3d28a500-ba92-47b5-bc7e-0be63fa103db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:51.571016 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3d28a500-ba92-47b5-bc7e-0be63fa103db tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.150143 Jul 27 23:15:51.571570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1501/3190] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:51 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:51.771733 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3ba0f260-8f74-448b-ba74-9da40b824a09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:51.772271 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3ba0f260-8f74-448b-ba74-9da40b824a09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:51.775724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b9bc2fd0-df5f-4ecb-9b41-a71078879cfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:51.776326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b9bc2fd0-df5f-4ecb-9b41-a71078879cfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:51.778756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3ba0f260-8f74-448b-ba74-9da40b824a09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:51.779202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3ba0f260-8f74-448b-ba74-9da40b824a09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:51.779957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3ba0f260-8f74-448b-ba74-9da40b824a09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:51.780388 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3ba0f260-8f74-448b-ba74-9da40b824a09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:51.782776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b9bc2fd0-df5f-4ecb-9b41-a71078879cfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:51.783217 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b9bc2fd0-df5f-4ecb-9b41-a71078879cfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:51.785268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b9bc2fd0-df5f-4ecb-9b41-a71078879cfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:51.785268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b9bc2fd0-df5f-4ecb-9b41-a71078879cfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:51.848370 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3ba0f260-8f74-448b-ba74-9da40b824a09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:51.856415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3ba0f260-8f74-448b-ba74-9da40b824a09 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.089201 Jul 27 23:15:51.857037 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1690/3191] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:51 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:51.933355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b9bc2fd0-df5f-4ecb-9b41-a71078879cfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:51.941739 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b9bc2fd0-df5f-4ecb-9b41-a71078879cfb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.169288 Jul 27 23:15:51.942296 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1502/3192] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:51 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:52.592484 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bb4f4e16-0a3b-4019-9e64-f2c0c52f7323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:52.593159 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bb4f4e16-0a3b-4019-9e64-f2c0c52f7323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:52.599751 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb4f4e16-0a3b-4019-9e64-f2c0c52f7323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:52.600202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb4f4e16-0a3b-4019-9e64-f2c0c52f7323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:52.600994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb4f4e16-0a3b-4019-9e64-f2c0c52f7323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:52.601431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bb4f4e16-0a3b-4019-9e64-f2c0c52f7323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:52.730110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bb4f4e16-0a3b-4019-9e64-f2c0c52f7323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:52.738229 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bb4f4e16-0a3b-4019-9e64-f2c0c52f7323 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.149681 Jul 27 23:15:52.738790 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1691/3193] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:52 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:52.877816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-020ff561-4710-4f03-a56a-395803bcce2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:52.878352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-020ff561-4710-4f03-a56a-395803bcce2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:52.888286 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-020ff561-4710-4f03-a56a-395803bcce2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:52.888760 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-020ff561-4710-4f03-a56a-395803bcce2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:52.889610 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-020ff561-4710-4f03-a56a-395803bcce2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:52.890049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-020ff561-4710-4f03-a56a-395803bcce2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:52.955062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-020ff561-4710-4f03-a56a-395803bcce2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:52.962336 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-102db640-f6d0-4a38-be4e-623fd01c7efd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:52.962970 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-020ff561-4710-4f03-a56a-395803bcce2b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.089266 Jul 27 23:15:52.963095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-102db640-f6d0-4a38-be4e-623fd01c7efd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:52.963532 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1503/3194] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:52 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:52.969442 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-102db640-f6d0-4a38-be4e-623fd01c7efd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:52.969884 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-102db640-f6d0-4a38-be4e-623fd01c7efd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:52.970635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-102db640-f6d0-4a38-be4e-623fd01c7efd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:52.971065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-102db640-f6d0-4a38-be4e-623fd01c7efd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:53.101151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-102db640-f6d0-4a38-be4e-623fd01c7efd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:53.109029 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-102db640-f6d0-4a38-be4e-623fd01c7efd tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.150514 Jul 27 23:15:53.109592 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1692/3195] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:52 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:53.759393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a17eb3b3-b2b4-46b0-8002-879b0ce03f74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:53.759907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a17eb3b3-b2b4-46b0-8002-879b0ce03f74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:53.766022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a17eb3b3-b2b4-46b0-8002-879b0ce03f74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:53.766466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a17eb3b3-b2b4-46b0-8002-879b0ce03f74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:53.767225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a17eb3b3-b2b4-46b0-8002-879b0ce03f74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:53.767662 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a17eb3b3-b2b4-46b0-8002-879b0ce03f74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:53.894454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a17eb3b3-b2b4-46b0-8002-879b0ce03f74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:53.902358 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a17eb3b3-b2b4-46b0-8002-879b0ce03f74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146980 Jul 27 23:15:53.902921 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1504/3196] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:53 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:53.983238 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e5e8911c-095b-4f0c-b680-e7e25bec6a18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:53.983864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e5e8911c-095b-4f0c-b680-e7e25bec6a18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:53.991404 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5e8911c-095b-4f0c-b680-e7e25bec6a18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:53.991854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5e8911c-095b-4f0c-b680-e7e25bec6a18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:53.992630 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5e8911c-095b-4f0c-b680-e7e25bec6a18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:53.993066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e5e8911c-095b-4f0c-b680-e7e25bec6a18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:54.055142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e5e8911c-095b-4f0c-b680-e7e25bec6a18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:54.063239 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e5e8911c-095b-4f0c-b680-e7e25bec6a18 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083805 Jul 27 23:15:54.063796 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1693/3197] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:53 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:54.130894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9a45a071-fe73-4bed-92d7-5c70df513e88 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:54.131536 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9a45a071-fe73-4bed-92d7-5c70df513e88 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:54.137643 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a45a071-fe73-4bed-92d7-5c70df513e88 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:54.138119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a45a071-fe73-4bed-92d7-5c70df513e88 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:54.138881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a45a071-fe73-4bed-92d7-5c70df513e88 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:54.139318 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9a45a071-fe73-4bed-92d7-5c70df513e88 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:54.270566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-9a45a071-fe73-4bed-92d7-5c70df513e88 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:54.278393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9a45a071-fe73-4bed-92d7-5c70df513e88 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.151345 Jul 27 23:15:54.278956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1505/3198] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:54 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:54.924010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d6a313c4-a370-4d1d-9c01-7881ddd753ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:54.924519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d6a313c4-a370-4d1d-9c01-7881ddd753ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:54.930556 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d6a313c4-a370-4d1d-9c01-7881ddd753ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:54.930997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d6a313c4-a370-4d1d-9c01-7881ddd753ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:54.931743 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d6a313c4-a370-4d1d-9c01-7881ddd753ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:54.932173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d6a313c4-a370-4d1d-9c01-7881ddd753ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:55.058311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d6a313c4-a370-4d1d-9c01-7881ddd753ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:55.066853 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d6a313c4-a370-4d1d-9c01-7881ddd753ae tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146137 Jul 27 23:15:55.067414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1694/3199] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:54 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:55.083103 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a8a5377b-6d26-4d52-bd9c-bb2610981072 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:55.083704 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a8a5377b-6d26-4d52-bd9c-bb2610981072 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:55.090659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8a5377b-6d26-4d52-bd9c-bb2610981072 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:55.091302 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8a5377b-6d26-4d52-bd9c-bb2610981072 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:55.092162 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8a5377b-6d26-4d52-bd9c-bb2610981072 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:55.092614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8a5377b-6d26-4d52-bd9c-bb2610981072 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:55.156856 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a8a5377b-6d26-4d52-bd9c-bb2610981072 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:55.164747 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a8a5377b-6d26-4d52-bd9c-bb2610981072 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.085568 Jul 27 23:15:55.165298 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1506/3200] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:55 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:55.299274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-49f2ed96-0430-420d-ab14-b9fd66221c8f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:55.299879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-49f2ed96-0430-420d-ab14-b9fd66221c8f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:55.305871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49f2ed96-0430-420d-ab14-b9fd66221c8f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:55.306324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49f2ed96-0430-420d-ab14-b9fd66221c8f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:55.307065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49f2ed96-0430-420d-ab14-b9fd66221c8f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:55.307498 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-49f2ed96-0430-420d-ab14-b9fd66221c8f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:55.433582 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-49f2ed96-0430-420d-ab14-b9fd66221c8f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:55.441883 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-49f2ed96-0430-420d-ab14-b9fd66221c8f tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.146041 Jul 27 23:15:55.442441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1695/3201] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:55 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:56.087150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-07ae2027-d713-4ec8-9c0b-75431d6fddd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:56.087762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-07ae2027-d713-4ec8-9c0b-75431d6fddd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:56.094724 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07ae2027-d713-4ec8-9c0b-75431d6fddd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:56.095190 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07ae2027-d713-4ec8-9c0b-75431d6fddd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:56.095933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07ae2027-d713-4ec8-9c0b-75431d6fddd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:56.096359 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-07ae2027-d713-4ec8-9c0b-75431d6fddd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:56.185906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6bb7f5ad-8879-4bee-b2d6-4c4079ff7edc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:56.186518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6bb7f5ad-8879-4bee-b2d6-4c4079ff7edc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:56.193050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bb7f5ad-8879-4bee-b2d6-4c4079ff7edc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:56.193495 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bb7f5ad-8879-4bee-b2d6-4c4079ff7edc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:56.194254 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bb7f5ad-8879-4bee-b2d6-4c4079ff7edc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:56.194704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6bb7f5ad-8879-4bee-b2d6-4c4079ff7edc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:56.233340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-07ae2027-d713-4ec8-9c0b-75431d6fddd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:56.242316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-07ae2027-d713-4ec8-9c0b-75431d6fddd5 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.158940 Jul 27 23:15:56.242887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1507/3202] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:56 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:56.263186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-6bb7f5ad-8879-4bee-b2d6-4c4079ff7edc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:56.271187 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6bb7f5ad-8879-4bee-b2d6-4c4079ff7edc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.089213 Jul 27 23:15:56.271744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1696/3203] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:56 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:56.463751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-94772b68-bb23-467d-ae95-584b47672e53 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:56.464362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-94772b68-bb23-467d-ae95-584b47672e53 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:56.470387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94772b68-bb23-467d-ae95-584b47672e53 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:56.470832 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94772b68-bb23-467d-ae95-584b47672e53 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:56.471587 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94772b68-bb23-467d-ae95-584b47672e53 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:56.472019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-94772b68-bb23-467d-ae95-584b47672e53 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:56.599156 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-94772b68-bb23-467d-ae95-584b47672e53 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:56.607056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-94772b68-bb23-467d-ae95-584b47672e53 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.147239 Jul 27 23:15:56.607614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1508/3204] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:56 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:57.263413 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c761f281-827f-4258-a6aa-7cf488bbef58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:57.264018 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c761f281-827f-4258-a6aa-7cf488bbef58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:57.270526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c761f281-827f-4258-a6aa-7cf488bbef58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:57.270968 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c761f281-827f-4258-a6aa-7cf488bbef58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:57.271716 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c761f281-827f-4258-a6aa-7cf488bbef58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:57.272143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c761f281-827f-4258-a6aa-7cf488bbef58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:57.275938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:57.291794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c51d1e0b-8376-461d-977d-c2c4417446fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:57.292426 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c51d1e0b-8376-461d-977d-c2c4417446fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:57.298906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c51d1e0b-8376-461d-977d-c2c4417446fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:57.299352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c51d1e0b-8376-461d-977d-c2c4417446fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:57.300115 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c51d1e0b-8376-461d-977d-c2c4417446fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:57.301084 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c51d1e0b-8376-461d-977d-c2c4417446fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:57.370709 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c51d1e0b-8376-461d-977d-c2c4417446fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:57.379297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c51d1e0b-8376-461d-977d-c2c4417446fb tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.090821 Jul 27 23:15:57.379867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1509/3205] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:57 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:57.424519 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-c761f281-827f-4258-a6aa-7cf488bbef58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:57.432971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c761f281-827f-4258-a6aa-7cf488bbef58 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.173390 Jul 27 23:15:57.433527 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1697/3206] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:57 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:57.627589 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b7578c6e-c5f2-4887-973a-b83c38fe40eb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:57.628202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b7578c6e-c5f2-4887-973a-b83c38fe40eb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:57.634807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7578c6e-c5f2-4887-973a-b83c38fe40eb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:57.635255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7578c6e-c5f2-4887-973a-b83c38fe40eb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:57.636012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7578c6e-c5f2-4887-973a-b83c38fe40eb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:57.636457 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7578c6e-c5f2-4887-973a-b83c38fe40eb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:57.762862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b7578c6e-c5f2-4887-973a-b83c38fe40eb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:57.770763 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b7578c6e-c5f2-4887-973a-b83c38fe40eb tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.147027 Jul 27 23:15:57.771327 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1510/3207] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:57 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:58.400274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-50f3c712-ca86-4f18-8496-4d75dc316d2e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:58.400911 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-50f3c712-ca86-4f18-8496-4d75dc316d2e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:58.407425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-50f3c712-ca86-4f18-8496-4d75dc316d2e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:58.407803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-50f3c712-ca86-4f18-8496-4d75dc316d2e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:58.408564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-50f3c712-ca86-4f18-8496-4d75dc316d2e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:58.408997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-50f3c712-ca86-4f18-8496-4d75dc316d2e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:58.454373 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-55fa7193-b8e5-469b-b576-543f55c33736 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:58.454988 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-55fa7193-b8e5-469b-b576-543f55c33736 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:58.462275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-55fa7193-b8e5-469b-b576-543f55c33736 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:58.462721 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-55fa7193-b8e5-469b-b576-543f55c33736 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:58.463512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-55fa7193-b8e5-469b-b576-543f55c33736 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:58.463944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-55fa7193-b8e5-469b-b576-543f55c33736 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:58.468521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-50f3c712-ca86-4f18-8496-4d75dc316d2e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:58.476428 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-50f3c712-ca86-4f18-8496-4d75dc316d2e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.079994 Jul 27 23:15:58.477241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1698/3208] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:58 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:58.592306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-55fa7193-b8e5-469b-b576-543f55c33736 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:58.600174 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-55fa7193-b8e5-469b-b576-543f55c33736 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.149612 Jul 27 23:15:58.600785 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1511/3209] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:58 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:15:58.791169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a0729bd8-4b0e-4437-aa4a-2761ce14daf4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:58.791780 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a0729bd8-4b0e-4437-aa4a-2761ce14daf4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:58.797848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0729bd8-4b0e-4437-aa4a-2761ce14daf4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:58.798297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0729bd8-4b0e-4437-aa4a-2761ce14daf4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:58.799057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0729bd8-4b0e-4437-aa4a-2761ce14daf4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:58.799497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0729bd8-4b0e-4437-aa4a-2761ce14daf4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:58.850566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:15:58.850821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:15:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:15:58.931295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a0729bd8-4b0e-4437-aa4a-2761ce14daf4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:58.939444 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a0729bd8-4b0e-4437-aa4a-2761ce14daf4 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.152103 Jul 27 23:15:58.940452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1699/3210] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:58 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:59.497317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-60a4cb39-a530-4610-94ff-77334d6e025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:59.497872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-60a4cb39-a530-4610-94ff-77334d6e025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:59.504672 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60a4cb39-a530-4610-94ff-77334d6e025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:59.505124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60a4cb39-a530-4610-94ff-77334d6e025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:59.505887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60a4cb39-a530-4610-94ff-77334d6e025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:59.506325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-60a4cb39-a530-4610-94ff-77334d6e025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:59.510303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:15:59.566978 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-60a4cb39-a530-4610-94ff-77334d6e025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:59.574714 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-60a4cb39-a530-4610-94ff-77334d6e025c tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.081336 Jul 27 23:15:59.575268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1512/3211] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:59 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:59.621297 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-264d8e31-4fcf-4537-9436-84c685556558 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:59.621904 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-264d8e31-4fcf-4537-9436-84c685556558 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:59.628313 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-264d8e31-4fcf-4537-9436-84c685556558 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:59.628798 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-264d8e31-4fcf-4537-9436-84c685556558 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:59.629572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-264d8e31-4fcf-4537-9436-84c685556558 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:59.630003 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-264d8e31-4fcf-4537-9436-84c685556558 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:59.756934 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-264d8e31-4fcf-4537-9436-84c685556558 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:15:59.764717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-264d8e31-4fcf-4537-9436-84c685556558 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147179 Jul 27 23:15:59.765278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1700/3212] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:59 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:15:59.961405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ce84ae14-3c9a-4df1-96bf-11bc008ba114 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:15:59.962012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ce84ae14-3c9a-4df1-96bf-11bc008ba114 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:15:59.967978 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce84ae14-3c9a-4df1-96bf-11bc008ba114 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:59.968422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce84ae14-3c9a-4df1-96bf-11bc008ba114 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:15:59.969205 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce84ae14-3c9a-4df1-96bf-11bc008ba114 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:15:59.969642 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ce84ae14-3c9a-4df1-96bf-11bc008ba114 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:00.095954 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ce84ae14-3c9a-4df1-96bf-11bc008ba114 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:00.104297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ce84ae14-3c9a-4df1-96bf-11bc008ba114 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.146740 Jul 27 23:16:00.104880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1513/3213] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:15:59 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:16:00.595246 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dc5d295a-da8b-4774-a29d-dd6bfa1f9563 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:00.595854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dc5d295a-da8b-4774-a29d-dd6bfa1f9563 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:00.602331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc5d295a-da8b-4774-a29d-dd6bfa1f9563 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:00.602781 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc5d295a-da8b-4774-a29d-dd6bfa1f9563 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:00.603532 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc5d295a-da8b-4774-a29d-dd6bfa1f9563 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:00.603965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dc5d295a-da8b-4774-a29d-dd6bfa1f9563 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:00.667357 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dc5d295a-da8b-4774-a29d-dd6bfa1f9563 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:00.675169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dc5d295a-da8b-4774-a29d-dd6bfa1f9563 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083791 Jul 27 23:16:00.676378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1701/3214] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:00 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:00.786689 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a1814885-29d0-41a5-8b89-2876008ade2a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:00.787301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a1814885-29d0-41a5-8b89-2876008ade2a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:00.793803 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1814885-29d0-41a5-8b89-2876008ade2a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:00.794260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1814885-29d0-41a5-8b89-2876008ade2a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:00.795019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1814885-29d0-41a5-8b89-2876008ade2a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:00.795464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a1814885-29d0-41a5-8b89-2876008ade2a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:00.924941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a1814885-29d0-41a5-8b89-2876008ade2a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:00.933355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a1814885-29d0-41a5-8b89-2876008ade2a tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.150986 Jul 27 23:16:00.933911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1514/3215] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:00 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:01.126821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-21fb9eb8-164a-40da-8fb7-0892c02ca843 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:01.127394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-21fb9eb8-164a-40da-8fb7-0892c02ca843 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:01.134605 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21fb9eb8-164a-40da-8fb7-0892c02ca843 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:01.135050 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21fb9eb8-164a-40da-8fb7-0892c02ca843 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:01.135946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21fb9eb8-164a-40da-8fb7-0892c02ca843 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:01.136380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-21fb9eb8-164a-40da-8fb7-0892c02ca843 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:01.264153 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-21fb9eb8-164a-40da-8fb7-0892c02ca843 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:01.272060 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-21fb9eb8-164a-40da-8fb7-0892c02ca843 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.149206 Jul 27 23:16:01.272649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1702/3216] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:01 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:01.696360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-661605b0-6de6-4022-9440-17be58a28aa2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:01.696990 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-661605b0-6de6-4022-9440-17be58a28aa2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:01.702965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-661605b0-6de6-4022-9440-17be58a28aa2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:01.703405 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-661605b0-6de6-4022-9440-17be58a28aa2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:01.704147 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-661605b0-6de6-4022-9440-17be58a28aa2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:01.704599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-661605b0-6de6-4022-9440-17be58a28aa2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:01.767667 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-661605b0-6de6-4022-9440-17be58a28aa2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:01.775999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-661605b0-6de6-4022-9440-17be58a28aa2 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083500 Jul 27 23:16:01.776574 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1515/3217] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:01 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:01.954122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8e867f39-3078-4aa7-8b77-0700e81387e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:01.954653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8e867f39-3078-4aa7-8b77-0700e81387e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:01.961650 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e867f39-3078-4aa7-8b77-0700e81387e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:01.962102 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e867f39-3078-4aa7-8b77-0700e81387e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:01.962855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e867f39-3078-4aa7-8b77-0700e81387e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:01.963290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8e867f39-3078-4aa7-8b77-0700e81387e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:02.089102 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8e867f39-3078-4aa7-8b77-0700e81387e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:02.097267 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8e867f39-3078-4aa7-8b77-0700e81387e3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.147021 Jul 27 23:16:02.097829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1703/3218] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:01 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:02.293123 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5dbec38a-8cbd-413d-9ad8-d65469d1ac18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:02.293740 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5dbec38a-8cbd-413d-9ad8-d65469d1ac18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:02.300355 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5dbec38a-8cbd-413d-9ad8-d65469d1ac18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:02.300841 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5dbec38a-8cbd-413d-9ad8-d65469d1ac18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:02.301595 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5dbec38a-8cbd-413d-9ad8-d65469d1ac18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:02.302030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5dbec38a-8cbd-413d-9ad8-d65469d1ac18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:02.426627 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5dbec38a-8cbd-413d-9ad8-d65469d1ac18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:02.434464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5dbec38a-8cbd-413d-9ad8-d65469d1ac18 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.145226 Jul 27 23:16:02.435021 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1516/3219] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:02 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:02.797087 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-daf41da8-6780-4461-b653-ad2c92dc4106 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:02.797698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-daf41da8-6780-4461-b653-ad2c92dc4106 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:02.804336 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-daf41da8-6780-4461-b653-ad2c92dc4106 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:02.804821 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-daf41da8-6780-4461-b653-ad2c92dc4106 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:02.805577 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-daf41da8-6780-4461-b653-ad2c92dc4106 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:02.806015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-daf41da8-6780-4461-b653-ad2c92dc4106 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:02.869726 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-daf41da8-6780-4461-b653-ad2c92dc4106 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:02.877579 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-daf41da8-6780-4461-b653-ad2c92dc4106 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.084371 Jul 27 23:16:02.878135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1704/3220] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:02 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:03.118546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7d69db61-277c-4635-ad47-ca3f506860e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:03.119180 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7d69db61-277c-4635-ad47-ca3f506860e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:03.125177 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7d69db61-277c-4635-ad47-ca3f506860e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:03.125619 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7d69db61-277c-4635-ad47-ca3f506860e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:03.126412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7d69db61-277c-4635-ad47-ca3f506860e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:03.126830 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7d69db61-277c-4635-ad47-ca3f506860e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:03.255587 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7d69db61-277c-4635-ad47-ca3f506860e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:03.263400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7d69db61-277c-4635-ad47-ca3f506860e0 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148759 Jul 27 23:16:03.263960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1517/3221] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:03 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:03.456408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bf62e679-3672-4c41-b6ea-ee268d2394f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:03.457010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bf62e679-3672-4c41-b6ea-ee268d2394f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:03.463672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf62e679-3672-4c41-b6ea-ee268d2394f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:03.464123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf62e679-3672-4c41-b6ea-ee268d2394f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:03.464908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf62e679-3672-4c41-b6ea-ee268d2394f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:03.465368 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf62e679-3672-4c41-b6ea-ee268d2394f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:03.592035 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-bf62e679-3672-4c41-b6ea-ee268d2394f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:03.600362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bf62e679-3672-4c41-b6ea-ee268d2394f9 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.147862 Jul 27 23:16:03.600956 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1705/3222] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:03 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:03.898018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cdcfa6ef-5cb6-4306-971f-de600ce4de3f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:03.898620 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cdcfa6ef-5cb6-4306-971f-de600ce4de3f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:03.905097 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cdcfa6ef-5cb6-4306-971f-de600ce4de3f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:03.905535 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cdcfa6ef-5cb6-4306-971f-de600ce4de3f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:03.906279 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cdcfa6ef-5cb6-4306-971f-de600ce4de3f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:03.906708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cdcfa6ef-5cb6-4306-971f-de600ce4de3f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:03.971754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cdcfa6ef-5cb6-4306-971f-de600ce4de3f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:03.980138 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cdcfa6ef-5cb6-4306-971f-de600ce4de3f tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.085945 Jul 27 23:16:03.980713 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1518/3223] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:03 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:04.283489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-86671c27-93b9-4115-af58-bdb1cecb7012 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:04.284100 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-86671c27-93b9-4115-af58-bdb1cecb7012 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:04.290773 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-86671c27-93b9-4115-af58-bdb1cecb7012 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:04.291214 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-86671c27-93b9-4115-af58-bdb1cecb7012 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:04.291965 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-86671c27-93b9-4115-af58-bdb1cecb7012 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:04.292395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-86671c27-93b9-4115-af58-bdb1cecb7012 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:04.416005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-86671c27-93b9-4115-af58-bdb1cecb7012 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:04.423950 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-86671c27-93b9-4115-af58-bdb1cecb7012 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.144334 Jul 27 23:16:04.424513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1706/3224] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:04 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:04.622260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-7020a98d-1113-48d0-9ecb-d9bde1f38233 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:04.622866 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-7020a98d-1113-48d0-9ecb-d9bde1f38233 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:04.629380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7020a98d-1113-48d0-9ecb-d9bde1f38233 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:04.629822 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7020a98d-1113-48d0-9ecb-d9bde1f38233 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:04.630569 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7020a98d-1113-48d0-9ecb-d9bde1f38233 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:04.631029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-7020a98d-1113-48d0-9ecb-d9bde1f38233 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:04.756108 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-7020a98d-1113-48d0-9ecb-d9bde1f38233 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:04.764056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-7020a98d-1113-48d0-9ecb-d9bde1f38233 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.145683 Jul 27 23:16:04.764640 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1519/3225] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:04 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:05.001318 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-38f2050f-80bd-4c82-b0f3-02f157a2fdcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:05.001914 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-38f2050f-80bd-4c82-b0f3-02f157a2fdcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:05.008352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-38f2050f-80bd-4c82-b0f3-02f157a2fdcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:05.009120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-38f2050f-80bd-4c82-b0f3-02f157a2fdcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:05.010489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-38f2050f-80bd-4c82-b0f3-02f157a2fdcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:05.010489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-38f2050f-80bd-4c82-b0f3-02f157a2fdcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:05.073256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-38f2050f-80bd-4c82-b0f3-02f157a2fdcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:05.081090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-38f2050f-80bd-4c82-b0f3-02f157a2fdcc tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.083905 Jul 27 23:16:05.082243 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1707/3226] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:04 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:05.445289 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-49041e91-700c-47cc-9553-1ae4e0013340 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:05.445911 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-49041e91-700c-47cc-9553-1ae4e0013340 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:05.452288 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-49041e91-700c-47cc-9553-1ae4e0013340 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:05.452759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-49041e91-700c-47cc-9553-1ae4e0013340 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:05.453506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-49041e91-700c-47cc-9553-1ae4e0013340 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:05.453933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-49041e91-700c-47cc-9553-1ae4e0013340 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:05.579161 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-49041e91-700c-47cc-9553-1ae4e0013340 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:05.587018 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-49041e91-700c-47cc-9553-1ae4e0013340 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146160 Jul 27 23:16:05.587573 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1520/3227] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:05 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:05.785797 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4548fd53-28c3-4c2d-8cd6-2685e8744789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:05.786316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4548fd53-28c3-4c2d-8cd6-2685e8744789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:05.792331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4548fd53-28c3-4c2d-8cd6-2685e8744789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:05.792809 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4548fd53-28c3-4c2d-8cd6-2685e8744789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:05.793565 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4548fd53-28c3-4c2d-8cd6-2685e8744789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:05.794000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4548fd53-28c3-4c2d-8cd6-2685e8744789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:05.919652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4548fd53-28c3-4c2d-8cd6-2685e8744789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:05.928065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4548fd53-28c3-4c2d-8cd6-2685e8744789 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.146162 Jul 27 23:16:05.928645 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1708/3228] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:05 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:06.102887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-300d581a-a77f-463d-9053-df9856025730 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:06.103495 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-300d581a-a77f-463d-9053-df9856025730 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:06.109462 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-300d581a-a77f-463d-9053-df9856025730 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:06.109908 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-300d581a-a77f-463d-9053-df9856025730 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:06.110659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-300d581a-a77f-463d-9053-df9856025730 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:06.111348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-300d581a-a77f-463d-9053-df9856025730 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:06.176348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-300d581a-a77f-463d-9053-df9856025730 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:06.184256 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-300d581a-a77f-463d-9053-df9856025730 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.085168 Jul 27 23:16:06.184845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1521/3229] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:06 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:06.607872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e4541f87-644b-423a-be09-342d8a6db63c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:06.608490 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e4541f87-644b-423a-be09-342d8a6db63c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:06.615292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4541f87-644b-423a-be09-342d8a6db63c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:06.615732 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4541f87-644b-423a-be09-342d8a6db63c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:06.616483 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4541f87-644b-423a-be09-342d8a6db63c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:06.616942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e4541f87-644b-423a-be09-342d8a6db63c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:06.742906 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e4541f87-644b-423a-be09-342d8a6db63c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:06.750705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e4541f87-644b-423a-be09-342d8a6db63c tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146730 Jul 27 23:16:06.751273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1709/3230] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:06 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:06.952895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-69fe0a4d-1eb6-42b5-b7b4-a2cf6f105195 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:06.953481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-69fe0a4d-1eb6-42b5-b7b4-a2cf6f105195 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:06.960373 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69fe0a4d-1eb6-42b5-b7b4-a2cf6f105195 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:06.960840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69fe0a4d-1eb6-42b5-b7b4-a2cf6f105195 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:06.961585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69fe0a4d-1eb6-42b5-b7b4-a2cf6f105195 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:06.962012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69fe0a4d-1eb6-42b5-b7b4-a2cf6f105195 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:07.088420 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-69fe0a4d-1eb6-42b5-b7b4-a2cf6f105195 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:07.096165 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-69fe0a4d-1eb6-42b5-b7b4-a2cf6f105195 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.147175 Jul 27 23:16:07.096735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1522/3231] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:06 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:07.204975 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3429a63c-82ef-4f85-8147-1d731dc897f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:07.205526 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3429a63c-82ef-4f85-8147-1d731dc897f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:07.211468 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3429a63c-82ef-4f85-8147-1d731dc897f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:07.211905 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3429a63c-82ef-4f85-8147-1d731dc897f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:07.212679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3429a63c-82ef-4f85-8147-1d731dc897f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:07.213107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3429a63c-82ef-4f85-8147-1d731dc897f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:07.275857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3429a63c-82ef-4f85-8147-1d731dc897f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:07.283731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3429a63c-82ef-4f85-8147-1d731dc897f1 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082930 Jul 27 23:16:07.284317 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1710/3232] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:07 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:07.772005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-ad3ec567-3575-437d-8913-20362627a700 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:07.772635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-ad3ec567-3575-437d-8913-20362627a700 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:07.778847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad3ec567-3575-437d-8913-20362627a700 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:07.779291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad3ec567-3575-437d-8913-20362627a700 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:07.780052 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad3ec567-3575-437d-8913-20362627a700 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:07.780487 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-ad3ec567-3575-437d-8913-20362627a700 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:07.904922 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-ad3ec567-3575-437d-8913-20362627a700 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:07.912876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-ad3ec567-3575-437d-8913-20362627a700 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.144675 Jul 27 23:16:07.913441 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1523/3233] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:07 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:08.117580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-20f39a98-8183-466e-a690-687e5db1116b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:08.118189 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-20f39a98-8183-466e-a690-687e5db1116b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:08.124525 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20f39a98-8183-466e-a690-687e5db1116b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:08.124992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20f39a98-8183-466e-a690-687e5db1116b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:08.125734 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20f39a98-8183-466e-a690-687e5db1116b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:08.126160 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-20f39a98-8183-466e-a690-687e5db1116b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:08.251129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-20f39a98-8183-466e-a690-687e5db1116b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:08.260970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-20f39a98-8183-466e-a690-687e5db1116b tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.147195 Jul 27 23:16:08.261528 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1711/3234] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:08 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:08.303863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-001d1f42-e921-439c-b574-b475fa23d1dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:08.304529 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-001d1f42-e921-439c-b574-b475fa23d1dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:08.311048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-001d1f42-e921-439c-b574-b475fa23d1dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:08.311491 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-001d1f42-e921-439c-b574-b475fa23d1dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:08.312241 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-001d1f42-e921-439c-b574-b475fa23d1dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:08.312706 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-001d1f42-e921-439c-b574-b475fa23d1dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:08.375930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-001d1f42-e921-439c-b574-b475fa23d1dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:08.384602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-001d1f42-e921-439c-b574-b475fa23d1dd tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.084531 Jul 27 23:16:08.385165 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1524/3235] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:08 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:08.934802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a797b66c-917e-40fd-886f-0580c3923e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:08.935327 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a797b66c-917e-40fd-886f-0580c3923e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:08.942030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a797b66c-917e-40fd-886f-0580c3923e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:08.942496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a797b66c-917e-40fd-886f-0580c3923e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:08.943282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a797b66c-917e-40fd-886f-0580c3923e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:08.943715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a797b66c-917e-40fd-886f-0580c3923e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:09.068888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a797b66c-917e-40fd-886f-0580c3923e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:09.076739 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a797b66c-917e-40fd-886f-0580c3923e49 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.145860 Jul 27 23:16:09.077310 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1712/3236] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:08 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:09.283418 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a3701301-c85e-44e5-bc8b-bc3fb19231d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:09.283944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a3701301-c85e-44e5-bc8b-bc3fb19231d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:09.289900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3701301-c85e-44e5-bc8b-bc3fb19231d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:09.290340 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3701301-c85e-44e5-bc8b-bc3fb19231d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:09.291081 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3701301-c85e-44e5-bc8b-bc3fb19231d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:09.291503 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a3701301-c85e-44e5-bc8b-bc3fb19231d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:09.405685 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ac75a908-df49-48c3-9c72-d25e9d282e3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:09.406292 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ac75a908-df49-48c3-9c72-d25e9d282e3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:09.412654 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ac75a908-df49-48c3-9c72-d25e9d282e3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:09.413103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ac75a908-df49-48c3-9c72-d25e9d282e3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:09.413854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ac75a908-df49-48c3-9c72-d25e9d282e3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:09.414516 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ac75a908-df49-48c3-9c72-d25e9d282e3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:09.416481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a3701301-c85e-44e5-bc8b-bc3fb19231d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:09.424348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a3701301-c85e-44e5-bc8b-bc3fb19231d3 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.144993 Jul 27 23:16:09.425022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1525/3237] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:09 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:09.477640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ac75a908-df49-48c3-9c72-d25e9d282e3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:09.479763 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=100 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:16:09.487138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ac75a908-df49-48c3-9c72-d25e9d282e3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.085252 Jul 27 23:16:09.488183 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1713/3238] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:09 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:16:10.098859 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-840a3a12-def6-424f-9c5b-2787e46ebcc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:10.099500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-840a3a12-def6-424f-9c5b-2787e46ebcc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:10.105513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-840a3a12-def6-424f-9c5b-2787e46ebcc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:10.105962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-840a3a12-def6-424f-9c5b-2787e46ebcc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:10.106712 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-840a3a12-def6-424f-9c5b-2787e46ebcc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:10.107154 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-840a3a12-def6-424f-9c5b-2787e46ebcc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:10.231124 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-840a3a12-def6-424f-9c5b-2787e46ebcc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:10.239499 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-840a3a12-def6-424f-9c5b-2787e46ebcc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.145342 Jul 27 23:16:10.240059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1526/3239] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:10 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:10.446803 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1e23a34b-4c6b-497f-b13e-051e43be7ba2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:10.447365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1e23a34b-4c6b-497f-b13e-051e43be7ba2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:10.453764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e23a34b-4c6b-497f-b13e-051e43be7ba2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:10.454203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e23a34b-4c6b-497f-b13e-051e43be7ba2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:10.454942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e23a34b-4c6b-497f-b13e-051e43be7ba2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:10.455371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e23a34b-4c6b-497f-b13e-051e43be7ba2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:10.507791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-bbe0fe1f-bfac-4049-a16b-4d054221dc8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:10.508402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-bbe0fe1f-bfac-4049-a16b-4d054221dc8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:10.515079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bbe0fe1f-bfac-4049-a16b-4d054221dc8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:10.515526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bbe0fe1f-bfac-4049-a16b-4d054221dc8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:10.516285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bbe0fe1f-bfac-4049-a16b-4d054221dc8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:10.516744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-bbe0fe1f-bfac-4049-a16b-4d054221dc8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:10.594211 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-bbe0fe1f-bfac-4049-a16b-4d054221dc8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:10.601997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-bbe0fe1f-bfac-4049-a16b-4d054221dc8b tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.098723 Jul 27 23:16:10.602566 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1527/3240] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:10 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:16:10.610161 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1e23a34b-4c6b-497f-b13e-051e43be7ba2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:10.618272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1e23a34b-4c6b-497f-b13e-051e43be7ba2 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.175590 Jul 27 23:16:10.618822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1714/3241] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:10 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:11.260250 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-72f3e844-7b84-487c-ae1c-037519f337cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:11.260889 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-72f3e844-7b84-487c-ae1c-037519f337cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:11.266949 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72f3e844-7b84-487c-ae1c-037519f337cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:11.267391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72f3e844-7b84-487c-ae1c-037519f337cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:11.268144 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72f3e844-7b84-487c-ae1c-037519f337cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:11.268600 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-72f3e844-7b84-487c-ae1c-037519f337cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:11.393347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-72f3e844-7b84-487c-ae1c-037519f337cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:11.395533 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=100 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:16:11.402488 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-72f3e844-7b84-487c-ae1c-037519f337cf tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.146098 Jul 27 23:16:11.403045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1528/3242] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:11 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:11.622563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4890f603-6d3e-44a7-94bb-bdfea27ca149 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:11.623171 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4890f603-6d3e-44a7-94bb-bdfea27ca149 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:11.629644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4890f603-6d3e-44a7-94bb-bdfea27ca149 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:11.630092 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4890f603-6d3e-44a7-94bb-bdfea27ca149 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:11.630846 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4890f603-6d3e-44a7-94bb-bdfea27ca149 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:11.631278 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4890f603-6d3e-44a7-94bb-bdfea27ca149 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:11.640438 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fc01675b-fe61-488c-aaab-b7ccad74818e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:11.641071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fc01675b-fe61-488c-aaab-b7ccad74818e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:11.648230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc01675b-fe61-488c-aaab-b7ccad74818e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:11.648705 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc01675b-fe61-488c-aaab-b7ccad74818e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:11.649461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc01675b-fe61-488c-aaab-b7ccad74818e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:11.649899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fc01675b-fe61-488c-aaab-b7ccad74818e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:11.693407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4890f603-6d3e-44a7-94bb-bdfea27ca149 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:11.701383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4890f603-6d3e-44a7-94bb-bdfea27ca149 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.082604 Jul 27 23:16:11.701953 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1715/3243] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:11 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:11.787734 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fc01675b-fe61-488c-aaab-b7ccad74818e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:11.795550 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fc01675b-fe61-488c-aaab-b7ccad74818e tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.159137 Jul 27 23:16:11.796109 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1529/3244] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:11 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:16:12.423875 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-01151e9e-7780-455d-9498-1e1fc30f7d2f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:12.424419 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-01151e9e-7780-455d-9498-1e1fc30f7d2f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:12.430616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01151e9e-7780-455d-9498-1e1fc30f7d2f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:12.431063 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01151e9e-7780-455d-9498-1e1fc30f7d2f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:12.431814 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01151e9e-7780-455d-9498-1e1fc30f7d2f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:12.432248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-01151e9e-7780-455d-9498-1e1fc30f7d2f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:12.559744 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-01151e9e-7780-455d-9498-1e1fc30f7d2f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:12.568112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-01151e9e-7780-455d-9498-1e1fc30f7d2f tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148202 Jul 27 23:16:12.568704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1716/3245] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:12 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:12.722620 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6937d4c6-c8a0-4c5d-b2ca-4aa859bc4a3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:12.723223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6937d4c6-c8a0-4c5d-b2ca-4aa859bc4a3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:12.729775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6937d4c6-c8a0-4c5d-b2ca-4aa859bc4a3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:12.730219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6937d4c6-c8a0-4c5d-b2ca-4aa859bc4a3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:12.730960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6937d4c6-c8a0-4c5d-b2ca-4aa859bc4a3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:12.731386 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6937d4c6-c8a0-4c5d-b2ca-4aa859bc4a3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:12.791201 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6937d4c6-c8a0-4c5d-b2ca-4aa859bc4a3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:12.798984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6937d4c6-c8a0-4c5d-b2ca-4aa859bc4a3e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.080378 Jul 27 23:16:12.799528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1530/3246] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:12 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:12.816935 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e364f323-43ba-4199-a10d-2abc10a5d6e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:12.817543 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e364f323-43ba-4199-a10d-2abc10a5d6e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:12.823576 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e364f323-43ba-4199-a10d-2abc10a5d6e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:12.824023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e364f323-43ba-4199-a10d-2abc10a5d6e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:12.824799 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e364f323-43ba-4199-a10d-2abc10a5d6e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:12.825237 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e364f323-43ba-4199-a10d-2abc10a5d6e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:12.955123 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e364f323-43ba-4199-a10d-2abc10a5d6e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:12.963569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e364f323-43ba-4199-a10d-2abc10a5d6e6 tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.150938 Jul 27 23:16:12.964136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1717/3247] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:12 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:13.589887 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-fb4638dc-5978-4992-8048-e7a31e2831af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:13.590528 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-fb4638dc-5978-4992-8048-e7a31e2831af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:13.596599 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb4638dc-5978-4992-8048-e7a31e2831af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:13.597549 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb4638dc-5978-4992-8048-e7a31e2831af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:13.598301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb4638dc-5978-4992-8048-e7a31e2831af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:13.598732 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-fb4638dc-5978-4992-8048-e7a31e2831af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:13.725766 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-fb4638dc-5978-4992-8048-e7a31e2831af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:13.734014 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-fb4638dc-5978-4992-8048-e7a31e2831af tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.148028 Jul 27 23:16:13.734570 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1531/3248] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:13 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:13.819206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b1e92d73-5726-40af-8ec2-71c95c4f4369 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:13.819819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b1e92d73-5726-40af-8ec2-71c95c4f4369 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: 9a5ccc96-6331-4ef5-a712-a72739545469] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:13.826352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1e92d73-5726-40af-8ec2-71c95c4f4369 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:13.826800 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1e92d73-5726-40af-8ec2-71c95c4f4369 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:13.827558 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1e92d73-5726-40af-8ec2-71c95c4f4369 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:13.827993 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b1e92d73-5726-40af-8ec2-71c95c4f4369 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:13.888606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b1e92d73-5726-40af-8ec2-71c95c4f4369 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:13.896957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b1e92d73-5726-40af-8ec2-71c95c4f4369 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469" status: 200 len: 1375 microversion: 2.1 time: 0.081539 Jul 27 23:16:13.897518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1718/3249] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:13 2022] GET /compute/v2.1/servers/9a5ccc96-6331-4ef5-a712-a72739545469 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:13.916815 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-06478a14-18e1-48c5-94dc-4c70099039d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '.version_select at 0x7f696a419430>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:13.937899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-06478a14-18e1-48c5-94dc-4c70099039d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-359978473" status: 202 len: 0 microversion: 2.1 time: 0.024819 Jul 27 23:16:13.938452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1532/3250] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Jul 27 23:16:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-359978473 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 23:16:13.984938 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fe9ee2d1-341d-4d66-8c11-d55382cfb48c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:13.985555 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fe9ee2d1-341d-4d66-8c11-d55382cfb48c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] [instance: b19fab65-5354-4383-ba3a-9eb6614382ff] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:13.991756 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fe9ee2d1-341d-4d66-8c11-d55382cfb48c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:13.992209 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fe9ee2d1-341d-4d66-8c11-d55382cfb48c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:13.993001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fe9ee2d1-341d-4d66-8c11-d55382cfb48c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:13.993443 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fe9ee2d1-341d-4d66-8c11-d55382cfb48c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:14.171439 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fe9ee2d1-341d-4d66-8c11-d55382cfb48c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325eac13d04548138b3d541fb4740c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002feda86f414d16b592aa9e3100b510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:14.189291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fe9ee2d1-341d-4d66-8c11-d55382cfb48c tempest-VolumesSnapshotTestJSON-702367403 tempest-VolumesSnapshotTestJSON-702367403-project] 10.222.0.47 "GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff" status: 200 len: 1559 microversion: 2.1 time: 0.208228 Jul 27 23:16:14.192663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1719/3251] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:13 2022] GET /compute/v2.1/servers/b19fab65-5354-4383-ba3a-9eb6614382ff => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:14.756237 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c013bf8a-27ae-4370-a0e9-65baca1e8dc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:14.756883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c013bf8a-27ae-4370-a0e9-65baca1e8dc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] [instance: 69a6fc53-bd93-47c4-9413-39ba0e1b6068] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:16:14.762792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c013bf8a-27ae-4370-a0e9-65baca1e8dc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:14.763244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c013bf8a-27ae-4370-a0e9-65baca1e8dc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:14.764004 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c013bf8a-27ae-4370-a0e9-65baca1e8dc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:16:14.764439 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c013bf8a-27ae-4370-a0e9-65baca1e8dc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:16:15.106166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c013bf8a-27ae-4370-a0e9-65baca1e8dc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f834cb4e134470286edcc0f1860f944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecdd80c027f419e93fc7de57dfd70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:16:15.114223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c013bf8a-27ae-4370-a0e9-65baca1e8dc3 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068" status: 200 len: 1599 microversion: 2.1 time: 0.363070 Jul 27 23:16:15.114789 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1533/3252] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:16:14 2022] GET /compute/v2.1/servers/69a6fc53-bd93-47c4-9413-39ba0e1b6068 => generated 1599 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:16:15.134395 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-895cfb22-01a4-457d-b899-00f1d5643c74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] Calling method '.version_select at 0x7f696a1d2ee0>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:16:15.153698 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-895cfb22-01a4-457d-b899-00f1d5643c74 tempest-TestMinimumBasicScenario-1503896919 tempest-TestMinimumBasicScenario-1503896919-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-395468210" status: 202 len: 0 microversion: 2.1 time: 0.023072 Jul 27 23:16:15.154844 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1720/3253] 10.222.0.47 () {58 vars in 1269 bytes} [Wed Jul 27 23:16:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-395468210 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 23:16:27.491525 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:16:27.492070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:16:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:17:41.413080 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:17:41.413754 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:17:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:17:41.891979 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:17:41.892568 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:17:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:18:14.766079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:18:14.766807 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=25 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:18:14.771186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b5231cea-1076-4db9-88bd-31deb95370c8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:18:14.771874 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b5231cea-1076-4db9-88bd-31deb95370c8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:18:14.780651 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b5231cea-1076-4db9-88bd-31deb95370c8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:14.781093 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b5231cea-1076-4db9-88bd-31deb95370c8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:14.782013 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b5231cea-1076-4db9-88bd-31deb95370c8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:14.782485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b5231cea-1076-4db9-88bd-31deb95370c8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:14.798999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-b5231cea-1076-4db9-88bd-31deb95370c8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] HTTP exception thrown: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b5231cea-1076-4db9-88bd-31deb95370c8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Request method failure captured: Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: DELETE /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 HTTP/1.1 Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cDt2jGYGP9avBKREaegGHX8ZTy2kz44enKKjyjO-15MlSubsYLgwLY9qqYsI5NH_p5bx2zZngNKDjFWu0Fetl0ijXLpmmj1jX_OleBvu1IrRI0woihJrHbEuWy7JlTiK66lBuoyBitOum2D6pploo6gdYnfSGwxZ7CPjAJ7dAswEvg Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 23:18:14.800767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 23:18:14.802688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_161af2d8dc8f4aa99d4cc112a89ff674", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:18:14.802688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:18:14.802688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 23:18:14.802688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:18:14.802688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 23:18:14.802688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 23:18:14.802688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 23:18:14.802688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 3aa05eaf07f14de6b6ef97f08e6e5123 Jul 27 23:18:14.802688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 23:18:14.802688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 23:18:14.802688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 23:18:14.802688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': 'f61a77c9-764c-4eca-a654-dabb4c208454'} Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:18:14.803835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 23:18:14.805500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:18:14.807285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b5231cea-1076-4db9-88bd-31deb95370c8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Returning 404 to user: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:18:14.807285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b5231cea-1076-4db9-88bd-31deb95370c8 tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 404 len: 111 microversion: 2.1 time: 0.038098 Jul 27 23:18:14.807285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1534/3254] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:18:14 2022] DELETE /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:18:14.811496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1e27bdd-8070-4868-b83d-939a4f8f9725] AMQP server on 10.222.0.47:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 27 23:18:14.812656 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=37 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:18:14.814237 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:18:14.821177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-274fb86a-fdf1-452e-88dc-9f64ba7104bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:18:14.822323 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-274fb86a-fdf1-452e-88dc-9f64ba7104bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] [instance: f61a77c9-764c-4eca-a654-dabb4c208454] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:18:14.834350 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-274fb86a-fdf1-452e-88dc-9f64ba7104bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:14.834817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-274fb86a-fdf1-452e-88dc-9f64ba7104bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:14.835618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-274fb86a-fdf1-452e-88dc-9f64ba7104bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:14.836244 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-274fb86a-fdf1-452e-88dc-9f64ba7104bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:14.852753 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-274fb86a-fdf1-452e-88dc-9f64ba7104bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] HTTP exception thrown: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-274fb86a-fdf1-452e-88dc-9f64ba7104bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Request method failure captured: Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 HTTP/1.1 Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cDt2jGYGP9avBKREaegGHX8ZTy2kz44enKKjyjO-15MlSubsYLgwLY9qqYsI5NH_p5bx2zZngNKDjFWu0Fetl0ijXLpmmj1jX_OleBvu1IrRI0woihJrHbEuWy7JlTiK66lBuoyBitOum2D6pploo6gdYnfSGwxZ7CPjAJ7dAswEvg Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:18:14.854825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:18:14.856764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_161af2d8dc8f4aa99d4cc112a89ff674", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/161af2d8dc8f4aa99d4cc112a89ff674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:18:14.856764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:18:14.856764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 161af2d8dc8f4aa99d4cc112a89ff674 Jul 27 23:18:14.856764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1470603407 Jul 27 23:18:14.856764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 23:18:14.856764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:18:14.856764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:18:14.856764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 3aa05eaf07f14de6b6ef97f08e6e5123 Jul 27 23:18:14.856764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-AttachVolumeTestJSON-1470603407-project Jul 27 23:18:14.856764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:18:14.856764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 23:18:14.856764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': 'f61a77c9-764c-4eca-a654-dabb4c208454'} Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:18:14.857808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. Jul 27 23:18:14.859269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:18:14.860624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-274fb86a-fdf1-452e-88dc-9f64ba7104bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] Returning 404 to user: Instance f61a77c9-764c-4eca-a654-dabb4c208454 could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:18:14.860624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-274fb86a-fdf1-452e-88dc-9f64ba7104bf tempest-AttachVolumeTestJSON-1470603407 tempest-AttachVolumeTestJSON-1470603407-project] 10.222.0.47 "GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454" status: 404 len: 111 microversion: 2.1 time: 0.047505 Jul 27 23:18:14.860624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1721/3255] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:18:14 2022] GET /compute/v2.1/servers/f61a77c9-764c-4eca-a654-dabb4c208454 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:18:23.256606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2ba36524-5fab-4f2d-b017-a15ff103d17d] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 27 23:18:23.362544 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c6cf2729-f430-4fed-b0ec-0f042c792101 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Action: 'create', calling method: .version_select at 0x7f696a24ab80>, body: {"keypair": {"name": "tempest-keypair-1169179453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI8FoqFwhz/pIh9IZJ83JdMR1DgvGAGOlyAOM13eNUoM30++zlI1TpgMONyTir6s2sxEqqInV1PEBu8KEfwR8XdEZJknr4u9BNY5c3EISE1gUEoJFFMs/OfwqOk1a/sYw=="}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:18:23.377655 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-c6cf2729-f430-4fed-b0ec-0f042c792101 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Getting quotas for project 62cccac090ad43059d82b81818434339. Resources: {'key_pairs'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 23:18:23.381465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-c6cf2729-f430-4fed-b0ec-0f042c792101 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Getting quotas for user 0fe603e45401486f873e7b908c8fff7d and project 62cccac090ad43059d82b81818434339. Resources: {'key_pairs'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 23:18:23.404114 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c6cf2729-f430-4fed-b0ec-0f042c792101 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152517 Jul 27 23:18:23.404710 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1535/3256] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 23:18:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:18:24.913329 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2062366481", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95bd9310-0f69-4035-a95b-5a1cc2c85c93"}], "security_groups": [{"name": "tempest-securitygroup--1588375060"}], "key_name": "tempest-keypair-1169179453", "user_data": "}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:18:24.923145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:18:24.924511 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:18:24.942946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1e27bdd-8070-4868-b83d-939a4f8f9725] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 44002. Jul 27 23:18:25.034202 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.network.neutron [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] validate_networks() for [('95bd9310-0f69-4035-a95b-5a1cc2c85c93', None, None, None, None, None)] {{(pid=129295) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 23:18:25.504700 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Flavor limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 23:18:25.505112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Image limits 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 23:18:25.505792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Flavor pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 23:18:25.506191 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Image pref 0:0:0 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 23:18:25.506593 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.virt.hardware [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 23:18:25.515704 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:25.516072 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:25.516878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:25.517309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:25.533724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Getting quotas for project 62cccac090ad43059d82b81818434339. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 23:18:25.537659 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Getting quotas for user 0fe603e45401486f873e7b908c8fff7d and project 62cccac090ad43059d82b81818434339. Resources: {'ram', 'cores', 'instances'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 23:18:25.548960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Going to run 1 instances... {{(pid=129295) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 23:18:25.551182 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 23:18:25.599974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4c3d63fb-8965-42cc-abea-628cb25ca615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.691111 Jul 27 23:18:25.606921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1722/3257] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 23:18:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 23:18:25.610385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=2 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:18:25.616277 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-743b801c-2b37-447d-98b5-718f17cd6cb9 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:18:25.616914 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-743b801c-2b37-447d-98b5-718f17cd6cb9 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:18:25.635199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2ba36524-5fab-4f2d-b017-a15ff103d17d] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 44020. Jul 27 23:18:25.701849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-743b801c-2b37-447d-98b5-718f17cd6cb9 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:18:25.710659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-743b801c-2b37-447d-98b5-718f17cd6cb9 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 200 len: 1242 microversion: 2.1 time: 0.102516 Jul 27 23:18:25.714930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1536/3258] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:18:25 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:18:26.731985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-9ad1ed66-0b33-48a8-b8e6-816b13494e6e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:18:26.732672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-9ad1ed66-0b33-48a8-b8e6-816b13494e6e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:18:26.739973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9ad1ed66-0b33-48a8-b8e6-816b13494e6e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:26.740420 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9ad1ed66-0b33-48a8-b8e6-816b13494e6e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:26.741205 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9ad1ed66-0b33-48a8-b8e6-816b13494e6e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:26.741642 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-9ad1ed66-0b33-48a8-b8e6-816b13494e6e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:26.801863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-9ad1ed66-0b33-48a8-b8e6-816b13494e6e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:18:26.809877 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-9ad1ed66-0b33-48a8-b8e6-816b13494e6e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 200 len: 1294 microversion: 2.1 time: 0.082297 Jul 27 23:18:26.810615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1723/3259] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:18:26 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:18:27.831100 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c49475c8-01cd-4103-b971-f9c8749a3e32 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:18:27.831718 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c49475c8-01cd-4103-b971-f9c8749a3e32 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:18:27.838762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c49475c8-01cd-4103-b971-f9c8749a3e32 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:27.839216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c49475c8-01cd-4103-b971-f9c8749a3e32 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:27.840167 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c49475c8-01cd-4103-b971-f9c8749a3e32 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:27.840635 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c49475c8-01cd-4103-b971-f9c8749a3e32 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:27.978172 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c49475c8-01cd-4103-b971-f9c8749a3e32 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:18:27.985759 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c49475c8-01cd-4103-b971-f9c8749a3e32 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 200 len: 1368 microversion: 2.1 time: 0.159044 Jul 27 23:18:27.986326 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1537/3260] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:18:27 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:18:28.419689 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-6a1f2fdd-4070-4f9e-a30d-85e7ba929a06 req-2fa24762-fd37-44ef-b510-41d585610a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7144f46-2169-40af-94a2-6d93b1dca4ed", "tag": "97a8c4af-4cbe-48a0-8daa-3dc90578b211"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:18:28.431471 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-6a1f2fdd-4070-4f9e-a30d-85e7ba929a06 req-2fa24762-fd37-44ef-b510-41d585610a79 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:28.432224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-6a1f2fdd-4070-4f9e-a30d-85e7ba929a06 req-2fa24762-fd37-44ef-b510-41d585610a79 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:28.444742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-6a1f2fdd-4070-4f9e-a30d-85e7ba929a06 req-2fa24762-fd37-44ef-b510-41d585610a79 service nova] Creating event network-changed:97a8c4af-4cbe-48a0-8daa-3dc90578b211 for instance a7144f46-2169-40af-94a2-6d93b1dca4ed on hv-cinder-85124 Jul 27 23:18:28.450377 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-6a1f2fdd-4070-4f9e-a30d-85e7ba929a06 req-2fa24762-fd37-44ef-b510-41d585610a79 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106813 Jul 27 23:18:28.451518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1724/3261] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:18:29.007603 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a32693d8-5494-4dc8-97ac-0b3c51dd3c26 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:18:29.008208 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a32693d8-5494-4dc8-97ac-0b3c51dd3c26 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:18:29.015583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a32693d8-5494-4dc8-97ac-0b3c51dd3c26 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:29.016028 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a32693d8-5494-4dc8-97ac-0b3c51dd3c26 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:29.016868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a32693d8-5494-4dc8-97ac-0b3c51dd3c26 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:29.017255 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a32693d8-5494-4dc8-97ac-0b3c51dd3c26 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:29.144942 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a32693d8-5494-4dc8-97ac-0b3c51dd3c26 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:18:29.152309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a32693d8-5494-4dc8-97ac-0b3c51dd3c26 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 200 len: 1368 microversion: 2.1 time: 0.148551 Jul 27 23:18:29.152923 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1538/3262] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:18:29 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:18:30.175299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-2b09184c-9219-4d75-84bc-96a33a6e3245 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:18:30.175959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-2b09184c-9219-4d75-84bc-96a33a6e3245 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:18:30.182822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b09184c-9219-4d75-84bc-96a33a6e3245 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:30.183266 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b09184c-9219-4d75-84bc-96a33a6e3245 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:30.184027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b09184c-9219-4d75-84bc-96a33a6e3245 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:30.184458 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-2b09184c-9219-4d75-84bc-96a33a6e3245 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:30.316855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-2b09184c-9219-4d75-84bc-96a33a6e3245 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:18:30.324919 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-2b09184c-9219-4d75-84bc-96a33a6e3245 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 200 len: 1368 microversion: 2.1 time: 0.154312 Jul 27 23:18:30.325474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1725/3263] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:18:30 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:18:31.346692 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f03584ad-0c09-4e98-aa9c-4dcd6bff1f2b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:18:31.347291 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f03584ad-0c09-4e98-aa9c-4dcd6bff1f2b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:18:31.354348 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f03584ad-0c09-4e98-aa9c-4dcd6bff1f2b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:31.354783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f03584ad-0c09-4e98-aa9c-4dcd6bff1f2b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:31.355534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f03584ad-0c09-4e98-aa9c-4dcd6bff1f2b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:31.355956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f03584ad-0c09-4e98-aa9c-4dcd6bff1f2b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:31.485235 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f03584ad-0c09-4e98-aa9c-4dcd6bff1f2b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:18:31.492751 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f03584ad-0c09-4e98-aa9c-4dcd6bff1f2b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 200 len: 1368 microversion: 2.1 time: 0.150518 Jul 27 23:18:31.493902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1539/3264] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:18:31 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:18:32.514447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e52ba1aa-2b15-4398-8d64-6e71329e89dc tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:18:32.514985 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e52ba1aa-2b15-4398-8d64-6e71329e89dc tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:18:32.521390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e52ba1aa-2b15-4398-8d64-6e71329e89dc tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:32.521829 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e52ba1aa-2b15-4398-8d64-6e71329e89dc tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:32.522572 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e52ba1aa-2b15-4398-8d64-6e71329e89dc tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:32.523000 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e52ba1aa-2b15-4398-8d64-6e71329e89dc tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:32.649394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e52ba1aa-2b15-4398-8d64-6e71329e89dc tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:18:32.656771 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e52ba1aa-2b15-4398-8d64-6e71329e89dc tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 200 len: 1368 microversion: 2.1 time: 0.146053 Jul 27 23:18:32.657320 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1726/3265] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:18:32 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:18:32.887380 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-08e4eaa6-e6ed-454a-a775-63c7ef5801dc req-842e8dcc-a269-42c1-8e41-cde805be5628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7144f46-2169-40af-94a2-6d93b1dca4ed", "name": "network-vif-plugged", "status": "completed", "tag": "97a8c4af-4cbe-48a0-8daa-3dc90578b211"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:18:32.896845 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-08e4eaa6-e6ed-454a-a775-63c7ef5801dc req-842e8dcc-a269-42c1-8e41-cde805be5628 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:32.897280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-08e4eaa6-e6ed-454a-a775-63c7ef5801dc req-842e8dcc-a269-42c1-8e41-cde805be5628 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:32.907847 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-08e4eaa6-e6ed-454a-a775-63c7ef5801dc req-842e8dcc-a269-42c1-8e41-cde805be5628 service nova] Creating event network-vif-plugged:97a8c4af-4cbe-48a0-8daa-3dc90578b211 for instance a7144f46-2169-40af-94a2-6d93b1dca4ed on hv-cinder-85124 Jul 27 23:18:32.913819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-08e4eaa6-e6ed-454a-a775-63c7ef5801dc req-842e8dcc-a269-42c1-8e41-cde805be5628 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084328 Jul 27 23:18:32.914385 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1540/3266] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:18:33.677169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d3352aaa-1bc1-42db-82ee-794f0c601bfb tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:18:33.677722 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d3352aaa-1bc1-42db-82ee-794f0c601bfb tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:18:33.684177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d3352aaa-1bc1-42db-82ee-794f0c601bfb tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:33.684653 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d3352aaa-1bc1-42db-82ee-794f0c601bfb tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:33.685405 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d3352aaa-1bc1-42db-82ee-794f0c601bfb tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:33.685840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d3352aaa-1bc1-42db-82ee-794f0c601bfb tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:33.820635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d3352aaa-1bc1-42db-82ee-794f0c601bfb tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:18:33.828410 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d3352aaa-1bc1-42db-82ee-794f0c601bfb tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 200 len: 1368 microversion: 2.1 time: 0.155176 Jul 27 23:18:33.828991 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1727/3267] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:18:33 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:18:34.850146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c223bcb8-2476-4cfd-97b4-1d6204a2d26d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:18:34.850862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c223bcb8-2476-4cfd-97b4-1d6204a2d26d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:18:34.857542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c223bcb8-2476-4cfd-97b4-1d6204a2d26d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:34.857982 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c223bcb8-2476-4cfd-97b4-1d6204a2d26d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:34.858723 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c223bcb8-2476-4cfd-97b4-1d6204a2d26d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:34.859150 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c223bcb8-2476-4cfd-97b4-1d6204a2d26d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:34.987126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c223bcb8-2476-4cfd-97b4-1d6204a2d26d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:18:34.994775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c223bcb8-2476-4cfd-97b4-1d6204a2d26d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 200 len: 1558 microversion: 2.1 time: 0.149277 Jul 27 23:18:34.995343 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1541/3268] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:18:34 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:18:35.014707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-05d5fe94-c5af-4770-9533-bbfb5f021b98 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:18:35.015204 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-05d5fe94-c5af-4770-9533-bbfb5f021b98 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:18:35.021616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05d5fe94-c5af-4770-9533-bbfb5f021b98 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:35.022062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05d5fe94-c5af-4770-9533-bbfb5f021b98 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:35.022812 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05d5fe94-c5af-4770-9533-bbfb5f021b98 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:35.023245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-05d5fe94-c5af-4770-9533-bbfb5f021b98 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:35.098879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-05d5fe94-c5af-4770-9533-bbfb5f021b98 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087913 Jul 27 23:18:35.099475 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1728/3269] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 23:18:35 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:18:36.013783 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=6 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:18:36.068825 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-2843bba5-b032-4c29-b18e-b6040a8581c6 req-509ae844-40ca-42bf-9bc8-a18c28f6cab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7144f46-2169-40af-94a2-6d93b1dca4ed", "tag": "97a8c4af-4cbe-48a0-8daa-3dc90578b211"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:18:36.079203 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-2843bba5-b032-4c29-b18e-b6040a8581c6 req-509ae844-40ca-42bf-9bc8-a18c28f6cab3 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:18:36.079636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-2843bba5-b032-4c29-b18e-b6040a8581c6 req-509ae844-40ca-42bf-9bc8-a18c28f6cab3 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:18:36.091402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-2843bba5-b032-4c29-b18e-b6040a8581c6 req-509ae844-40ca-42bf-9bc8-a18c28f6cab3 service nova] Creating event network-changed:97a8c4af-4cbe-48a0-8daa-3dc90578b211 for instance a7144f46-2169-40af-94a2-6d93b1dca4ed on hv-cinder-85124 Jul 27 23:18:36.096453 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-2843bba5-b032-4c29-b18e-b6040a8581c6 req-509ae844-40ca-42bf-9bc8-a18c28f6cab3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087771 Jul 27 23:18:36.097258 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1542/3270] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:19:12.105628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:19:12.106463 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=6 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:19:12.107759 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:19:12.108414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=32 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:19:12.112414 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1986b1da-98a4-45bd-914a-afeac968cd9b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:19:12.113179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1986b1da-98a4-45bd-914a-afeac968cd9b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:19:12.121711 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1986b1da-98a4-45bd-914a-afeac968cd9b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:19:12.122158 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1986b1da-98a4-45bd-914a-afeac968cd9b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:19:12.122908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1986b1da-98a4-45bd-914a-afeac968cd9b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:19:12.123341 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1986b1da-98a4-45bd-914a-afeac968cd9b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:19:12.146629 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1986b1da-98a4-45bd-914a-afeac968cd9b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed/ips" status: 200 len: 149 microversion: 2.1 time: 0.042367 Jul 27 23:19:12.147186 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1729/3271] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 23:19:12 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:19:22.166308 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:19:22.166861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:19:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:20:12.220003 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:20:12.220771 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=28 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:20:12.225164 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-af153288-5d64-40b7-a484-a8f408235213 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:12.225737 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-af153288-5d64-40b7-a484-a8f408235213 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:12.233953 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af153288-5d64-40b7-a484-a8f408235213 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:12.234403 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af153288-5d64-40b7-a484-a8f408235213 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:12.235152 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af153288-5d64-40b7-a484-a8f408235213 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:12.235584 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-af153288-5d64-40b7-a484-a8f408235213 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:12.260538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-af153288-5d64-40b7-a484-a8f408235213 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Going to try to terminate instance {{(pid=129294) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 23:20:12.334321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-af153288-5d64-40b7-a484-a8f408235213 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 204 len: 0 microversion: 2.1 time: 0.116277 Jul 27 23:20:12.335106 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1543/3272] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:20:12 2022] DELETE /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 23:20:12.341624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:20:12.342385 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=4 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:20:12.346283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fbcb7409-b63d-433a-9d5d-88803bed9b2d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:12.346939 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fbcb7409-b63d-433a-9d5d-88803bed9b2d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:12.353721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fbcb7409-b63d-433a-9d5d-88803bed9b2d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:12.354169 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fbcb7409-b63d-433a-9d5d-88803bed9b2d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:12.355437 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fbcb7409-b63d-433a-9d5d-88803bed9b2d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:12.355871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fbcb7409-b63d-433a-9d5d-88803bed9b2d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:12.564707 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fbcb7409-b63d-433a-9d5d-88803bed9b2d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:20:12.572084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fbcb7409-b63d-433a-9d5d-88803bed9b2d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 200 len: 1682 microversion: 2.1 time: 0.232102 Jul 27 23:20:12.572663 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1730/3273] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:12 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 1682 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:20:13.594791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c4f61079-e49c-4c89-8487-19f13f356e1e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:13.595476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c4f61079-e49c-4c89-8487-19f13f356e1e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:13.601811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4f61079-e49c-4c89-8487-19f13f356e1e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:13.602254 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4f61079-e49c-4c89-8487-19f13f356e1e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:13.602997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4f61079-e49c-4c89-8487-19f13f356e1e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:13.603422 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c4f61079-e49c-4c89-8487-19f13f356e1e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:13.784860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c4f61079-e49c-4c89-8487-19f13f356e1e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:20:13.793280 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c4f61079-e49c-4c89-8487-19f13f356e1e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 200 len: 1682 microversion: 2.1 time: 0.202671 Jul 27 23:20:13.793885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1544/3274] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:13 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:20:14.814493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-ba56d3ce-37a4-47b9-af47-e73a6a0a9b1d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:14.815105 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-ba56d3ce-37a4-47b9-af47-e73a6a0a9b1d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:14.821971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba56d3ce-37a4-47b9-af47-e73a6a0a9b1d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:14.822416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba56d3ce-37a4-47b9-af47-e73a6a0a9b1d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:14.823854 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba56d3ce-37a4-47b9-af47-e73a6a0a9b1d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:14.824290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-ba56d3ce-37a4-47b9-af47-e73a6a0a9b1d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:14.892477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-ba56d3ce-37a4-47b9-af47-e73a6a0a9b1d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:20:14.902311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-ba56d3ce-37a4-47b9-af47-e73a6a0a9b1d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 200 len: 1614 microversion: 2.1 time: 0.091137 Jul 27 23:20:14.902680 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1731/3275] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:14 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:20:14.952530 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-481da0ad-8c68-401c-b448-4cec5abf43f3 req-e65dd28f-60b1-46a1-be59-0f361e0f8362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7144f46-2169-40af-94a2-6d93b1dca4ed", "name": "network-vif-deleted", "tag": "97a8c4af-4cbe-48a0-8daa-3dc90578b211"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:20:14.963962 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-481da0ad-8c68-401c-b448-4cec5abf43f3 req-e65dd28f-60b1-46a1-be59-0f361e0f8362 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:14.964709 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-481da0ad-8c68-401c-b448-4cec5abf43f3 req-e65dd28f-60b1-46a1-be59-0f361e0f8362 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:14.991397 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-481da0ad-8c68-401c-b448-4cec5abf43f3 req-e65dd28f-60b1-46a1-be59-0f361e0f8362 service nova] Creating event network-vif-deleted:97a8c4af-4cbe-48a0-8daa-3dc90578b211 for instance a7144f46-2169-40af-94a2-6d93b1dca4ed on hv-cinder-85124 Jul 27 23:20:15.002571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-481da0ad-8c68-401c-b448-4cec5abf43f3 req-e65dd28f-60b1-46a1-be59-0f361e0f8362 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054287 Jul 27 23:20:15.003173 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1545/3276] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:20:15.320381 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c96e7c46-65fe-4e01-9686-ea11aeebf992 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:15.321164 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-c96e7c46-65fe-4e01-9686-ea11aeebf992 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:15.328696 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c96e7c46-65fe-4e01-9686-ea11aeebf992 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:15.329113 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c96e7c46-65fe-4e01-9686-ea11aeebf992 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:15.330091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c96e7c46-65fe-4e01-9686-ea11aeebf992 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:15.330834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-c96e7c46-65fe-4e01-9686-ea11aeebf992 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:15.346819 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-c96e7c46-65fe-4e01-9686-ea11aeebf992 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] HTTP exception thrown: Instance e457f5fc-ae83-4b88-87be-ba1007c5865e could not be found. Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c96e7c46-65fe-4e01-9686-ea11aeebf992 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Request method failure captured: Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: DELETE /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e HTTP/1.1 Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cDv1fgJXsCQ367hlkfbdy7_aF-GgajmNo48KEhXU3sOmci0R6PIoILwJ9otstrCU4xECyUgYlbPwRnfHz_orgOPqIQAEPi2rXWNdR68mzoCl_EJZ_E_UmV4xv9NhF92_iS6PFjgjvqGQlUXvFZSUkhi1-s4n18VxZnhkGbSDsJ3BEE Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 0d65941ddb4346e0b3fdc6b751a6aa07 Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:20:15.349041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:20:15.351135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0d65941ddb4346e0b3fdc6b751a6aa07", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:20:15.351135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:20:15.351135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 0d65941ddb4346e0b3fdc6b751a6aa07 Jul 27 23:20:15.351135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:20:15.351135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-AttachVolumeShelveTestJSON-2081014947-project Jul 27 23:20:15.351135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:20:15.351135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:20:15.351135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 51db745daefd448b80630ef1bceca4c4 Jul 27 23:20:15.351135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2081014947-project Jul 27 23:20:15.351135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:20:15.351135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance e457f5fc-ae83-4b88-87be-ba1007c5865e could not be found. Jul 27 23:20:15.351135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': 'e457f5fc-ae83-4b88-87be-ba1007c5865e'} Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e457f5fc-ae83-4b88-87be-ba1007c5865e could not be found. Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:20:15.352431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e457f5fc-ae83-4b88-87be-ba1007c5865e could not be found. Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e457f5fc-ae83-4b88-87be-ba1007c5865e could not be found. Jul 27 23:20:15.354065 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.357472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-c96e7c46-65fe-4e01-9686-ea11aeebf992 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Returning 404 to user: Instance e457f5fc-ae83-4b88-87be-ba1007c5865e could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:20:15.358324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-c96e7c46-65fe-4e01-9686-ea11aeebf992 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 404 len: 111 microversion: 2.20 time: 0.042024 Jul 27 23:20:15.358932 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1732/3277] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Jul 27 23:20:15 2022] DELETE /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 23:20:15.371699 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2deed8ef-50e6-4e2f-ae57-6fd2a1e806d0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:15.373369 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-2deed8ef-50e6-4e2f-ae57-6fd2a1e806d0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] [instance: e457f5fc-ae83-4b88-87be-ba1007c5865e] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:15.380616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2deed8ef-50e6-4e2f-ae57-6fd2a1e806d0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:15.381512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2deed8ef-50e6-4e2f-ae57-6fd2a1e806d0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:15.383055 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2deed8ef-50e6-4e2f-ae57-6fd2a1e806d0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:15.383995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-2deed8ef-50e6-4e2f-ae57-6fd2a1e806d0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:15.418873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-2deed8ef-50e6-4e2f-ae57-6fd2a1e806d0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] HTTP exception thrown: Instance e457f5fc-ae83-4b88-87be-ba1007c5865e could not be found. Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2deed8ef-50e6-4e2f-ae57-6fd2a1e806d0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Request method failure captured: Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e HTTP/1.1 Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cDv1fgJXsCQ367hlkfbdy7_aF-GgajmNo48KEhXU3sOmci0R6PIoILwJ9otstrCU4xECyUgYlbPwRnfHz_orgOPqIQAEPi2rXWNdR68mzoCl_EJZ_E_UmV4xv9NhF92_iS6PFjgjvqGQlUXvFZSUkhi1-s4n18VxZnhkGbSDsJ3BEE Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 0d65941ddb4346e0b3fdc6b751a6aa07 Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 23:20:15.424754 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 23:20:15.426779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0d65941ddb4346e0b3fdc6b751a6aa07", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d65941ddb4346e0b3fdc6b751a6aa07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:20:15.426779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:20:15.426779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 0d65941ddb4346e0b3fdc6b751a6aa07 Jul 27 23:20:15.426779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2081014947 Jul 27 23:20:15.426779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-AttachVolumeShelveTestJSON-2081014947-project Jul 27 23:20:15.426779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 23:20:15.426779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 23:20:15.426779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 51db745daefd448b80630ef1bceca4c4 Jul 27 23:20:15.426779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2081014947-project Jul 27 23:20:15.426779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 23:20:15.426779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance e457f5fc-ae83-4b88-87be-ba1007c5865e could not be found. Jul 27 23:20:15.426779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': 'e457f5fc-ae83-4b88-87be-ba1007c5865e'} Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e457f5fc-ae83-4b88-87be-ba1007c5865e could not be found. Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:20:15.428068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e457f5fc-ae83-4b88-87be-ba1007c5865e could not be found. Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e457f5fc-ae83-4b88-87be-ba1007c5865e could not be found. Jul 27 23:20:15.429546 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.430834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-2deed8ef-50e6-4e2f-ae57-6fd2a1e806d0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] Returning 404 to user: Instance e457f5fc-ae83-4b88-87be-ba1007c5865e could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:20:15.430834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-2deed8ef-50e6-4e2f-ae57-6fd2a1e806d0 tempest-AttachVolumeShelveTestJSON-2081014947 tempest-AttachVolumeShelveTestJSON-2081014947-project] 10.222.0.47 "GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e" status: 404 len: 111 microversion: 2.20 time: 0.062969 Jul 27 23:20:15.430834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1546/3278] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Jul 27 23:20:15 2022] GET /compute/v2.1/servers/e457f5fc-ae83-4b88-87be-ba1007c5865e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 23:20:15.922997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d8dd172b-f356-4986-839b-0267d6c0f627 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:15.923609 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d8dd172b-f356-4986-839b-0267d6c0f627 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:15.930465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d8dd172b-f356-4986-839b-0267d6c0f627 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:15.930908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d8dd172b-f356-4986-839b-0267d6c0f627 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:15.931833 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d8dd172b-f356-4986-839b-0267d6c0f627 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:15.932639 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d8dd172b-f356-4986-839b-0267d6c0f627 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:15.946641 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-d8dd172b-f356-4986-839b-0267d6c0f627 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] HTTP exception thrown: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d8dd172b-f356-4986-839b-0267d6c0f627 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Request method failure captured: Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed HTTP/1.1 Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4ce_86_mpgEQhs4gaTV0tfjm8JjmxgPrIo833kLA2weaAY3-wEY-72J-xAWKzgl63sG9VQe7h9u16Giww8q0QvHKXagoT2eboe-zCuMZoaKdBHpafuaBobVDtpfWgn39X0qL7DGXqP_2MFHUyx4KAu3M1fz8c1B_NnIOoOTVHJXI0NM Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:20:15.948746 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:20:15.950331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/62cccac090ad43059d82b81818434339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_62cccac090ad43059d82b81818434339", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:20:15.950331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:20:15.950331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:20:15.950331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:20:15.950331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:20:15.950331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:20:15.950331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:20:15.950331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 0fe603e45401486f873e7b908c8fff7d Jul 27 23:20:15.950331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:20:15.950331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:20:15.950331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:20:15.950331 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': 'a7144f46-2169-40af-94a2-6d93b1dca4ed'} Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:20:15.951258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:20:15.952730 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:20:15.954002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d8dd172b-f356-4986-839b-0267d6c0f627 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Returning 404 to user: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:20:15.954002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d8dd172b-f356-4986-839b-0267d6c0f627 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 404 len: 111 microversion: 2.1 time: 0.031265 Jul 27 23:20:15.954002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1733/3279] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:15 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:20:15.958896 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-8db1a171-a1b5-40cd-96da-6d51c4c07003 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '.version_select at 0x7f696a1473a0>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:15.980325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-8db1a171-a1b5-40cd-96da-6d51c4c07003 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169179453" status: 202 len: 0 microversion: 2.1 time: 0.025119 Jul 27 23:20:15.980960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1547/3280] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Jul 27 23:20:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169179453 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 23:20:17.223064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6989a4fa-e420-4f5b-b752-d253b3b02e39 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Action: 'create', calling method: .version_select at 0x7f696a1d24c0>, body: {"keypair": {"name": "tempest-keypair-530202967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF64bX/1QGR7EAW96E2WOLG3BbY6IYG2NrlUHhVimVZlf+27mxRGKEw2bMauRfAoVAGJEBYJN8yw12Ao99PVw59d4GiQbk+I+f+avhldnpiGqPiT9u/B8tDBSPYWV5Zk6Q=="}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:20:17.239501 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-6989a4fa-e420-4f5b-b752-d253b3b02e39 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Getting quotas for project 62cccac090ad43059d82b81818434339. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 23:20:17.246269 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-6989a4fa-e420-4f5b-b752-d253b3b02e39 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Getting quotas for user 0fe603e45401486f873e7b908c8fff7d and project 62cccac090ad43059d82b81818434339. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 23:20:17.273745 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6989a4fa-e420-4f5b-b752-d253b3b02e39 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054516 Jul 27 23:20:17.274347 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1734/3281] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 23:20:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:20:18.612384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-404295349", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95bd9310-0f69-4035-a95b-5a1cc2c85c93"}], "security_groups": [{"name": "tempest-securitygroup--1784929618"}], "key_name": "tempest-keypair-530202967", "user_data": "}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:20:18.799538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.network.neutron [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] validate_networks() for [('95bd9310-0f69-4035-a95b-5a1cc2c85c93', None, None, None, None, None)] {{(pid=129294) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 23:20:19.720588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Flavor limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 23:20:19.721192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Image limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 23:20:19.721709 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Flavor pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 23:20:19.722216 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Image pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 23:20:19.722758 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 23:20:19.732319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:19.732804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:19.733598 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:19.734036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:19.752377 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Getting quotas for project 62cccac090ad43059d82b81818434339. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 23:20:19.756362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Getting quotas for user 0fe603e45401486f873e7b908c8fff7d and project 62cccac090ad43059d82b81818434339. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 23:20:19.770171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Going to run 1 instances... {{(pid=129294) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 23:20:19.770171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129294) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 23:20:19.818767 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a28efcce-8aee-4cf4-a3bc-a84a760ca85b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.210693 Jul 27 23:20:19.824795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1548/3282] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 23:20:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 23:20:19.830457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-553b0360-8f0b-4afe-b43e-198060dbf5c8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:19.831330 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-553b0360-8f0b-4afe-b43e-198060dbf5c8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:19.908112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-553b0360-8f0b-4afe-b43e-198060dbf5c8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:20:19.915245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-553b0360-8f0b-4afe-b43e-198060dbf5c8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 200 len: 1240 microversion: 2.1 time: 0.088942 Jul 27 23:20:19.915896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1735/3283] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:19 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:20:20.939219 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f979fd62-1576-421f-800f-09406fbd9280 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:20.940517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f979fd62-1576-421f-800f-09406fbd9280 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:20.950295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f979fd62-1576-421f-800f-09406fbd9280 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:20.950746 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f979fd62-1576-421f-800f-09406fbd9280 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:20.951512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f979fd62-1576-421f-800f-09406fbd9280 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:20.952045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f979fd62-1576-421f-800f-09406fbd9280 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:21.040744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f979fd62-1576-421f-800f-09406fbd9280 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:20:21.049444 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f979fd62-1576-421f-800f-09406fbd9280 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 200 len: 1310 microversion: 2.1 time: 0.117502 Jul 27 23:20:21.049997 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1549/3284] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:20 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 1310 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:20:22.070624 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-908455cc-86e3-4dba-9a97-b436e9a735fa tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:22.071228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-908455cc-86e3-4dba-9a97-b436e9a735fa tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:22.078041 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-908455cc-86e3-4dba-9a97-b436e9a735fa tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:22.078482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-908455cc-86e3-4dba-9a97-b436e9a735fa tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:22.079231 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-908455cc-86e3-4dba-9a97-b436e9a735fa tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:22.079660 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-908455cc-86e3-4dba-9a97-b436e9a735fa tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:22.230615 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-908455cc-86e3-4dba-9a97-b436e9a735fa tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:20:22.239120 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-908455cc-86e3-4dba-9a97-b436e9a735fa tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 200 len: 1366 microversion: 2.1 time: 0.172264 Jul 27 23:20:22.239818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1736/3285] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:22 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:20:22.329623 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-3729e85e-64c2-4806-b3de-71b10ab53bcc req-c66e26f0-6c2c-4fb0-ba72-ff29a85a8bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e09795d-f484-48e2-9e4f-bf9b86e0349f", "tag": "2b6fd8e9-4056-4dd1-b3d2-c3244ff9b2a3"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:20:22.342967 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-3729e85e-64c2-4806-b3de-71b10ab53bcc req-c66e26f0-6c2c-4fb0-ba72-ff29a85a8bba service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:22.344084 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-3729e85e-64c2-4806-b3de-71b10ab53bcc req-c66e26f0-6c2c-4fb0-ba72-ff29a85a8bba service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:22.359099 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-3729e85e-64c2-4806-b3de-71b10ab53bcc req-c66e26f0-6c2c-4fb0-ba72-ff29a85a8bba service nova] Creating event network-changed:2b6fd8e9-4056-4dd1-b3d2-c3244ff9b2a3 for instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f on hv-cinder-85124 Jul 27 23:20:22.365501 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-3729e85e-64c2-4806-b3de-71b10ab53bcc req-c66e26f0-6c2c-4fb0-ba72-ff29a85a8bba service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039095 Jul 27 23:20:22.366091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1550/3286] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:20:23.260518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f5abd1a7-a5ac-4a8d-a5d4-d8b2f53b6615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:23.261139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f5abd1a7-a5ac-4a8d-a5d4-d8b2f53b6615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:23.267596 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f5abd1a7-a5ac-4a8d-a5d4-d8b2f53b6615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:23.268036 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f5abd1a7-a5ac-4a8d-a5d4-d8b2f53b6615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:23.268813 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f5abd1a7-a5ac-4a8d-a5d4-d8b2f53b6615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:23.269242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f5abd1a7-a5ac-4a8d-a5d4-d8b2f53b6615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:23.395447 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f5abd1a7-a5ac-4a8d-a5d4-d8b2f53b6615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:20:23.403240 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f5abd1a7-a5ac-4a8d-a5d4-d8b2f53b6615 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 200 len: 1366 microversion: 2.1 time: 0.146574 Jul 27 23:20:23.403834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1737/3287] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:23 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:20:24.424665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-70cddad0-e38a-4562-87ce-cd26f2a1b758 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:24.425360 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-70cddad0-e38a-4562-87ce-cd26f2a1b758 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:24.431609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-70cddad0-e38a-4562-87ce-cd26f2a1b758 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:24.432060 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-70cddad0-e38a-4562-87ce-cd26f2a1b758 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:24.433466 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-70cddad0-e38a-4562-87ce-cd26f2a1b758 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:24.433903 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-70cddad0-e38a-4562-87ce-cd26f2a1b758 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:24.565078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-70cddad0-e38a-4562-87ce-cd26f2a1b758 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:20:24.572376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-70cddad0-e38a-4562-87ce-cd26f2a1b758 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 200 len: 1366 microversion: 2.1 time: 0.152469 Jul 27 23:20:24.572960 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1551/3288] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:24 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:20:25.593257 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b6c9e32f-8215-488d-b724-7470590971e5 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:25.593872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b6c9e32f-8215-488d-b724-7470590971e5 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:25.599836 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b6c9e32f-8215-488d-b724-7470590971e5 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:25.600275 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b6c9e32f-8215-488d-b724-7470590971e5 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:25.601055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b6c9e32f-8215-488d-b724-7470590971e5 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:25.601482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b6c9e32f-8215-488d-b724-7470590971e5 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:25.728922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b6c9e32f-8215-488d-b724-7470590971e5 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:20:25.736852 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b6c9e32f-8215-488d-b724-7470590971e5 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 200 len: 1366 microversion: 2.1 time: 0.147761 Jul 27 23:20:25.737417 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1738/3289] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:25 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:20:26.758673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e558ad2b-1151-415a-b20d-671245f401d8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:26.759207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e558ad2b-1151-415a-b20d-671245f401d8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:26.765253 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e558ad2b-1151-415a-b20d-671245f401d8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:26.765695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e558ad2b-1151-415a-b20d-671245f401d8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:26.766447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e558ad2b-1151-415a-b20d-671245f401d8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:26.766878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e558ad2b-1151-415a-b20d-671245f401d8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:26.894936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e558ad2b-1151-415a-b20d-671245f401d8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:20:26.902876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e558ad2b-1151-415a-b20d-671245f401d8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 200 len: 1366 microversion: 2.1 time: 0.148343 Jul 27 23:20:26.903431 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1552/3290] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:26 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:20:27.311775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-16600d67-3387-44b3-a50b-c66754feabba req-2f9f6964-6d79-42a9-b4aa-37dd944f3a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e09795d-f484-48e2-9e4f-bf9b86e0349f", "name": "network-vif-plugged", "status": "completed", "tag": "2b6fd8e9-4056-4dd1-b3d2-c3244ff9b2a3"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:20:27.322515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-16600d67-3387-44b3-a50b-c66754feabba req-2f9f6964-6d79-42a9-b4aa-37dd944f3a9a service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:27.323454 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-16600d67-3387-44b3-a50b-c66754feabba req-2f9f6964-6d79-42a9-b4aa-37dd944f3a9a service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:27.334626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-16600d67-3387-44b3-a50b-c66754feabba req-2f9f6964-6d79-42a9-b4aa-37dd944f3a9a service nova] Creating event network-vif-plugged:2b6fd8e9-4056-4dd1-b3d2-c3244ff9b2a3 for instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f on hv-cinder-85124 Jul 27 23:20:27.340077 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-16600d67-3387-44b3-a50b-c66754feabba req-2f9f6964-6d79-42a9-b4aa-37dd944f3a9a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032031 Jul 27 23:20:27.340685 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1739/3291] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:20:27.925542 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-0eb14fc0-051c-4fe1-84c1-3d6e0516f38b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:27.926260 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-0eb14fc0-051c-4fe1-84c1-3d6e0516f38b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:27.933515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0eb14fc0-051c-4fe1-84c1-3d6e0516f38b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:27.933957 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0eb14fc0-051c-4fe1-84c1-3d6e0516f38b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:27.934715 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0eb14fc0-051c-4fe1-84c1-3d6e0516f38b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:27.935146 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-0eb14fc0-051c-4fe1-84c1-3d6e0516f38b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:28.065868 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-0eb14fc0-051c-4fe1-84c1-3d6e0516f38b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:20:28.073517 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-0eb14fc0-051c-4fe1-84c1-3d6e0516f38b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 200 len: 1366 microversion: 2.1 time: 0.153888 Jul 27 23:20:28.074087 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1553/3292] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:27 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:20:29.094724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3d94284d-b7a7-43af-9c5a-23cca3859553 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:29.095425 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3d94284d-b7a7-43af-9c5a-23cca3859553 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:29.101575 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3d94284d-b7a7-43af-9c5a-23cca3859553 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:29.102021 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3d94284d-b7a7-43af-9c5a-23cca3859553 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:29.102774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3d94284d-b7a7-43af-9c5a-23cca3859553 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:29.103203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3d94284d-b7a7-43af-9c5a-23cca3859553 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:29.243857 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3d94284d-b7a7-43af-9c5a-23cca3859553 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:20:29.251826 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3d94284d-b7a7-43af-9c5a-23cca3859553 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 200 len: 1366 microversion: 2.1 time: 0.161730 Jul 27 23:20:29.252383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1740/3293] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:29 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:20:30.273513 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-86441c93-6358-456f-aa7e-27311edf6479 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:30.274122 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-86441c93-6358-456f-aa7e-27311edf6479 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:30.276545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=2 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:20:30.277812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=6 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:20:30.284392 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86441c93-6358-456f-aa7e-27311edf6479 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:30.284860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86441c93-6358-456f-aa7e-27311edf6479 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:30.285613 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86441c93-6358-456f-aa7e-27311edf6479 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:30.286046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-86441c93-6358-456f-aa7e-27311edf6479 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:30.415677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-86441c93-6358-456f-aa7e-27311edf6479 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:20:30.423038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-86441c93-6358-456f-aa7e-27311edf6479 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 200 len: 1555 microversion: 2.1 time: 0.153746 Jul 27 23:20:30.423594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1554/3294] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:20:30 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:20:30.442997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-52e9e038-62db-497b-a4af-9019e4b306b1 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:20:30.443491 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-52e9e038-62db-497b-a4af-9019e4b306b1 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:20:30.445394 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=6 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:20:30.451584 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52e9e038-62db-497b-a4af-9019e4b306b1 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:30.452030 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52e9e038-62db-497b-a4af-9019e4b306b1 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:30.452806 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52e9e038-62db-497b-a4af-9019e4b306b1 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:30.453233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-52e9e038-62db-497b-a4af-9019e4b306b1 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:30.529043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-52e9e038-62db-497b-a4af-9019e4b306b1 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089691 Jul 27 23:20:30.529632 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1741/3295] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 23:20:30 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:20:31.436079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-3fe25ebe-3176-41fc-920f-1b437ccd8bf2 req-b0bb52a4-51c0-49c6-9790-87790b6f77d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e09795d-f484-48e2-9e4f-bf9b86e0349f", "tag": "2b6fd8e9-4056-4dd1-b3d2-c3244ff9b2a3"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:20:31.445741 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-3fe25ebe-3176-41fc-920f-1b437ccd8bf2 req-b0bb52a4-51c0-49c6-9790-87790b6f77d7 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:20:31.446177 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-3fe25ebe-3176-41fc-920f-1b437ccd8bf2 req-b0bb52a4-51c0-49c6-9790-87790b6f77d7 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:20:31.457446 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-3fe25ebe-3176-41fc-920f-1b437ccd8bf2 req-b0bb52a4-51c0-49c6-9790-87790b6f77d7 service nova] Creating event network-changed:2b6fd8e9-4056-4dd1-b3d2-c3244ff9b2a3 for instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f on hv-cinder-85124 Jul 27 23:20:31.462352 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-3fe25ebe-3176-41fc-920f-1b437ccd8bf2 req-b0bb52a4-51c0-49c6-9790-87790b6f77d7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030399 Jul 27 23:20:31.462930 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1555/3296] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:21:01.420738 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:21:01.421303 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:21:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:21:07.186618 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:21:07.187436 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=46 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:21:07.191457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-532c299d-95aa-41ff-aeee-0bcedabaeb21 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:21:07.191942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-532c299d-95aa-41ff-aeee-0bcedabaeb21 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:21:07.198978 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-532c299d-95aa-41ff-aeee-0bcedabaeb21 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:21:07.199424 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-532c299d-95aa-41ff-aeee-0bcedabaeb21 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:21:07.200167 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-532c299d-95aa-41ff-aeee-0bcedabaeb21 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:21:07.200616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-532c299d-95aa-41ff-aeee-0bcedabaeb21 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:21:07.231103 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-532c299d-95aa-41ff-aeee-0bcedabaeb21 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f/ips" status: 200 len: 148 microversion: 2.1 time: 0.045128 Jul 27 23:21:07.231699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1742/3297] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 23:21:07 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f/ips => generated 148 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:22:07.304475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:22:07.305230 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:22:07.309941 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5f20fae5-477e-4b83-940f-71e2d144013c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:07.310515 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5f20fae5-477e-4b83-940f-71e2d144013c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:07.319009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f20fae5-477e-4b83-940f-71e2d144013c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:07.319445 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f20fae5-477e-4b83-940f-71e2d144013c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:07.320188 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f20fae5-477e-4b83-940f-71e2d144013c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:07.320641 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5f20fae5-477e-4b83-940f-71e2d144013c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:07.347811 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5f20fae5-477e-4b83-940f-71e2d144013c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Going to try to terminate instance {{(pid=129294) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 23:22:07.421583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5f20fae5-477e-4b83-940f-71e2d144013c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 204 len: 0 microversion: 2.1 time: 0.117589 Jul 27 23:22:07.421583 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1556/3298] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:22:07 2022] DELETE /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 23:22:07.427590 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:22:07.428498 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=4 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:22:07.432311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-e972e627-6c20-4f98-b73b-13525b098168 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:07.433023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-e972e627-6c20-4f98-b73b-13525b098168 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:07.439835 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e972e627-6c20-4f98-b73b-13525b098168 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:07.440279 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e972e627-6c20-4f98-b73b-13525b098168 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:07.441179 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e972e627-6c20-4f98-b73b-13525b098168 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:07.441612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-e972e627-6c20-4f98-b73b-13525b098168 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:07.568023 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-e972e627-6c20-4f98-b73b-13525b098168 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:22:07.575422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-e972e627-6c20-4f98-b73b-13525b098168 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 200 len: 1679 microversion: 2.1 time: 0.149502 Jul 27 23:22:07.576717 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1743/3299] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:07 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:22:08.598436 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b94bb12c-7831-4a83-b7b3-3e234aabed01 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:08.599367 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b94bb12c-7831-4a83-b7b3-3e234aabed01 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:08.606547 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b94bb12c-7831-4a83-b7b3-3e234aabed01 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:08.606984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b94bb12c-7831-4a83-b7b3-3e234aabed01 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:08.607779 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b94bb12c-7831-4a83-b7b3-3e234aabed01 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:08.608207 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b94bb12c-7831-4a83-b7b3-3e234aabed01 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:08.739309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b94bb12c-7831-4a83-b7b3-3e234aabed01 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:22:08.746673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b94bb12c-7831-4a83-b7b3-3e234aabed01 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 200 len: 1679 microversion: 2.1 time: 0.152467 Jul 27 23:22:08.747227 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1557/3300] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:08 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:22:09.768986 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f93ed637-98fa-4355-b9bc-77c4118cba1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:09.769597 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f93ed637-98fa-4355-b9bc-77c4118cba1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:09.778046 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f93ed637-98fa-4355-b9bc-77c4118cba1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:09.778489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f93ed637-98fa-4355-b9bc-77c4118cba1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:09.779843 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f93ed637-98fa-4355-b9bc-77c4118cba1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:09.780272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f93ed637-98fa-4355-b9bc-77c4118cba1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:09.846009 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f93ed637-98fa-4355-b9bc-77c4118cba1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:22:09.853472 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f93ed637-98fa-4355-b9bc-77c4118cba1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 200 len: 1611 microversion: 2.1 time: 0.088466 Jul 27 23:22:09.854170 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1744/3301] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:09 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 1611 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:22:10.037791 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-b0503009-1a77-4279-a48f-ac33aafdc63e req-bdb6d845-a49f-478c-8a85-c8a3112d88da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e09795d-f484-48e2-9e4f-bf9b86e0349f", "name": "network-vif-deleted", "tag": "2b6fd8e9-4056-4dd1-b3d2-c3244ff9b2a3"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:22:10.047384 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-b0503009-1a77-4279-a48f-ac33aafdc63e req-bdb6d845-a49f-478c-8a85-c8a3112d88da service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:10.047929 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-b0503009-1a77-4279-a48f-ac33aafdc63e req-bdb6d845-a49f-478c-8a85-c8a3112d88da service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:10.059492 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-b0503009-1a77-4279-a48f-ac33aafdc63e req-bdb6d845-a49f-478c-8a85-c8a3112d88da service nova] Creating event network-vif-deleted:2b6fd8e9-4056-4dd1-b3d2-c3244ff9b2a3 for instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f on hv-cinder-85124 Jul 27 23:22:10.064892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-b0503009-1a77-4279-a48f-ac33aafdc63e req-bdb6d845-a49f-478c-8a85-c8a3112d88da service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031473 Jul 27 23:22:10.065694 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1558/3302] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:22:10.875206 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f0fdbb52-f402-477b-a542-401469289268 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:10.875808 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f0fdbb52-f402-477b-a542-401469289268 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:10.882236 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f0fdbb52-f402-477b-a542-401469289268 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:10.882672 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f0fdbb52-f402-477b-a542-401469289268 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:10.883415 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f0fdbb52-f402-477b-a542-401469289268 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:10.883841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f0fdbb52-f402-477b-a542-401469289268 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:10.898005 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-f0fdbb52-f402-477b-a542-401469289268 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] HTTP exception thrown: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f0fdbb52-f402-477b-a542-401469289268 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Request method failure captured: Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f HTTP/1.1 Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4ce_86_mpgEQhs4gaTV0tfjm8JjmxgPrIo833kLA2weaAY3-wEY-72J-xAWKzgl63sG9VQe7h9u16Giww8q0QvHKXagoT2eboe-zCuMZoaKdBHpafuaBobVDtpfWgn39X0qL7DGXqP_2MFHUyx4KAu3M1fz8c1B_NnIOoOTVHJXI0NM Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:22:10.899622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:22:10.901462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/62cccac090ad43059d82b81818434339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_62cccac090ad43059d82b81818434339", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:22:10.901462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:22:10.901462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:22:10.901462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:22:10.901462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:22:10.901462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:22:10.901462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:22:10.901462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 0fe603e45401486f873e7b908c8fff7d Jul 27 23:22:10.901462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:22:10.901462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:22:10.901462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:22:10.901462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': '5e09795d-f484-48e2-9e4f-bf9b86e0349f'} Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:22:10.902497 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:22:10.904273 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:22:10.906090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f0fdbb52-f402-477b-a542-401469289268 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Returning 404 to user: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:22:10.906090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f0fdbb52-f402-477b-a542-401469289268 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 404 len: 111 microversion: 2.1 time: 0.030250 Jul 27 23:22:10.906090 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1745/3303] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:10 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:22:10.910646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c86a58e2-a0ce-48ef-a38c-a6dc53f87704 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '.version_select at 0x7f696a2adee0>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:10.929500 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c86a58e2-a0ce-48ef-a38c-a6dc53f87704 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-530202967" status: 202 len: 0 microversion: 2.1 time: 0.023012 Jul 27 23:22:10.930080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1559/3304] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Jul 27 23:22:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-530202967 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 23:22:11.554314 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6843391b-6945-4bb4-8f6a-6a040046deab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Action: 'create', calling method: .version_select at 0x7f696a264dc0>, body: {"keypair": {"name": "tempest-keypair-1125274232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOXCmlJSkMJ7SjpeYNdWFa6/F0yNIKp6HlcGluNcg0DYKLizybga2368bJqxgOkIlDE3xtVGh1o7+hIPNS77nNtIZ9Ms6KolDVHwPkljDrdXBJSG2JaoqZh0TJA9X1LEQ=="}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:22:11.569588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-6843391b-6945-4bb4-8f6a-6a040046deab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Getting quotas for project 62cccac090ad43059d82b81818434339. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 23:22:11.573355 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-6843391b-6945-4bb4-8f6a-6a040046deab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Getting quotas for user 0fe603e45401486f873e7b908c8fff7d and project 62cccac090ad43059d82b81818434339. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 23:22:11.595177 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6843391b-6945-4bb4-8f6a-6a040046deab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044773 Jul 27 23:22:11.595742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1746/3305] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 23:22:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:22:12.843936 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-470663858", "imageRef": "21d750ad-7357-4662-b68a-2a320cbd9fdc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95bd9310-0f69-4035-a95b-5a1cc2c85c93"}], "security_groups": [{"name": "tempest-securitygroup--50037077"}], "key_name": "tempest-keypair-1125274232", "user_data": "}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:22:12.947094 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.network.neutron [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] validate_networks() for [('95bd9310-0f69-4035-a95b-5a1cc2c85c93', None, None, None, None, None)] {{(pid=129294) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 23:22:13.313555 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Flavor limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 23:22:13.313970 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Image limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 23:22:13.314465 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Flavor pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 23:22:13.314865 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Image pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 23:22:13.315263 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 23:22:13.323952 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:13.324388 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:13.325202 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:13.325628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:13.341604 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Getting quotas for project 62cccac090ad43059d82b81818434339. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 23:22:13.345972 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Getting quotas for user 0fe603e45401486f873e7b908c8fff7d and project 62cccac090ad43059d82b81818434339. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 23:22:13.356470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Going to run 1 instances... {{(pid=129294) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 23:22:13.359347 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21d750ad-7357-4662-b68a-2a320cbd9fdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129294) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 23:22:13.403467 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-65d44c4c-6722-41a1-8441-6f2338a20b4b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.564233 Jul 27 23:22:13.404103 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1560/3306] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 23:22:12 2022] POST /compute/v2.1/servers => generated 400 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 23:22:13.415679 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a32f2e9b-0b0d-4921-acef-a2639f12536b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:13.416276 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a32f2e9b-0b0d-4921-acef-a2639f12536b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:13.475825 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a32f2e9b-0b0d-4921-acef-a2639f12536b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:22:13.482407 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a32f2e9b-0b0d-4921-acef-a2639f12536b tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 200 len: 1241 microversion: 2.1 time: 0.071001 Jul 27 23:22:13.483236 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1747/3307] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:13 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:22:14.504873 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-cb0c6446-e054-4eeb-9b35-e4ccbfa076ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:14.505485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-cb0c6446-e054-4eeb-9b35-e4ccbfa076ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:14.512482 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb0c6446-e054-4eeb-9b35-e4ccbfa076ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:14.513029 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb0c6446-e054-4eeb-9b35-e4ccbfa076ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:14.513878 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb0c6446-e054-4eeb-9b35-e4ccbfa076ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:14.514299 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-cb0c6446-e054-4eeb-9b35-e4ccbfa076ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:14.582447 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-cb0c6446-e054-4eeb-9b35-e4ccbfa076ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:22:14.590001 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-cb0c6446-e054-4eeb-9b35-e4ccbfa076ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 200 len: 1299 microversion: 2.1 time: 0.090053 Jul 27 23:22:14.590562 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1561/3308] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:14 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:22:15.616430 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d4da5a4c-a986-40ed-879d-1cd4f615197c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:15.617708 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d4da5a4c-a986-40ed-879d-1cd4f615197c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:15.629815 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d4da5a4c-a986-40ed-879d-1cd4f615197c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:15.630907 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d4da5a4c-a986-40ed-879d-1cd4f615197c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:15.631868 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d4da5a4c-a986-40ed-879d-1cd4f615197c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:15.632951 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d4da5a4c-a986-40ed-879d-1cd4f615197c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:15.802858 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d4da5a4c-a986-40ed-879d-1cd4f615197c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:22:15.816254 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-43048885-c84c-4d35-b1f9-6b0eb6a62a77 req-570f9b72-d4ac-4286-ae5a-6a7631a1c256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36342a4b-f2da-450e-8ecc-119a180d598c", "tag": "5efe332a-eecf-4d24-b464-c69b42c6f763"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:22:15.827713 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d4da5a4c-a986-40ed-879d-1cd4f615197c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 200 len: 1365 microversion: 2.1 time: 0.219567 Jul 27 23:22:15.830010 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1748/3309] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:15 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:22:15.838295 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-43048885-c84c-4d35-b1f9-6b0eb6a62a77 req-570f9b72-d4ac-4286-ae5a-6a7631a1c256 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:15.838731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-43048885-c84c-4d35-b1f9-6b0eb6a62a77 req-570f9b72-d4ac-4286-ae5a-6a7631a1c256 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:15.868389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-43048885-c84c-4d35-b1f9-6b0eb6a62a77 req-570f9b72-d4ac-4286-ae5a-6a7631a1c256 service nova] Creating event network-changed:5efe332a-eecf-4d24-b464-c69b42c6f763 for instance 36342a4b-f2da-450e-8ecc-119a180d598c on hv-cinder-85124 Jul 27 23:22:15.881410 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-43048885-c84c-4d35-b1f9-6b0eb6a62a77 req-570f9b72-d4ac-4286-ae5a-6a7631a1c256 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068626 Jul 27 23:22:15.883072 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1562/3310] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:22:16.849588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-b163bf07-ac2c-4b8b-8ee1-786895d7cca2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:16.850228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-b163bf07-ac2c-4b8b-8ee1-786895d7cca2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:16.856630 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b163bf07-ac2c-4b8b-8ee1-786895d7cca2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:16.857070 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b163bf07-ac2c-4b8b-8ee1-786895d7cca2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:16.858482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b163bf07-ac2c-4b8b-8ee1-786895d7cca2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:16.858908 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-b163bf07-ac2c-4b8b-8ee1-786895d7cca2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:16.986952 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-b163bf07-ac2c-4b8b-8ee1-786895d7cca2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:22:16.994418 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-b163bf07-ac2c-4b8b-8ee1-786895d7cca2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 200 len: 1365 microversion: 2.1 time: 0.148629 Jul 27 23:22:16.994966 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1749/3311] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:16 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:22:18.016979 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-6d75d5c2-58ac-453c-b2c7-c8cc158ed3b8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:18.017588 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-6d75d5c2-58ac-453c-b2c7-c8cc158ed3b8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:18.023688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6d75d5c2-58ac-453c-b2c7-c8cc158ed3b8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:18.024125 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6d75d5c2-58ac-453c-b2c7-c8cc158ed3b8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:18.024892 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6d75d5c2-58ac-453c-b2c7-c8cc158ed3b8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:18.025321 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-6d75d5c2-58ac-453c-b2c7-c8cc158ed3b8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:18.153869 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-6d75d5c2-58ac-453c-b2c7-c8cc158ed3b8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:22:18.161851 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-6d75d5c2-58ac-453c-b2c7-c8cc158ed3b8 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 200 len: 1365 microversion: 2.1 time: 0.150112 Jul 27 23:22:18.162403 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1563/3312] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:18 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:22:19.182175 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a0b8947a-3127-4cbf-bfe8-b9161cf1bf1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:19.182804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a0b8947a-3127-4cbf-bfe8-b9161cf1bf1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:19.189353 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0b8947a-3127-4cbf-bfe8-b9161cf1bf1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:19.189799 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0b8947a-3127-4cbf-bfe8-b9161cf1bf1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:19.190553 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0b8947a-3127-4cbf-bfe8-b9161cf1bf1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:19.190987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0b8947a-3127-4cbf-bfe8-b9161cf1bf1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:19.318020 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a0b8947a-3127-4cbf-bfe8-b9161cf1bf1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:22:19.325298 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a0b8947a-3127-4cbf-bfe8-b9161cf1bf1c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 200 len: 1365 microversion: 2.1 time: 0.146930 Jul 27 23:22:19.325855 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1750/3313] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:19 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:22:20.346346 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f2a27e20-688a-4e6a-89b0-0524ecfac058 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:20.346986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f2a27e20-688a-4e6a-89b0-0524ecfac058 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:20.353586 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f2a27e20-688a-4e6a-89b0-0524ecfac058 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:20.354032 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f2a27e20-688a-4e6a-89b0-0524ecfac058 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:20.354790 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f2a27e20-688a-4e6a-89b0-0524ecfac058 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:20.355222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f2a27e20-688a-4e6a-89b0-0524ecfac058 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:20.481011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f2a27e20-688a-4e6a-89b0-0524ecfac058 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:22:20.488334 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f2a27e20-688a-4e6a-89b0-0524ecfac058 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 200 len: 1365 microversion: 2.1 time: 0.146498 Jul 27 23:22:20.488984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1564/3314] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:20 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:22:21.509188 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-34d3c895-9d34-4b16-a5e4-2c02a48682f6 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:21.509724 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-34d3c895-9d34-4b16-a5e4-2c02a48682f6 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:21.516281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34d3c895-9d34-4b16-a5e4-2c02a48682f6 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:21.516753 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34d3c895-9d34-4b16-a5e4-2c02a48682f6 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:21.517494 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34d3c895-9d34-4b16-a5e4-2c02a48682f6 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:21.517922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-34d3c895-9d34-4b16-a5e4-2c02a48682f6 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:21.642699 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-34d3c895-9d34-4b16-a5e4-2c02a48682f6 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:22:21.649946 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-34d3c895-9d34-4b16-a5e4-2c02a48682f6 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 200 len: 1365 microversion: 2.1 time: 0.144638 Jul 27 23:22:21.650496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1751/3315] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:21 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:22:21.819728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-a3e0e503-b9ff-4d7d-ab1e-3d5dd45247d0 req-587e2e0e-99f6-4946-ab56-73364fba958a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36342a4b-f2da-450e-8ecc-119a180d598c", "name": "network-vif-plugged", "status": "completed", "tag": "5efe332a-eecf-4d24-b464-c69b42c6f763"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:22:21.829844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-a3e0e503-b9ff-4d7d-ab1e-3d5dd45247d0 req-587e2e0e-99f6-4946-ab56-73364fba958a service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:21.830292 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-a3e0e503-b9ff-4d7d-ab1e-3d5dd45247d0 req-587e2e0e-99f6-4946-ab56-73364fba958a service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:21.841460 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-a3e0e503-b9ff-4d7d-ab1e-3d5dd45247d0 req-587e2e0e-99f6-4946-ab56-73364fba958a service nova] Creating event network-vif-plugged:5efe332a-eecf-4d24-b464-c69b42c6f763 for instance 36342a4b-f2da-450e-8ecc-119a180d598c on hv-cinder-85124 Jul 27 23:22:21.846867 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-a3e0e503-b9ff-4d7d-ab1e-3d5dd45247d0 req-587e2e0e-99f6-4946-ab56-73364fba958a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031029 Jul 27 23:22:21.847452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1565/3316] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:22:22.673222 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-685e3bd1-d390-49ab-b078-4f17e3795b8d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:22.673758 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-685e3bd1-d390-49ab-b078-4f17e3795b8d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:22.680149 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-685e3bd1-d390-49ab-b078-4f17e3795b8d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:22.680616 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-685e3bd1-d390-49ab-b078-4f17e3795b8d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:22.681390 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-685e3bd1-d390-49ab-b078-4f17e3795b8d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:22.681817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-685e3bd1-d390-49ab-b078-4f17e3795b8d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:22.816585 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-685e3bd1-d390-49ab-b078-4f17e3795b8d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:22:22.823817 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-685e3bd1-d390-49ab-b078-4f17e3795b8d tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 200 len: 1365 microversion: 2.1 time: 0.155619 Jul 27 23:22:22.824361 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1752/3317] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:22 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:22:23.843049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=2 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:22:23.843798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=6 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:22:23.848263 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a8e4530e-54db-422c-98e4-de033caefb31 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:23.849045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a8e4530e-54db-422c-98e4-de033caefb31 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:23.856265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8e4530e-54db-422c-98e4-de033caefb31 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:23.856734 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8e4530e-54db-422c-98e4-de033caefb31 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:23.857479 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8e4530e-54db-422c-98e4-de033caefb31 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:23.857907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a8e4530e-54db-422c-98e4-de033caefb31 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:23.984768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-a8e4530e-54db-422c-98e4-de033caefb31 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:22:23.992333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a8e4530e-54db-422c-98e4-de033caefb31 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 200 len: 1554 microversion: 2.1 time: 0.150680 Jul 27 23:22:23.992912 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1566/3318] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:22:23 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:22:24.012627 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d5eb93cf-6a78-4345-91df-e2cdcf07b187 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:22:24.013141 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d5eb93cf-6a78-4345-91df-e2cdcf07b187 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:22:24.014897 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=6 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:22:24.020482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d5eb93cf-6a78-4345-91df-e2cdcf07b187 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:24.020960 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d5eb93cf-6a78-4345-91df-e2cdcf07b187 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:24.021705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d5eb93cf-6a78-4345-91df-e2cdcf07b187 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:24.022132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d5eb93cf-6a78-4345-91df-e2cdcf07b187 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:24.102357 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d5eb93cf-6a78-4345-91df-e2cdcf07b187 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093457 Jul 27 23:22:24.102942 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1753/3319] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Jul 27 23:22:24 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:22:25.257475 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-efb65876-d5c0-45f9-b38a-f3428fc4b8cd req-e8e2dbc4-d4e4-40fd-8b4f-2ada5f5459b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36342a4b-f2da-450e-8ecc-119a180d598c", "tag": "5efe332a-eecf-4d24-b464-c69b42c6f763"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:22:25.268349 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-efb65876-d5c0-45f9-b38a-f3428fc4b8cd req-e8e2dbc4-d4e4-40fd-8b4f-2ada5f5459b3 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:22:25.268819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-efb65876-d5c0-45f9-b38a-f3428fc4b8cd req-e8e2dbc4-d4e4-40fd-8b4f-2ada5f5459b3 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:22:25.280119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-efb65876-d5c0-45f9-b38a-f3428fc4b8cd req-e8e2dbc4-d4e4-40fd-8b4f-2ada5f5459b3 service nova] Creating event network-changed:5efe332a-eecf-4d24-b464-c69b42c6f763 for instance 36342a4b-f2da-450e-8ecc-119a180d598c on hv-cinder-85124 Jul 27 23:22:25.285245 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-efb65876-d5c0-45f9-b38a-f3428fc4b8cd req-e8e2dbc4-d4e4-40fd-8b4f-2ada5f5459b3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031490 Jul 27 23:22:25.285840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1567/3320] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:23:00.844963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:23:00.845764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=48 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:23:00.849600 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-6e057312-0cf7-49fc-b54c-3006ca81cf52 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:23:00.850094 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-6e057312-0cf7-49fc-b54c-3006ca81cf52 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:23:00.857564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e057312-0cf7-49fc-b54c-3006ca81cf52 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:23:00.858015 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e057312-0cf7-49fc-b54c-3006ca81cf52 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:23:00.859274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e057312-0cf7-49fc-b54c-3006ca81cf52 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:23:00.859709 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-6e057312-0cf7-49fc-b54c-3006ca81cf52 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:23:00.882963 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-6e057312-0cf7-49fc-b54c-3006ca81cf52 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c/ips" status: 200 len: 149 microversion: 2.1 time: 0.039426 Jul 27 23:23:00.883515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1754/3321] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 23:23:00 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:23:12.870185 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:23:12.870879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:23:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:24:00.954606 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:24:00.955864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:24:01.074534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-69f71f49-9096-49b8-b6bf-8db1b5d19bf0 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:01.075112 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-69f71f49-9096-49b8-b6bf-8db1b5d19bf0 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:01.081265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69f71f49-9096-49b8-b6bf-8db1b5d19bf0 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:01.081708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69f71f49-9096-49b8-b6bf-8db1b5d19bf0 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:01.082462 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69f71f49-9096-49b8-b6bf-8db1b5d19bf0 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:01.082894 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-69f71f49-9096-49b8-b6bf-8db1b5d19bf0 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:01.109117 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-69f71f49-9096-49b8-b6bf-8db1b5d19bf0 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Going to try to terminate instance {{(pid=129294) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 23:24:01.184994 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-69f71f49-9096-49b8-b6bf-8db1b5d19bf0 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "DELETE /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 204 len: 0 microversion: 2.1 time: 0.232088 Jul 27 23:24:01.185571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1568/3322] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:24:00 2022] DELETE /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 23:24:01.191640 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:24:01.192408 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=4 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:24:01.196213 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-72e9d10c-717c-4e9a-b8a6-18fb18b234da tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:01.196850 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-72e9d10c-717c-4e9a-b8a6-18fb18b234da tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:01.203614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72e9d10c-717c-4e9a-b8a6-18fb18b234da tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:01.204057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72e9d10c-717c-4e9a-b8a6-18fb18b234da tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:01.204891 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72e9d10c-717c-4e9a-b8a6-18fb18b234da tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:01.205270 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-72e9d10c-717c-4e9a-b8a6-18fb18b234da tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:01.341252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-72e9d10c-717c-4e9a-b8a6-18fb18b234da tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:24:01.348655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-72e9d10c-717c-4e9a-b8a6-18fb18b234da tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 200 len: 1679 microversion: 2.1 time: 0.158787 Jul 27 23:24:01.349207 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1755/3323] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:01 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:24:02.372168 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b565386f-4bc0-4f03-9bd9-574a607e807f tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:02.373048 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b565386f-4bc0-4f03-9bd9-574a607e807f tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:02.380223 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b565386f-4bc0-4f03-9bd9-574a607e807f tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:02.380701 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b565386f-4bc0-4f03-9bd9-574a607e807f tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:02.381458 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b565386f-4bc0-4f03-9bd9-574a607e807f tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:02.381888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b565386f-4bc0-4f03-9bd9-574a607e807f tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:02.508749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b565386f-4bc0-4f03-9bd9-574a607e807f tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:24:02.516163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b565386f-4bc0-4f03-9bd9-574a607e807f tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 200 len: 1679 microversion: 2.1 time: 0.148385 Jul 27 23:24:02.516744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1569/3324] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:02 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:24:03.538149 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-39b52227-9638-479d-af3c-44667107e643 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:03.539304 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-39b52227-9638-479d-af3c-44667107e643 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:03.546462 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39b52227-9638-479d-af3c-44667107e643 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:03.547166 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39b52227-9638-479d-af3c-44667107e643 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:03.548107 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39b52227-9638-479d-af3c-44667107e643 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:03.548537 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-39b52227-9638-479d-af3c-44667107e643 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:03.609637 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-5cca484a-e721-4562-9efa-d6eb2cbe0e11 req-6bba67d8-8b89-431f-ae50-22c684cf9ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36342a4b-f2da-450e-8ecc-119a180d598c", "name": "network-vif-deleted", "tag": "5efe332a-eecf-4d24-b464-c69b42c6f763"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:24:03.627577 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-5cca484a-e721-4562-9efa-d6eb2cbe0e11 req-6bba67d8-8b89-431f-ae50-22c684cf9ce3 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:03.628026 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-5cca484a-e721-4562-9efa-d6eb2cbe0e11 req-6bba67d8-8b89-431f-ae50-22c684cf9ce3 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:03.657046 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-5cca484a-e721-4562-9efa-d6eb2cbe0e11 req-6bba67d8-8b89-431f-ae50-22c684cf9ce3 service nova] Creating event network-vif-deleted:5efe332a-eecf-4d24-b464-c69b42c6f763 for instance 36342a4b-f2da-450e-8ecc-119a180d598c on hv-cinder-85124 Jul 27 23:24:03.662521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-39b52227-9638-479d-af3c-44667107e643 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe603e45401486f873e7b908c8fff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cccac090ad43059d82b81818434339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:24:03.664775 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-5cca484a-e721-4562-9efa-d6eb2cbe0e11 req-6bba67d8-8b89-431f-ae50-22c684cf9ce3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126663 Jul 27 23:24:03.665903 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1570/3325] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:24:03.671964 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-39b52227-9638-479d-af3c-44667107e643 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 200 len: 1613 microversion: 2.1 time: 0.138324 Jul 27 23:24:03.672764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1756/3326] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:03 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 1613 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:24:04.694986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-88acdd7a-734b-4e54-975b-c4677357f1e2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:04.695695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-88acdd7a-734b-4e54-975b-c4677357f1e2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:04.701859 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88acdd7a-734b-4e54-975b-c4677357f1e2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:04.702306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88acdd7a-734b-4e54-975b-c4677357f1e2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:04.703051 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88acdd7a-734b-4e54-975b-c4677357f1e2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:04.703481 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-88acdd7a-734b-4e54-975b-c4677357f1e2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:04.717065 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-88acdd7a-734b-4e54-975b-c4677357f1e2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] HTTP exception thrown: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-88acdd7a-734b-4e54-975b-c4677357f1e2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Request method failure captured: Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c HTTP/1.1 Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4ce_86_mpgEQhs4gaTV0tfjm8JjmxgPrIo833kLA2weaAY3-wEY-72J-xAWKzgl63sG9VQe7h9u16Giww8q0QvHKXagoT2eboe-zCuMZoaKdBHpafuaBobVDtpfWgn39X0qL7DGXqP_2MFHUyx4KAu3M1fz8c1B_NnIOoOTVHJXI0NM Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 23:24:04.718682 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 23:24:04.720527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/62cccac090ad43059d82b81818434339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_62cccac090ad43059d82b81818434339", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:24:04.720527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:04.720527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:04.720527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:04.720527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:04.720527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 23:24:04.720527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 23:24:04.720527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 0fe603e45401486f873e7b908c8fff7d Jul 27 23:24:04.720527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:04.720527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 23:24:04.720527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:04.720527 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '36342a4b-f2da-450e-8ecc-119a180d598c'} Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:24:04.721880 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:04.723727 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:04.725272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-88acdd7a-734b-4e54-975b-c4677357f1e2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Returning 404 to user: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:24:04.725272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-88acdd7a-734b-4e54-975b-c4677357f1e2 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 404 len: 111 microversion: 2.1 time: 0.030273 Jul 27 23:24:04.725272 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1571/3327] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:04 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:24:04.728802 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a14ab608-4c4d-4cc5-9a07-ef698ede5125 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '.version_select at 0x7f696e93a940>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:04.747517 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a14ab608-4c4d-4cc5-9a07-ef698ede5125 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125274232" status: 202 len: 0 microversion: 2.1 time: 0.022412 Jul 27 23:24:04.748061 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1757/3328] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Jul 27 23:24:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125274232 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 23:24:05.571324 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a389d1d4-20f5-43c0-80a1-4883bc4218ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:05.571925 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-a389d1d4-20f5-43c0-80a1-4883bc4218ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:05.577974 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a389d1d4-20f5-43c0-80a1-4883bc4218ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:05.578424 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a389d1d4-20f5-43c0-80a1-4883bc4218ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:05.579171 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a389d1d4-20f5-43c0-80a1-4883bc4218ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:05.579600 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-a389d1d4-20f5-43c0-80a1-4883bc4218ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:05.592796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-a389d1d4-20f5-43c0-80a1-4883bc4218ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] HTTP exception thrown: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a389d1d4-20f5-43c0-80a1-4883bc4218ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Request method failure captured: Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: DELETE /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c HTTP/1.1 Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4ce_86_mpgEQhs4gaTV0tfjm8JjmxgPrIo833kLA2weaAY3-wEY-72J-xAWKzgl63sG9VQe7h9u16Giww8q0QvHKXagoT2eboe-zCuMZoaKdBHpafuaBobVDtpfWgn39X0qL7DGXqP_2MFHUyx4KAu3M1fz8c1B_NnIOoOTVHJXI0NM Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 23:24:05.594306 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 23:24:05.596079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/62cccac090ad43059d82b81818434339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_62cccac090ad43059d82b81818434339", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:24:05.596079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.596079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:05.596079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.596079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:05.596079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 23:24:05.596079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 23:24:05.596079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 0fe603e45401486f873e7b908c8fff7d Jul 27 23:24:05.596079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:05.596079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 23:24:05.596079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:05.596079 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '36342a4b-f2da-450e-8ecc-119a180d598c'} Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:24:05.597519 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:05.598886 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.600464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-a389d1d4-20f5-43c0-80a1-4883bc4218ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Returning 404 to user: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:24:05.600464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-a389d1d4-20f5-43c0-80a1-4883bc4218ab tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "DELETE /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 404 len: 111 microversion: 2.1 time: 0.028240 Jul 27 23:24:05.600464 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1572/3329] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:24:05 2022] DELETE /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:24:05.604989 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d55de53f-edb3-469a-b914-3708ceaec304 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:05.605595 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d55de53f-edb3-469a-b914-3708ceaec304 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 36342a4b-f2da-450e-8ecc-119a180d598c] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:05.612731 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d55de53f-edb3-469a-b914-3708ceaec304 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:05.613173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d55de53f-edb3-469a-b914-3708ceaec304 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:05.614289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d55de53f-edb3-469a-b914-3708ceaec304 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:05.614725 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d55de53f-edb3-469a-b914-3708ceaec304 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:05.627671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-d55de53f-edb3-469a-b914-3708ceaec304 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] HTTP exception thrown: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d55de53f-edb3-469a-b914-3708ceaec304 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Request method failure captured: Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c HTTP/1.1 Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4ce_86_mpgEQhs4gaTV0tfjm8JjmxgPrIo833kLA2weaAY3-wEY-72J-xAWKzgl63sG9VQe7h9u16Giww8q0QvHKXagoT2eboe-zCuMZoaKdBHpafuaBobVDtpfWgn39X0qL7DGXqP_2MFHUyx4KAu3M1fz8c1B_NnIOoOTVHJXI0NM Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:24:05.629218 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:24:05.630970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/62cccac090ad43059d82b81818434339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_62cccac090ad43059d82b81818434339", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:24:05.630970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.630970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:05.630970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.630970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:05.630970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:24:05.630970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:24:05.630970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 0fe603e45401486f873e7b908c8fff7d Jul 27 23:24:05.630970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:05.630970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:24:05.630970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:05.630970 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': '36342a4b-f2da-450e-8ecc-119a180d598c'} Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:24:05.632062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. Jul 27 23:24:05.633888 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.635392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d55de53f-edb3-469a-b914-3708ceaec304 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Returning 404 to user: Instance 36342a4b-f2da-450e-8ecc-119a180d598c could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:24:05.635392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d55de53f-edb3-469a-b914-3708ceaec304 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c" status: 404 len: 111 microversion: 2.1 time: 0.029495 Jul 27 23:24:05.635392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1758/3330] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:05 2022] GET /compute/v2.1/servers/36342a4b-f2da-450e-8ecc-119a180d598c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:24:05.638622 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c480835a-e3ed-4bc1-9f51-1e6e1c90daae tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:05.639133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c480835a-e3ed-4bc1-9f51-1e6e1c90daae tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:05.644995 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c480835a-e3ed-4bc1-9f51-1e6e1c90daae tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:05.645434 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c480835a-e3ed-4bc1-9f51-1e6e1c90daae tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:05.646176 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c480835a-e3ed-4bc1-9f51-1e6e1c90daae tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:05.646602 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c480835a-e3ed-4bc1-9f51-1e6e1c90daae tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:05.659585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-c480835a-e3ed-4bc1-9f51-1e6e1c90daae tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] HTTP exception thrown: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c480835a-e3ed-4bc1-9f51-1e6e1c90daae tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Request method failure captured: Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: DELETE /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f HTTP/1.1 Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4ce_86_mpgEQhs4gaTV0tfjm8JjmxgPrIo833kLA2weaAY3-wEY-72J-xAWKzgl63sG9VQe7h9u16Giww8q0QvHKXagoT2eboe-zCuMZoaKdBHpafuaBobVDtpfWgn39X0qL7DGXqP_2MFHUyx4KAu3M1fz8c1B_NnIOoOTVHJXI0NM Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 23:24:05.661933 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 23:24:05.663677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/62cccac090ad43059d82b81818434339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_62cccac090ad43059d82b81818434339", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:24:05.663677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.663677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:05.663677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.663677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:05.663677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 23:24:05.663677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 23:24:05.663677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 0fe603e45401486f873e7b908c8fff7d Jul 27 23:24:05.663677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:05.663677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 23:24:05.663677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:24:05.663677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '5e09795d-f484-48e2-9e4f-bf9b86e0349f'} Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:24:05.664835 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:24:05.666448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.668078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c480835a-e3ed-4bc1-9f51-1e6e1c90daae tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Returning 404 to user: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:24:05.668078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c480835a-e3ed-4bc1-9f51-1e6e1c90daae tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 404 len: 111 microversion: 2.1 time: 0.028364 Jul 27 23:24:05.668078 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1573/3331] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:24:05 2022] DELETE /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 23:24:05.671515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-946f4bb7-12a0-4d2f-82f3-be606207ef02 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:05.672125 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-946f4bb7-12a0-4d2f-82f3-be606207ef02 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: 5e09795d-f484-48e2-9e4f-bf9b86e0349f] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:05.678750 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-946f4bb7-12a0-4d2f-82f3-be606207ef02 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:05.679199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-946f4bb7-12a0-4d2f-82f3-be606207ef02 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:05.679954 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-946f4bb7-12a0-4d2f-82f3-be606207ef02 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:05.680416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-946f4bb7-12a0-4d2f-82f3-be606207ef02 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:05.693482 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-946f4bb7-12a0-4d2f-82f3-be606207ef02 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] HTTP exception thrown: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-946f4bb7-12a0-4d2f-82f3-be606207ef02 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Request method failure captured: Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f HTTP/1.1 Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4ce_86_mpgEQhs4gaTV0tfjm8JjmxgPrIo833kLA2weaAY3-wEY-72J-xAWKzgl63sG9VQe7h9u16Giww8q0QvHKXagoT2eboe-zCuMZoaKdBHpafuaBobVDtpfWgn39X0qL7DGXqP_2MFHUyx4KAu3M1fz8c1B_NnIOoOTVHJXI0NM Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:24:05.694973 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:24:05.696715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/62cccac090ad43059d82b81818434339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_62cccac090ad43059d82b81818434339", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:24:05.696715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.696715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:05.696715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.696715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:05.696715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:24:05.696715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:24:05.696715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 0fe603e45401486f873e7b908c8fff7d Jul 27 23:24:05.696715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:05.696715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:24:05.696715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:24:05.696715 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': '5e09795d-f484-48e2-9e4f-bf9b86e0349f'} Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:24:05.697692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. Jul 27 23:24:05.699316 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.700839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-946f4bb7-12a0-4d2f-82f3-be606207ef02 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Returning 404 to user: Instance 5e09795d-f484-48e2-9e4f-bf9b86e0349f could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:24:05.700839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-946f4bb7-12a0-4d2f-82f3-be606207ef02 tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f" status: 404 len: 111 microversion: 2.1 time: 0.028644 Jul 27 23:24:05.700839 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1759/3332] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:05 2022] GET /compute/v2.1/servers/5e09795d-f484-48e2-9e4f-bf9b86e0349f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 23:24:05.704474 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b8c13789-22d3-44f1-89fa-16cb2e3f607e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:05.704983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b8c13789-22d3-44f1-89fa-16cb2e3f607e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:05.711762 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b8c13789-22d3-44f1-89fa-16cb2e3f607e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:05.712199 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b8c13789-22d3-44f1-89fa-16cb2e3f607e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:05.712983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b8c13789-22d3-44f1-89fa-16cb2e3f607e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:05.713409 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b8c13789-22d3-44f1-89fa-16cb2e3f607e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:05.727165 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-b8c13789-22d3-44f1-89fa-16cb2e3f607e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] HTTP exception thrown: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b8c13789-22d3-44f1-89fa-16cb2e3f607e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Request method failure captured: Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: DELETE /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed HTTP/1.1 Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4ce_86_mpgEQhs4gaTV0tfjm8JjmxgPrIo833kLA2weaAY3-wEY-72J-xAWKzgl63sG9VQe7h9u16Giww8q0QvHKXagoT2eboe-zCuMZoaKdBHpafuaBobVDtpfWgn39X0qL7DGXqP_2MFHUyx4KAu3M1fz8c1B_NnIOoOTVHJXI0NM Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 23:24:05.729182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 23:24:05.731035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/62cccac090ad43059d82b81818434339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_62cccac090ad43059d82b81818434339", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:24:05.731035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.731035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:05.731035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.731035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:05.731035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 23:24:05.731035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 23:24:05.731035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 0fe603e45401486f873e7b908c8fff7d Jul 27 23:24:05.731035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:05.731035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 23:24:05.731035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:24:05.731035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': 'a7144f46-2169-40af-94a2-6d93b1dca4ed'} Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:24:05.732030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:24:05.733679 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.735309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b8c13789-22d3-44f1-89fa-16cb2e3f607e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Returning 404 to user: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:24:05.735309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b8c13789-22d3-44f1-89fa-16cb2e3f607e tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 404 len: 111 microversion: 2.1 time: 0.030179 Jul 27 23:24:05.735309 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1574/3333] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:24:05 2022] DELETE /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 23:24:05.739987 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-578d255d-98cf-47c6-8a3a-5ed3736da41c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:05.740878 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-578d255d-98cf-47c6-8a3a-5ed3736da41c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] [instance: a7144f46-2169-40af-94a2-6d93b1dca4ed] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:05.747315 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-578d255d-98cf-47c6-8a3a-5ed3736da41c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:05.747761 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-578d255d-98cf-47c6-8a3a-5ed3736da41c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:05.748512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-578d255d-98cf-47c6-8a3a-5ed3736da41c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:05.748971 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-578d255d-98cf-47c6-8a3a-5ed3736da41c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:05.762371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-578d255d-98cf-47c6-8a3a-5ed3736da41c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] HTTP exception thrown: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-578d255d-98cf-47c6-8a3a-5ed3736da41c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Request method failure captured: Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed HTTP/1.1 Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4ce_86_mpgEQhs4gaTV0tfjm8JjmxgPrIo833kLA2weaAY3-wEY-72J-xAWKzgl63sG9VQe7h9u16Giww8q0QvHKXagoT2eboe-zCuMZoaKdBHpafuaBobVDtpfWgn39X0qL7DGXqP_2MFHUyx4KAu3M1fz8c1B_NnIOoOTVHJXI0NM Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:24:05.764142 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:24:05.765909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/62cccac090ad43059d82b81818434339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_62cccac090ad43059d82b81818434339", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/62cccac090ad43059d82b81818434339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:24:05.765909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.765909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 62cccac090ad43059d82b81818434339 Jul 27 23:24:05.765909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1194419272 Jul 27 23:24:05.765909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:05.765909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:24:05.765909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:24:05.765909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: 0fe603e45401486f873e7b908c8fff7d Jul 27 23:24:05.765909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-AttachVolumeNegativeTest-1194419272-project Jul 27 23:24:05.765909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:24:05.765909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:24:05.765909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': 'a7144f46-2169-40af-94a2-6d93b1dca4ed'} Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:24:05.766913 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. Jul 27 23:24:05.768534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:05.770779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-578d255d-98cf-47c6-8a3a-5ed3736da41c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] Returning 404 to user: Instance a7144f46-2169-40af-94a2-6d93b1dca4ed could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:24:05.770779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-578d255d-98cf-47c6-8a3a-5ed3736da41c tempest-AttachVolumeNegativeTest-1194419272 tempest-AttachVolumeNegativeTest-1194419272-project] 10.222.0.47 "GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed" status: 404 len: 111 microversion: 2.1 time: 0.029999 Jul 27 23:24:05.770779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1760/3334] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:05 2022] GET /compute/v2.1/servers/a7144f46-2169-40af-94a2-6d93b1dca4ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 23:24:17.521749 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1226a1eb-f52d-46d8-8f32-c039511977be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:17.522979 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1226a1eb-f52d-46d8-8f32-c039511977be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:17.527071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:24:17.527919 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:24:17.533472 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1226a1eb-f52d-46d8-8f32-c039511977be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:17.533983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1226a1eb-f52d-46d8-8f32-c039511977be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:17.535510 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1226a1eb-f52d-46d8-8f32-c039511977be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:17.536084 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-1226a1eb-f52d-46d8-8f32-c039511977be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:17.566877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-1226a1eb-f52d-46d8-8f32-c039511977be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Going to try to terminate instance {{(pid=129294) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 23:24:17.671353 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1226a1eb-f52d-46d8-8f32-c039511977be tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 204 len: 0 microversion: 2.1 time: 0.154473 Jul 27 23:24:17.672091 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1575/3335] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:24:17 2022] DELETE /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 23:24:17.680470 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-dd95959f-f1a5-404a-8d5a-a0e01ceeb35e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:17.688487 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-dd95959f-f1a5-404a-8d5a-a0e01ceeb35e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:17.691043 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:24:17.691673 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=18 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:24:17.699507 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd95959f-f1a5-404a-8d5a-a0e01ceeb35e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:17.700247 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd95959f-f1a5-404a-8d5a-a0e01ceeb35e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:17.701111 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd95959f-f1a5-404a-8d5a-a0e01ceeb35e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:17.701608 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-dd95959f-f1a5-404a-8d5a-a0e01ceeb35e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:17.884374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-dd95959f-f1a5-404a-8d5a-a0e01ceeb35e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:24:17.892625 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-dd95959f-f1a5-404a-8d5a-a0e01ceeb35e tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1508 microversion: 2.1 time: 0.215637 Jul 27 23:24:17.893258 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1761/3336] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:17 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:24:18.917160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-f6656c4b-5f8e-4f0c-8e9d-9a978f2b7188 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:18.917859 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-f6656c4b-5f8e-4f0c-8e9d-9a978f2b7188 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:18.925819 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6656c4b-5f8e-4f0c-8e9d-9a978f2b7188 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:18.926849 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6656c4b-5f8e-4f0c-8e9d-9a978f2b7188 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:18.927688 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6656c4b-5f8e-4f0c-8e9d-9a978f2b7188 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:18.928071 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-f6656c4b-5f8e-4f0c-8e9d-9a978f2b7188 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:19.075491 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-f6656c4b-5f8e-4f0c-8e9d-9a978f2b7188 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:24:19.084011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-f6656c4b-5f8e-4f0c-8e9d-9a978f2b7188 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1508 microversion: 2.1 time: 0.171027 Jul 27 23:24:19.084587 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1576/3337] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:18 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:24:20.106890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a6f0870d-bae3-4464-99ab-bb5ca50ae687 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:20.107513 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a6f0870d-bae3-4464-99ab-bb5ca50ae687 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:20.117280 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a6f0870d-bae3-4464-99ab-bb5ca50ae687 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:20.117729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a6f0870d-bae3-4464-99ab-bb5ca50ae687 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:20.118493 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a6f0870d-bae3-4464-99ab-bb5ca50ae687 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:20.118922 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a6f0870d-bae3-4464-99ab-bb5ca50ae687 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:20.286155 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a6f0870d-bae3-4464-99ab-bb5ca50ae687 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:24:20.294929 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a6f0870d-bae3-4464-99ab-bb5ca50ae687 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1508 microversion: 2.1 time: 0.193505 Jul 27 23:24:20.295496 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1762/3338] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:20 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:24:20.705614 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-074e4c97-3e46-4fe8-ba66-0b5e68a73581 req-cbc9eea7-c582-4947-acf4-c29fe2351adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a6fc53-bd93-47c4-9413-39ba0e1b6068", "name": "network-vif-deleted", "tag": "ea3daece-2ad0-4979-adb0-cba646786ccc"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:24:20.726270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-074e4c97-3e46-4fe8-ba66-0b5e68a73581 req-cbc9eea7-c582-4947-acf4-c29fe2351adc service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:20.726983 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-074e4c97-3e46-4fe8-ba66-0b5e68a73581 req-cbc9eea7-c582-4947-acf4-c29fe2351adc service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:20.745228 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-074e4c97-3e46-4fe8-ba66-0b5e68a73581 req-cbc9eea7-c582-4947-acf4-c29fe2351adc service nova] Creating event network-vif-deleted:ea3daece-2ad0-4979-adb0-cba646786ccc for instance 69a6fc53-bd93-47c4-9413-39ba0e1b6068 on hv-cinder-85124 Jul 27 23:24:20.751166 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-074e4c97-3e46-4fe8-ba66-0b5e68a73581 req-cbc9eea7-c582-4947-acf4-c29fe2351adc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050119 Jul 27 23:24:20.752522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1577/3339] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:24:21.315880 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-965de543-7cb9-4e2d-abe6-fccd70c7ba00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:21.317136 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-965de543-7cb9-4e2d-abe6-fccd70c7ba00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:21.341856 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-965de543-7cb9-4e2d-abe6-fccd70c7ba00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:21.342930 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-965de543-7cb9-4e2d-abe6-fccd70c7ba00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:21.352890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-965de543-7cb9-4e2d-abe6-fccd70c7ba00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:21.355248 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-965de543-7cb9-4e2d-abe6-fccd70c7ba00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:21.429457 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:24:21.429863 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:24:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 (ip 10.222.0.47) !!! Jul 27 23:24:21.645233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-965de543-7cb9-4e2d-abe6-fccd70c7ba00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:24:21.661620 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-965de543-7cb9-4e2d-abe6-fccd70c7ba00 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 200 len: 1466 microversion: 2.1 time: 0.349952 Jul 27 23:24:21.662554 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1763/3340] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:21 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 1466 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:24:22.690403 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-83cbee7d-71e6-4935-b97c-7702686871e9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:22.692273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-83cbee7d-71e6-4935-b97c-7702686871e9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: d3c90c3b-021d-449c-8d25-b38e625ffc54] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:22.703551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83cbee7d-71e6-4935-b97c-7702686871e9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:22.703551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83cbee7d-71e6-4935-b97c-7702686871e9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:22.703551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83cbee7d-71e6-4935-b97c-7702686871e9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:22.703551 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-83cbee7d-71e6-4935-b97c-7702686871e9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:22.718402 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-83cbee7d-71e6-4935-b97c-7702686871e9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] HTTP exception thrown: Instance d3c90c3b-021d-449c-8d25-b38e625ffc54 could not be found. Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-83cbee7d-71e6-4935-b97c-7702686871e9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Request method failure captured: Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 HTTP/1.1 Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cDsRp2x8UpNMJ6HnBL-04WjUw31hp5CQUUOuE9hX6DL43I06gDHp83bInXEQLrb4zFa-kZlcoaFH3UrxhEO0ftl3Kz56nR7Tj73l4oReVlfBtLEtyl0TNrPvrewHdkBZTsrykZJENrf-93DZvOEzTZW--OfosHDvz7hDCnuewnIq_c Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: fc02f444ea474300a879336c8b122303 Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1076644021 Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 23:24:22.720068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 23:24:22.721926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fc02f444ea474300a879336c8b122303"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fc02f444ea474300a879336c8b122303", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fc02f444ea474300a879336c8b122303"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fc02f444ea474300a879336c8b122303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:24:22.721926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1076644021 Jul 27 23:24:22.721926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: fc02f444ea474300a879336c8b122303 Jul 27 23:24:22.721926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1076644021 Jul 27 23:24:22.721926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-ServerRescueNegativeTestJSON-1076644021-project Jul 27 23:24:22.721926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 23:24:22.721926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 23:24:22.721926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: a5c5f856a38849a39d84b6cd0706da4e Jul 27 23:24:22.721926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1076644021-project Jul 27 23:24:22.721926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: > Jul 27 23:24:22.721926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Instance d3c90c3b-021d-449c-8d25-b38e625ffc54 could not be found. Jul 27 23:24:22.721926 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': 'd3c90c3b-021d-449c-8d25-b38e625ffc54'} Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c90c3b-021d-449c-8d25-b38e625ffc54 could not be found. Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:24:22.722798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c90c3b-021d-449c-8d25-b38e625ffc54 could not be found. Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c90c3b-021d-449c-8d25-b38e625ffc54 could not be found. Jul 27 23:24:22.724419 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:22.728986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-83cbee7d-71e6-4935-b97c-7702686871e9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Returning 404 to user: Instance d3c90c3b-021d-449c-8d25-b38e625ffc54 could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:24:22.728986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-83cbee7d-71e6-4935-b97c-7702686871e9 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54" status: 404 len: 111 microversion: 2.1 time: 0.040992 Jul 27 23:24:22.728986 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1578/3341] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:22 2022] GET /compute/v2.1/servers/d3c90c3b-021d-449c-8d25-b38e625ffc54 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:24:22.733285 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-87ebee17-7f99-41fb-b199-d614090e6dcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:22.733764 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-87ebee17-7f99-41fb-b199-d614090e6dcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:22.741112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87ebee17-7f99-41fb-b199-d614090e6dcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:22.741563 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87ebee17-7f99-41fb-b199-d614090e6dcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:22.742598 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87ebee17-7f99-41fb-b199-d614090e6dcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:22.743034 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-87ebee17-7f99-41fb-b199-d614090e6dcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:22.770916 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-830fad15-b1d7-443e-b806-5e5c52775542 req-0984b5c5-1b95-4c24-a683-d4e97d6b6567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c90c3b-021d-449c-8d25-b38e625ffc54", "name": "network-vif-deleted", "tag": "00778e2c-f71b-4986-8a16-14796fb6efad"}, {"server_uuid": "b19fab65-5354-4383-ba3a-9eb6614382ff", "name": "network-vif-deleted", "tag": "e46bb58f-7220-4510-a401-14284c9dde2a"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:24:22.783085 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-830fad15-b1d7-443e-b806-5e5c52775542 req-0984b5c5-1b95-4c24-a683-d4e97d6b6567 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:22.783870 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-830fad15-b1d7-443e-b806-5e5c52775542 req-0984b5c5-1b95-4c24-a683-d4e97d6b6567 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:22.796097 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-87ebee17-7f99-41fb-b199-d614090e6dcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Going to try to terminate instance {{(pid=129295) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 23:24:22.800485 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-830fad15-b1d7-443e-b806-5e5c52775542 req-0984b5c5-1b95-4c24-a683-d4e97d6b6567 service nova] Creating event network-vif-deleted:00778e2c-f71b-4986-8a16-14796fb6efad for instance d3c90c3b-021d-449c-8d25-b38e625ffc54 on hv-cinder-85124 Jul 27 23:24:22.801012 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-830fad15-b1d7-443e-b806-5e5c52775542 req-0984b5c5-1b95-4c24-a683-d4e97d6b6567 service nova] Creating event network-vif-deleted:e46bb58f-7220-4510-a401-14284c9dde2a for instance b19fab65-5354-4383-ba3a-9eb6614382ff on hv-cinder-85124 Jul 27 23:24:22.807268 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-830fad15-b1d7-443e-b806-5e5c52775542 req-0984b5c5-1b95-4c24-a683-d4e97d6b6567 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040756 Jul 27 23:24:22.807862 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1579/3342] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 23:24:22.919324 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-87ebee17-7f99-41fb-b199-d614090e6dcf tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 204 len: 0 microversion: 2.1 time: 0.189792 Jul 27 23:24:22.922237 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1764/3343] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:24:22 2022] DELETE /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 23:24:22.930275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4585f2be-d925-46a7-9446-8e0657624976 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:22.930964 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4585f2be-d925-46a7-9446-8e0657624976 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:22.937965 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4585f2be-d925-46a7-9446-8e0657624976 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:22.938448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4585f2be-d925-46a7-9446-8e0657624976 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:22.939165 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4585f2be-d925-46a7-9446-8e0657624976 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:22.939593 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4585f2be-d925-46a7-9446-8e0657624976 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:23.161659 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4585f2be-d925-46a7-9446-8e0657624976 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:24:23.170379 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4585f2be-d925-46a7-9446-8e0657624976 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1523 microversion: 2.1 time: 0.244378 Jul 27 23:24:23.171273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1580/3344] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:22 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:24:24.192818 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fb834332-bdc3-450e-9413-00e110ff67d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:24.194421 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fb834332-bdc3-450e-9413-00e110ff67d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:24.209434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb834332-bdc3-450e-9413-00e110ff67d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:24.209896 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb834332-bdc3-450e-9413-00e110ff67d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:24.210675 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb834332-bdc3-450e-9413-00e110ff67d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:24.220228 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fb834332-bdc3-450e-9413-00e110ff67d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:24.399845 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fb834332-bdc3-450e-9413-00e110ff67d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c5f856a38849a39d84b6cd0706da4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc02f444ea474300a879336c8b122303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:24:24.415088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fb834332-bdc3-450e-9413-00e110ff67d6 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 200 len: 1481 microversion: 2.1 time: 0.226954 Jul 27 23:24:24.416339 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1765/3345] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:24 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 1481 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:24:24.826408 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-d17e12c6-418c-467b-b1eb-adb0147bc079 req-1d5333d4-7d7c-48bd-a5b0-e0eefd0bccd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6", "name": "network-vif-deleted", "tag": "375463fd-0894-4aa2-b316-8b4f2c64de4d"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:24:24.838673 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-d17e12c6-418c-467b-b1eb-adb0147bc079 req-1d5333d4-7d7c-48bd-a5b0-e0eefd0bccd4 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:24.839664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-d17e12c6-418c-467b-b1eb-adb0147bc079 req-1d5333d4-7d7c-48bd-a5b0-e0eefd0bccd4 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:24.859271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-d17e12c6-418c-467b-b1eb-adb0147bc079 req-1d5333d4-7d7c-48bd-a5b0-e0eefd0bccd4 service nova] Creating event network-vif-deleted:375463fd-0894-4aa2-b316-8b4f2c64de4d for instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 on hv-cinder-85124 Jul 27 23:24:24.866594 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-d17e12c6-418c-467b-b1eb-adb0147bc079 req-1d5333d4-7d7c-48bd-a5b0-e0eefd0bccd4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044511 Jul 27 23:24:24.867182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1581/3346] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 23:24:25.436066 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-faf9d553-ae52-4cae-84dc-c3f502658c77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:25.436697 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-faf9d553-ae52-4cae-84dc-c3f502658c77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] [instance: b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:24:25.442687 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-faf9d553-ae52-4cae-84dc-c3f502658c77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:25.443117 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-faf9d553-ae52-4cae-84dc-c3f502658c77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:25.443860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-faf9d553-ae52-4cae-84dc-c3f502658c77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:24:25.444288 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-faf9d553-ae52-4cae-84dc-c3f502658c77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:24:25.457671 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-faf9d553-ae52-4cae-84dc-c3f502658c77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] HTTP exception thrown: Instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 could not be found. Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-faf9d553-ae52-4cae-84dc-c3f502658c77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Request method failure captured: Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 HTTP/1.1 Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4cDsRp2x8UpNMJ6HnBL-04WjUw31hp5CQUUOuE9hX6DL43I06gDHp83bInXEQLrb4zFa-kZlcoaFH3UrxhEO0ftl3Kz56nR7Tj73l4oReVlfBtLEtyl0TNrPvrewHdkBZTsrykZJENrf-93DZvOEzTZW--OfosHDvz7hDCnuewnIq_c Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: fc02f444ea474300a879336c8b122303 Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1076644021 Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:24:25.459289 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:24:25.461055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fc02f444ea474300a879336c8b122303"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fc02f444ea474300a879336c8b122303", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fc02f444ea474300a879336c8b122303"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fc02f444ea474300a879336c8b122303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:24:25.461055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1076644021 Jul 27 23:24:25.461055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: fc02f444ea474300a879336c8b122303 Jul 27 23:24:25.461055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1076644021 Jul 27 23:24:25.461055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-ServerRescueNegativeTestJSON-1076644021-project Jul 27 23:24:25.461055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:24:25.461055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:24:25.461055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: a5c5f856a38849a39d84b6cd0706da4e Jul 27 23:24:25.461055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1076644021-project Jul 27 23:24:25.461055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:24:25.461055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 could not be found. Jul 27 23:24:25.461055 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': 'b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6'} Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 could not be found. Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:24:25.461982 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 could not be found. Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 could not be found. Jul 27 23:24:25.463362 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:24:25.464644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-faf9d553-ae52-4cae-84dc-c3f502658c77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] Returning 404 to user: Instance b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:24:25.464644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-faf9d553-ae52-4cae-84dc-c3f502658c77 tempest-ServerRescueNegativeTestJSON-1076644021 tempest-ServerRescueNegativeTestJSON-1076644021-project] 10.222.0.47 "GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6" status: 404 len: 111 microversion: 2.1 time: 0.028561 Jul 27 23:24:25.464644 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1766/3347] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:24:25 2022] GET /compute/v2.1/servers/b38ea9f9-b10a-4fcf-9e60-d8bc89cffea6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:24:30.019860 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-81070e3d-1931-4ee3-942b-fdb61a834f4c tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] Action: 'create', calling method: .version_select at 0x7f696a262280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-411455202", "metadata": {"Type": "work"}}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:24:30.350720 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-81070e3d-1931-4ee3-942b-fdb61a834f4c tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.496079 Jul 27 23:24:30.351429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1582/3348] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Jul 27 23:24:29 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 498 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 23:24:30.364299 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-831cb67b-5d64-47b0-98c1-470f56f14182 tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] Calling method '.version_select at 0x7f696befc550>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:30.414842 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-831cb67b-5d64-47b0-98c1-470f56f14182 tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/486bc45b-e282-4ffa-9ca4-91470014166e" status: 200 len: 352 microversion: 2.1 time: 0.054890 Jul 27 23:24:30.415416 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1767/3349] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 23:24:30 2022] GET /compute/v2.1/os-volumes/486bc45b-e282-4ffa-9ca4-91470014166e => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:24:31.429251 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-1bae999f-aafd-419f-82a7-353ccce9aa0d tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] Calling method '.version_select at 0x7f696e88d790>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:31.481158 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-1bae999f-aafd-419f-82a7-353ccce9aa0d tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/486bc45b-e282-4ffa-9ca4-91470014166e" status: 200 len: 353 microversion: 2.1 time: 0.056174 Jul 27 23:24:31.481731 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1583/3350] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 23:24:31 2022] GET /compute/v2.1/os-volumes/486bc45b-e282-4ffa-9ca4-91470014166e => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:24:31.495157 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-69352373-5650-4858-8741-743f4b31b941 tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] Calling method '.version_select at 0x7f696a125430>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:31.546173 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-69352373-5650-4858-8741-743f4b31b941 tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/486bc45b-e282-4ffa-9ca4-91470014166e" status: 200 len: 353 microversion: 2.1 time: 0.055723 Jul 27 23:24:31.546722 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1768/3351] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 23:24:31 2022] GET /compute/v2.1/os-volumes/486bc45b-e282-4ffa-9ca4-91470014166e => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:24:31.566008 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9245ff8b-a1ef-4242-9080-229d416cc937 tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] Calling method '.version_select at 0x7f6969f7fc10>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:31.628579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9245ff8b-a1ef-4242-9080-229d416cc937 tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/486bc45b-e282-4ffa-9ca4-91470014166e" status: 202 len: 0 microversion: 2.1 time: 0.066242 Jul 27 23:24:31.631002 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1584/3352] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Jul 27 23:24:31 2022] DELETE /compute/v2.1/os-volumes/486bc45b-e282-4ffa-9ca4-91470014166e => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 23:24:31.638882 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-49eb01a7-d871-40b4-92eb-f1fc91bf9c98 tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] Calling method '.version_select at 0x7f696befc040>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:31.689918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-49eb01a7-d871-40b4-92eb-f1fc91bf9c98 tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/486bc45b-e282-4ffa-9ca4-91470014166e" status: 200 len: 352 microversion: 2.1 time: 0.054688 Jul 27 23:24:31.690487 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1769/3353] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 23:24:31 2022] GET /compute/v2.1/os-volumes/486bc45b-e282-4ffa-9ca4-91470014166e => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:24:32.703636 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d177e7c3-5294-4748-ac72-363199057a85 tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] Calling method '.version_select at 0x7f696a236310>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:24:32.733089 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.wsgi [None req-d177e7c3-5294-4748-ac72-363199057a85 tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] HTTP exception thrown: Volume 486bc45b-e282-4ffa-9ca4-91470014166e could not be found. Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d177e7c3-5294-4748-ac72-363199057a85 tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] Request method failure captured: Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: request: GET /compute/v2.1/os-volumes/486bc45b-e282-4ffa-9ca4-91470014166e HTTP/1.1 Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept: application/json Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Accept-Encoding: identity Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Connection: close Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Length: 0 Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Content-Type: application/json Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Host: 10.222.0.47 Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Openstack-System-Scope: None Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: User-Agent: python-urllib3/1.26.10 Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Auth-Token: gAAAAABi4cktqRzwiUfb9mPrEeXiB1c8Fmwd8-v2abAnPANppeS_2scV-ImAkmVSFFghbxAqewESIORjWKke9B3YsSRNklMI1jH-4r9uPsihV0stc5IfaMONPSCpFpvGtxR2b0ROhUZq9oDv32bHYKb8jdDrCkaBVlNwM_Ard1aoS8rwwG93fF0 Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Id: None Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Domain-Name: None Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Identity-Status: Confirmed Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Is-Admin-Project: True Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Id: default Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Domain-Name: Default Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Id: 4e7d67bb5ffe4eed8ef462d82aa925b7 Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Project-Name: tempest-VolumesGetTestJSON-620367547 Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Role: member,reader Jul 27 23:24:32.735311 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Roles: member,reader Jul 27 23:24:32.737271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4e7d67bb5ffe4eed8ef462d82aa925b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4e7d67bb5ffe4eed8ef462d82aa925b7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4e7d67bb5ffe4eed8ef462d82aa925b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4e7d67bb5ffe4eed8ef462d82aa925b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:24:32.737271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant: tempest-VolumesGetTestJSON-620367547 Jul 27 23:24:32.737271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Id: 4e7d67bb5ffe4eed8ef462d82aa925b7 Jul 27 23:24:32.737271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-Tenant-Name: tempest-VolumesGetTestJSON-620367547 Jul 27 23:24:32.737271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User: tempest-VolumesGetTestJSON-620367547-project Jul 27 23:24:32.737271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Id: default Jul 27 23:24:32.737271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Domain-Name: Default Jul 27 23:24:32.737271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Id: 241c4198517e46978bbf81f3b2238d6f Jul 27 23:24:32.737271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: X-User-Name: tempest-VolumesGetTestJSON-620367547-project Jul 27 23:24:32.737271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: method: Jul 27 23:24:32.737271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: exception: Volume 486bc45b-e282-4ffa-9ca4-91470014166e could not be found. Jul 27 23:24:32.737271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: action_args: {'id': '486bc45b-e282-4ffa-9ca4-91470014166e'} Jul 27 23:24:32.737271 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 486bc45b-e282-4ffa-9ca4-91470014166e could not be found. (HTTP 404) (Request-ID: req-583b3ad3-7fe1-488e-a995-188d1c40baa6) Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:32.738985 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 23:24:32.743864 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 486bc45b-e282-4ffa-9ca4-91470014166e could not be found. Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 23:24:32.745567 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 486bc45b-e282-4ffa-9ca4-91470014166e could not be found. Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 486bc45b-e282-4ffa-9ca4-91470014166e could not be found. Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR nova.api.openstack.wsgi Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d177e7c3-5294-4748-ac72-363199057a85 tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] Returning 404 to user: Volume 486bc45b-e282-4ffa-9ca4-91470014166e could not be found. {{(pid=129294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d177e7c3-5294-4748-ac72-363199057a85 tempest-VolumesGetTestJSON-620367547 tempest-VolumesGetTestJSON-620367547-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/486bc45b-e282-4ffa-9ca4-91470014166e" status: 404 len: 109 microversion: 2.1 time: 0.038432 Jul 27 23:24:32.747685 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1585/3354] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Jul 27 23:24:32 2022] GET /compute/v2.1/os-volumes/486bc45b-e282-4ffa-9ca4-91470014166e => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:25:00.539959 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:25:00.540779 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:25:00.799265 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3addc46d-2539-48fb-9db5-370b272b9d2c tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Action: 'create', calling method: .version_select at 0x7f696e93adc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1099128410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRRHLTW+CAFgFg5a0feTcrd5JTgjsfxeuWWmhGfK7jOfv8+XxOHMB7Ef2cLudB6H632hLCdItPPoT8jMWmfOHrutgFRjr7ytnXRQb5ibzAxn5fXw+iJsE/AbyvJ0Uef/Q=="}} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:25:00.822636 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-3addc46d-2539-48fb-9db5-370b272b9d2c tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Getting quotas for project 80bdecf8fad2460d969f4dad6ced9d9a. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 23:25:00.828782 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.quota [None req-3addc46d-2539-48fb-9db5-370b272b9d2c tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Getting quotas for user a4eb6d71e41a4cb4889d956b6a84f975 and project 80bdecf8fad2460d969f4dad6ced9d9a. Resources: {'key_pairs'} {{(pid=129295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 23:25:00.878322 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3addc46d-2539-48fb-9db5-370b272b9d2c tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.339616 Jul 27 23:25:00.879343 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1770/3355] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Jul 27 23:25:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:25:24.474989 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:25:24.475730 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:25:24.480329 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-222687357", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1099128410", "security_groups": [{"name": "tempest-secgroup-smoke-2072358533"}], "networks": [{"uuid": "db46d7a5-389f-406d-81e4-d962709f3c74"}], "block_device_mapping_v2": [{"uuid": "4a779bc8-1113-487f-b6ed-d70d7b055aff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:25:24.791412 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.network.neutron [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] validate_networks() for [('db46d7a5-389f-406d-81e4-d962709f3c74', None, None, None, None, None)] {{(pid=129294) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 23:25:25.255225 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Flavor limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 23:25:25.255648 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Image limits 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 23:25:25.256119 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Flavor pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 23:25:25.256526 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Image pref 0:0:0 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 23:25:25.256976 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.virt.hardware [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 23:25:25.266357 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:25.266798 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:25.267579 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:25.268009 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:25.284764 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Getting quotas for project 80bdecf8fad2460d969f4dad6ced9d9a. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 23:25:25.289294 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.quota [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Getting quotas for user a4eb6d71e41a4cb4889d956b6a84f975 and project 80bdecf8fad2460d969f4dad6ced9d9a. Resources: {'ram', 'cores', 'instances'} {{(pid=129294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 23:25:25.344070 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Going to run 1 instances... {{(pid=129294) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 23:25:25.346273 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a779bc8-1113-487f-b6ed-d70d7b055aff',volume_size=None,volume_type=None)] {{(pid=129294) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 23:25:25.472222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-9e8ad0fc-f2ce-407c-92c8-da611322a09f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.999160 Jul 27 23:25:25.472891 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1586/3356] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Jul 27 23:25:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 23:25:25.481785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=4 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:25:25.482768 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:25:25.486691 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f2b8406b-f4a5-47e5-a374-0a607a90e140 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:25.487371 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f2b8406b-f4a5-47e5-a374-0a607a90e140 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:25.601393 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f2b8406b-f4a5-47e5-a374-0a607a90e140 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:25.608025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f2b8406b-f4a5-47e5-a374-0a607a90e140 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1088 microversion: 2.1 time: 0.127676 Jul 27 23:25:25.608588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1771/3357] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:25 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1088 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:26.629413 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-04df0093-60b3-486a-9565-ada374966437 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:26.630019 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-04df0093-60b3-486a-9565-ada374966437 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:26.638778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04df0093-60b3-486a-9565-ada374966437 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:26.639275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04df0093-60b3-486a-9565-ada374966437 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:26.640030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04df0093-60b3-486a-9565-ada374966437 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:26.640455 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04df0093-60b3-486a-9565-ada374966437 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:26.703906 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-04df0093-60b3-486a-9565-ada374966437 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:26.711656 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-04df0093-60b3-486a-9565-ada374966437 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1204 microversion: 2.1 time: 0.086868 Jul 27 23:25:26.712215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1587/3358] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:26 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1204 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:27.733481 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-32d955e1-5ba2-4f8a-9f4b-db8113e1b49b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:27.734089 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-32d955e1-5ba2-4f8a-9f4b-db8113e1b49b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:27.741974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-32d955e1-5ba2-4f8a-9f4b-db8113e1b49b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:27.742621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-32d955e1-5ba2-4f8a-9f4b-db8113e1b49b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:27.743480 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-32d955e1-5ba2-4f8a-9f4b-db8113e1b49b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:27.743915 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-32d955e1-5ba2-4f8a-9f4b-db8113e1b49b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:27.898365 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-32d955e1-5ba2-4f8a-9f4b-db8113e1b49b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:27.909053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-32d955e1-5ba2-4f8a-9f4b-db8113e1b49b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1260 microversion: 2.1 time: 0.179250 Jul 27 23:25:27.909238 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-3f64428f-ce8e-481c-9ba9-a790b2cb52c8 req-09afd236-f289-45a9-ae4d-eb5f21200b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9410429-a694-4ac4-88ac-7db8cf2c6786", "tag": "3bb6d854-ec87-49ce-a58f-07a6f86d69d2"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:25:27.911805 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1772/3359] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:27 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:27.924969 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-3f64428f-ce8e-481c-9ba9-a790b2cb52c8 req-09afd236-f289-45a9-ae4d-eb5f21200b6c service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:27.925496 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-3f64428f-ce8e-481c-9ba9-a790b2cb52c8 req-09afd236-f289-45a9-ae4d-eb5f21200b6c service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:27.938186 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-3f64428f-ce8e-481c-9ba9-a790b2cb52c8 req-09afd236-f289-45a9-ae4d-eb5f21200b6c service nova] Creating event network-changed:3bb6d854-ec87-49ce-a58f-07a6f86d69d2 for instance e9410429-a694-4ac4-88ac-7db8cf2c6786 on hv-cinder-85124 Jul 27 23:25:27.944039 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-3f64428f-ce8e-481c-9ba9-a790b2cb52c8 req-09afd236-f289-45a9-ae4d-eb5f21200b6c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037886 Jul 27 23:25:27.944669 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1588/3360] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:25:28.930721 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-3c8ca1d9-9e87-4652-847e-0efb48ef1f48 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:28.931357 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-3c8ca1d9-9e87-4652-847e-0efb48ef1f48 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:28.938676 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c8ca1d9-9e87-4652-847e-0efb48ef1f48 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:28.939131 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c8ca1d9-9e87-4652-847e-0efb48ef1f48 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:28.939892 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c8ca1d9-9e87-4652-847e-0efb48ef1f48 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:28.940326 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-3c8ca1d9-9e87-4652-847e-0efb48ef1f48 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:29.070058 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-3c8ca1d9-9e87-4652-847e-0efb48ef1f48 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:29.077564 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-3c8ca1d9-9e87-4652-847e-0efb48ef1f48 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1260 microversion: 2.1 time: 0.151283 Jul 27 23:25:29.078128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1773/3361] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:28 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:30.098742 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c888e3d3-bc96-470c-8687-94c5cd8e0c2e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:30.099470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c888e3d3-bc96-470c-8687-94c5cd8e0c2e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:30.105795 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c888e3d3-bc96-470c-8687-94c5cd8e0c2e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:30.106185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c888e3d3-bc96-470c-8687-94c5cd8e0c2e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:30.107222 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c888e3d3-bc96-470c-8687-94c5cd8e0c2e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:30.107400 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c888e3d3-bc96-470c-8687-94c5cd8e0c2e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:30.242545 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c888e3d3-bc96-470c-8687-94c5cd8e0c2e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:30.250113 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c888e3d3-bc96-470c-8687-94c5cd8e0c2e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1260 microversion: 2.1 time: 0.156039 Jul 27 23:25:30.250664 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1589/3362] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:30 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:31.270274 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-d366aaf1-a9de-4ce6-bdba-aa060566c8f9 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:31.271392 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-d366aaf1-a9de-4ce6-bdba-aa060566c8f9 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:31.277816 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d366aaf1-a9de-4ce6-bdba-aa060566c8f9 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:31.278256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d366aaf1-a9de-4ce6-bdba-aa060566c8f9 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:31.278999 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d366aaf1-a9de-4ce6-bdba-aa060566c8f9 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:31.279426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-d366aaf1-a9de-4ce6-bdba-aa060566c8f9 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:31.405621 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-d366aaf1-a9de-4ce6-bdba-aa060566c8f9 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:31.413441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-d366aaf1-a9de-4ce6-bdba-aa060566c8f9 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1260 microversion: 2.1 time: 0.147040 Jul 27 23:25:31.413992 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1774/3363] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:31 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:32.434429 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-91d531ea-9616-4004-8159-1060e9172a87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:32.434961 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-91d531ea-9616-4004-8159-1060e9172a87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:32.441376 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91d531ea-9616-4004-8159-1060e9172a87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:32.441814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91d531ea-9616-4004-8159-1060e9172a87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:32.442556 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91d531ea-9616-4004-8159-1060e9172a87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:32.443007 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-91d531ea-9616-4004-8159-1060e9172a87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:32.574728 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-91d531ea-9616-4004-8159-1060e9172a87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:32.582068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-91d531ea-9616-4004-8159-1060e9172a87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1260 microversion: 2.1 time: 0.151584 Jul 27 23:25:32.582628 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1590/3364] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:32 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:33.602635 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-4d769867-9581-4bd2-b438-cf45ad9ff0fd tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:33.603252 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-4d769867-9581-4bd2-b438-cf45ad9ff0fd tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:33.609729 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d769867-9581-4bd2-b438-cf45ad9ff0fd tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:33.610157 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d769867-9581-4bd2-b438-cf45ad9ff0fd tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:33.610909 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d769867-9581-4bd2-b438-cf45ad9ff0fd tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:33.611342 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-4d769867-9581-4bd2-b438-cf45ad9ff0fd tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:33.745057 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-4d769867-9581-4bd2-b438-cf45ad9ff0fd tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:33.752441 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-4d769867-9581-4bd2-b438-cf45ad9ff0fd tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1260 microversion: 2.1 time: 0.153797 Jul 27 23:25:33.753044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1775/3365] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:33 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:34.774178 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-16d94eb1-2fe5-4ee9-92dc-ebe6914247eb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:34.774780 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-16d94eb1-2fe5-4ee9-92dc-ebe6914247eb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:34.781265 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-16d94eb1-2fe5-4ee9-92dc-ebe6914247eb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:34.781646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-16d94eb1-2fe5-4ee9-92dc-ebe6914247eb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:34.782386 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-16d94eb1-2fe5-4ee9-92dc-ebe6914247eb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:34.782812 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-16d94eb1-2fe5-4ee9-92dc-ebe6914247eb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:34.907872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-16d94eb1-2fe5-4ee9-92dc-ebe6914247eb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:34.915244 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-16d94eb1-2fe5-4ee9-92dc-ebe6914247eb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1260 microversion: 2.1 time: 0.145575 Jul 27 23:25:34.915814 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1591/3366] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:34 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:35.936521 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-70ca61af-149c-4584-beef-8fcacf21fdbc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:35.937143 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-70ca61af-149c-4584-beef-8fcacf21fdbc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:35.939652 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell0:SELECT=2 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:25:35.945861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70ca61af-149c-4584-beef-8fcacf21fdbc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:35.946305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70ca61af-149c-4584-beef-8fcacf21fdbc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:35.947078 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70ca61af-149c-4584-beef-8fcacf21fdbc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:35.947509 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-70ca61af-149c-4584-beef-8fcacf21fdbc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:36.084110 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-70ca61af-149c-4584-beef-8fcacf21fdbc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:36.091438 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-70ca61af-149c-4584-beef-8fcacf21fdbc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1260 microversion: 2.1 time: 0.159069 Jul 27 23:25:36.091994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1776/3367] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:35 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:37.111944 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b201b826-6352-4942-8771-9441042f2d87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:37.112596 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b201b826-6352-4942-8771-9441042f2d87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:37.116394 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=2 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:25:37.117056 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell0:SELECT=6 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:25:37.122035 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b201b826-6352-4942-8771-9441042f2d87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:37.122477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b201b826-6352-4942-8771-9441042f2d87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:37.123232 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b201b826-6352-4942-8771-9441042f2d87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:37.123665 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b201b826-6352-4942-8771-9441042f2d87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:37.261470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b201b826-6352-4942-8771-9441042f2d87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:37.268831 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b201b826-6352-4942-8771-9441042f2d87 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1260 microversion: 2.1 time: 0.160702 Jul 27 23:25:37.269387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1592/3368] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:37 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:38.291282 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8f2f7713-95a0-40e6-90f0-aece0fa981b6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:38.292242 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8f2f7713-95a0-40e6-90f0-aece0fa981b6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:38.298692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f2f7713-95a0-40e6-90f0-aece0fa981b6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:38.299127 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f2f7713-95a0-40e6-90f0-aece0fa981b6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:38.299864 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f2f7713-95a0-40e6-90f0-aece0fa981b6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:38.300290 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8f2f7713-95a0-40e6-90f0-aece0fa981b6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:38.434025 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8f2f7713-95a0-40e6-90f0-aece0fa981b6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:38.441589 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8f2f7713-95a0-40e6-90f0-aece0fa981b6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1260 microversion: 2.1 time: 0.154068 Jul 27 23:25:38.442156 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1777/3369] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:38 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:38.622654 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-ecf7ebce-76c4-4444-a50c-61cbc4b49747 req-1130e47d-d421-43c8-be5a-9919c7c4a6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9410429-a694-4ac4-88ac-7db8cf2c6786", "name": "network-vif-plugged", "status": "completed", "tag": "3bb6d854-ec87-49ce-a58f-07a6f86d69d2"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:25:38.632133 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-ecf7ebce-76c4-4444-a50c-61cbc4b49747 req-1130e47d-d421-43c8-be5a-9919c7c4a6b5 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:38.632597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-ecf7ebce-76c4-4444-a50c-61cbc4b49747 req-1130e47d-d421-43c8-be5a-9919c7c4a6b5 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:38.643182 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-ecf7ebce-76c4-4444-a50c-61cbc4b49747 req-1130e47d-d421-43c8-be5a-9919c7c4a6b5 service nova] Creating event network-vif-plugged:3bb6d854-ec87-49ce-a58f-07a6f86d69d2 for instance e9410429-a694-4ac4-88ac-7db8cf2c6786 on hv-cinder-85124 Jul 27 23:25:38.648522 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-ecf7ebce-76c4-4444-a50c-61cbc4b49747 req-1130e47d-d421-43c8-be5a-9919c7c4a6b5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088881 Jul 27 23:25:38.649102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1593/3370] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:25:39.461917 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-f45e8c79-51c2-4ad4-b5a1-c8c09ff254ac tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:39.462529 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-f45e8c79-51c2-4ad4-b5a1-c8c09ff254ac tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:39.469068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f45e8c79-51c2-4ad4-b5a1-c8c09ff254ac tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:39.469515 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f45e8c79-51c2-4ad4-b5a1-c8c09ff254ac tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:39.470272 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f45e8c79-51c2-4ad4-b5a1-c8c09ff254ac tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:39.470921 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-f45e8c79-51c2-4ad4-b5a1-c8c09ff254ac tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:39.609452 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-f45e8c79-51c2-4ad4-b5a1-c8c09ff254ac tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:39.617785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-f45e8c79-51c2-4ad4-b5a1-c8c09ff254ac tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1260 microversion: 2.1 time: 0.159816 Jul 27 23:25:39.618348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1778/3371] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:39 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:40.639768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-198f30b7-f5bb-42ed-abc3-b298b573eed3 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:40.640454 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-198f30b7-f5bb-42ed-abc3-b298b573eed3 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:40.647239 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-198f30b7-f5bb-42ed-abc3-b298b573eed3 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:40.647708 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-198f30b7-f5bb-42ed-abc3-b298b573eed3 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:40.648461 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-198f30b7-f5bb-42ed-abc3-b298b573eed3 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:40.648923 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-198f30b7-f5bb-42ed-abc3-b298b573eed3 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:40.785080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-198f30b7-f5bb-42ed-abc3-b298b573eed3 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:40.792437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-198f30b7-f5bb-42ed-abc3-b298b573eed3 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1260 microversion: 2.1 time: 0.157352 Jul 27 23:25:40.793022 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1594/3372] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:40 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:41.813002 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-8cd4465b-75b4-4eaa-9686-e4d2465a91e6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:41.813617 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-8cd4465b-75b4-4eaa-9686-e4d2465a91e6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:41.820076 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8cd4465b-75b4-4eaa-9686-e4d2465a91e6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:41.820523 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8cd4465b-75b4-4eaa-9686-e4d2465a91e6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:41.821305 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8cd4465b-75b4-4eaa-9686-e4d2465a91e6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:41.821739 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-8cd4465b-75b4-4eaa-9686-e4d2465a91e6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:41.952705 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-8cd4465b-75b4-4eaa-9686-e4d2465a91e6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:41.960643 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-8cd4465b-75b4-4eaa-9686-e4d2465a91e6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1445 microversion: 2.1 time: 0.151471 Jul 27 23:25:41.961203 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1779/3373] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:41 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:41.980670 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-10147d8b-b913-4d31-94cc-0f341b7792e0 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:25:41.981285 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-10147d8b-b913-4d31-94cc-0f341b7792e0 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:25:41.987663 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10147d8b-b913-4d31-94cc-0f341b7792e0 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:41.988106 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10147d8b-b913-4d31-94cc-0f341b7792e0 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:41.988885 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10147d8b-b913-4d31-94cc-0f341b7792e0 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:41.989319 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-10147d8b-b913-4d31-94cc-0f341b7792e0 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:42.116333 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-10147d8b-b913-4d31-94cc-0f341b7792e0 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:25:42.123776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-10147d8b-b913-4d31-94cc-0f341b7792e0 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1445 microversion: 2.1 time: 0.146920 Jul 27 23:25:42.124338 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1595/3374] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:25:41 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1445 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:25:44.011769 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-266530c0-5116-4808-8428-340b32eeb7c9 req-a04c76ab-18f6-4ac4-b349-0bc7e64ccb6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9410429-a694-4ac4-88ac-7db8cf2c6786", "tag": "3bb6d854-ec87-49ce-a58f-07a6f86d69d2"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:25:44.021860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-266530c0-5116-4808-8428-340b32eeb7c9 req-a04c76ab-18f6-4ac4-b349-0bc7e64ccb6b service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:25:44.022302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-266530c0-5116-4808-8428-340b32eeb7c9 req-a04c76ab-18f6-4ac4-b349-0bc7e64ccb6b service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:25:44.033138 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-266530c0-5116-4808-8428-340b32eeb7c9 req-a04c76ab-18f6-4ac4-b349-0bc7e64ccb6b service nova] Creating event network-changed:3bb6d854-ec87-49ce-a58f-07a6f86d69d2 for instance e9410429-a694-4ac4-88ac-7db8cf2c6786 on hv-cinder-85124 Jul 27 23:25:44.038181 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-266530c0-5116-4808-8428-340b32eeb7c9 req-a04c76ab-18f6-4ac4-b349-0bc7e64ccb6b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030047 Jul 27 23:25:44.038765 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1780/3375] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:27:38.867609 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:27:38.868137 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:27:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:27:39.240325 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2ba36524-5fab-4f2d-b017-a15ff103d17d] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 27 23:27:39.240888 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:27:39.242506 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=48 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:27:39.246840 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-3ac8f765-9b24-4668-9fcd-f1327dc61889 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:27:39.247364 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-3ac8f765-9b24-4668-9fcd-f1327dc61889 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:39.254697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3ac8f765-9b24-4668-9fcd-f1327dc61889 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:39.255139 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3ac8f765-9b24-4668-9fcd-f1327dc61889 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:39.255881 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3ac8f765-9b24-4668-9fcd-f1327dc61889 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:39.256303 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-3ac8f765-9b24-4668-9fcd-f1327dc61889 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:39.277863 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.objects.instance [None req-3ac8f765-9b24-4668-9fcd-f1327dc61889 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lazy-loading 'flavor' on Instance uuid e9410429-a694-4ac4-88ac-7db8cf2c6786 {{(pid=129294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 23:27:39.349339 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-3ac8f765-9b24-4668-9fcd-f1327dc61889 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "POST /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786/action" status: 202 len: 0 microversion: 2.1 time: 0.110848 Jul 27 23:27:39.349907 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1596/3376] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 23:27:39 2022] POST /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 23:27:39.357259 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1e27bdd-8070-4868-b83d-939a4f8f9725] AMQP server on 10.222.0.47:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 27 23:27:39.357994 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=22 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:27:39.358804 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=50 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:27:39.363163 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-fff2bba5-dec5-41b0-a192-d74587e969f6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:39.363871 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-fff2bba5-dec5-41b0-a192-d74587e969f6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:39.371199 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fff2bba5-dec5-41b0-a192-d74587e969f6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:39.371646 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fff2bba5-dec5-41b0-a192-d74587e969f6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:39.372409 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fff2bba5-dec5-41b0-a192-d74587e969f6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:39.372879 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-fff2bba5-dec5-41b0-a192-d74587e969f6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:39.507357 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-fff2bba5-dec5-41b0-a192-d74587e969f6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:39.514869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-fff2bba5-dec5-41b0-a192-d74587e969f6 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.159817 Jul 27 23:27:39.515421 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1781/3377] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:39 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:40.536776 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-26610273-834f-422a-b512-b91d31c71ebc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:40.537477 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-26610273-834f-422a-b512-b91d31c71ebc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:40.546430 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-26610273-834f-422a-b512-b91d31c71ebc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:40.546890 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-26610273-834f-422a-b512-b91d31c71ebc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:40.547624 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-26610273-834f-422a-b512-b91d31c71ebc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:40.548049 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-26610273-834f-422a-b512-b91d31c71ebc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:40.553354 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2ba36524-5fab-4f2d-b017-a15ff103d17d] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 46646. Jul 27 23:27:40.680050 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-26610273-834f-422a-b512-b91d31c71ebc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:40.687507 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-26610273-834f-422a-b512-b91d31c71ebc tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.155083 Jul 27 23:27:40.688068 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1597/3378] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:40 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:41.437834 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:27:41.438311 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:27:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:27:41.708599 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-0d970163-2996-4e61-8be4-75b3e749d1a4 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:41.709128 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-0d970163-2996-4e61-8be4-75b3e749d1a4 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:41.716927 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d970163-2996-4e61-8be4-75b3e749d1a4 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:41.717374 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d970163-2996-4e61-8be4-75b3e749d1a4 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:41.718129 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d970163-2996-4e61-8be4-75b3e749d1a4 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:41.718562 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-0d970163-2996-4e61-8be4-75b3e749d1a4 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:41.723748 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1e27bdd-8070-4868-b83d-939a4f8f9725] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 46658. Jul 27 23:27:41.854198 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-0d970163-2996-4e61-8be4-75b3e749d1a4 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:41.861626 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-0d970163-2996-4e61-8be4-75b3e749d1a4 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.156974 Jul 27 23:27:41.862181 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1782/3379] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:41 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:41.906616 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:27:41.907317 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:27:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:27:42.181154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:27:42.181302 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:27:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:27:42.884395 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b7f229db-632c-4a23-8d92-f5d60b76a507 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:42.884956 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b7f229db-632c-4a23-8d92-f5d60b76a507 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:42.891425 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7f229db-632c-4a23-8d92-f5d60b76a507 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:42.891895 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7f229db-632c-4a23-8d92-f5d60b76a507 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:42.892671 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7f229db-632c-4a23-8d92-f5d60b76a507 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:42.893102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b7f229db-632c-4a23-8d92-f5d60b76a507 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:43.019314 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b7f229db-632c-4a23-8d92-f5d60b76a507 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:43.027452 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b7f229db-632c-4a23-8d92-f5d60b76a507 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.147974 Jul 27 23:27:43.028010 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1598/3380] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:42 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:44.048728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-15bfc89d-0c80-42f1-8475-cd89401cee71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:44.049372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-15bfc89d-0c80-42f1-8475-cd89401cee71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:44.055841 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15bfc89d-0c80-42f1-8475-cd89401cee71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:44.056281 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15bfc89d-0c80-42f1-8475-cd89401cee71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:44.057084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15bfc89d-0c80-42f1-8475-cd89401cee71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:44.057520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-15bfc89d-0c80-42f1-8475-cd89401cee71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:44.187095 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-15bfc89d-0c80-42f1-8475-cd89401cee71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:44.195027 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-15bfc89d-0c80-42f1-8475-cd89401cee71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.149763 Jul 27 23:27:44.195586 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1783/3381] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:44 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:45.216045 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-71b4a5f7-86cc-4388-be80-dccceaed8bae tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:45.216677 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-71b4a5f7-86cc-4388-be80-dccceaed8bae tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:45.223163 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-71b4a5f7-86cc-4388-be80-dccceaed8bae tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:45.223607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-71b4a5f7-86cc-4388-be80-dccceaed8bae tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:45.224362 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-71b4a5f7-86cc-4388-be80-dccceaed8bae tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:45.224821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-71b4a5f7-86cc-4388-be80-dccceaed8bae tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:45.355470 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-71b4a5f7-86cc-4388-be80-dccceaed8bae tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:45.362902 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-71b4a5f7-86cc-4388-be80-dccceaed8bae tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.150700 Jul 27 23:27:45.363462 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1599/3382] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:45 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:46.384774 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-47fc50da-8081-41bc-96f0-93fdfbae3589 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:46.385352 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-47fc50da-8081-41bc-96f0-93fdfbae3589 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:46.391770 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-47fc50da-8081-41bc-96f0-93fdfbae3589 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:46.392212 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-47fc50da-8081-41bc-96f0-93fdfbae3589 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:46.392997 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-47fc50da-8081-41bc-96f0-93fdfbae3589 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:46.393434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-47fc50da-8081-41bc-96f0-93fdfbae3589 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:46.520140 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-47fc50da-8081-41bc-96f0-93fdfbae3589 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:46.527489 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-47fc50da-8081-41bc-96f0-93fdfbae3589 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.147342 Jul 27 23:27:46.528044 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1784/3383] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:46 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:47.548781 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d47b9e95-450d-43f4-9791-508a3ac3ac31 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:47.549391 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d47b9e95-450d-43f4-9791-508a3ac3ac31 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:47.557416 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d47b9e95-450d-43f4-9791-508a3ac3ac31 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:47.558102 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d47b9e95-450d-43f4-9791-508a3ac3ac31 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:47.558872 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d47b9e95-450d-43f4-9791-508a3ac3ac31 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:47.559476 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d47b9e95-450d-43f4-9791-508a3ac3ac31 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:47.708792 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d47b9e95-450d-43f4-9791-508a3ac3ac31 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:47.716158 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d47b9e95-450d-43f4-9791-508a3ac3ac31 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.171287 Jul 27 23:27:47.716744 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1600/3384] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:47 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:48.737053 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-16166e1f-2d28-4cf1-87b3-44608f5d4a36 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:48.737691 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-16166e1f-2d28-4cf1-87b3-44608f5d4a36 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:48.744372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-16166e1f-2d28-4cf1-87b3-44608f5d4a36 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:48.744848 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-16166e1f-2d28-4cf1-87b3-44608f5d4a36 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:48.745606 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-16166e1f-2d28-4cf1-87b3-44608f5d4a36 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:48.746040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-16166e1f-2d28-4cf1-87b3-44608f5d4a36 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:48.872372 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-16166e1f-2d28-4cf1-87b3-44608f5d4a36 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:48.880022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-16166e1f-2d28-4cf1-87b3-44608f5d4a36 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.146690 Jul 27 23:27:48.880669 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1785/3385] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:48 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:49.902270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-e44fb769-05e5-4f27-b4ac-3575a028936b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:49.902877 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-e44fb769-05e5-4f27-b4ac-3575a028936b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:49.909393 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e44fb769-05e5-4f27-b4ac-3575a028936b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:49.909834 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e44fb769-05e5-4f27-b4ac-3575a028936b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:49.910582 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e44fb769-05e5-4f27-b4ac-3575a028936b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:49.911006 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-e44fb769-05e5-4f27-b4ac-3575a028936b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:50.039005 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-e44fb769-05e5-4f27-b4ac-3575a028936b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:50.046796 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-e44fb769-05e5-4f27-b4ac-3575a028936b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.148884 Jul 27 23:27:50.047498 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1601/3386] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:49 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:51.067474 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1e18233a-9403-477e-a63f-5d39e139e22a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:51.068084 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1e18233a-9403-477e-a63f-5d39e139e22a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:51.074651 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e18233a-9403-477e-a63f-5d39e139e22a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:51.075088 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e18233a-9403-477e-a63f-5d39e139e22a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:51.075830 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e18233a-9403-477e-a63f-5d39e139e22a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:51.076256 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1e18233a-9403-477e-a63f-5d39e139e22a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:51.207728 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1e18233a-9403-477e-a63f-5d39e139e22a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:51.215692 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1e18233a-9403-477e-a63f-5d39e139e22a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.152027 Jul 27 23:27:51.216255 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1786/3387] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:51 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:52.236979 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-b2f73c29-6a6c-45d7-b5b9-5c6c8539f3f1 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:52.237560 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-b2f73c29-6a6c-45d7-b5b9-5c6c8539f3f1 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:52.244668 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2f73c29-6a6c-45d7-b5b9-5c6c8539f3f1 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:52.245122 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2f73c29-6a6c-45d7-b5b9-5c6c8539f3f1 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:52.246290 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2f73c29-6a6c-45d7-b5b9-5c6c8539f3f1 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:52.246414 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-b2f73c29-6a6c-45d7-b5b9-5c6c8539f3f1 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:52.388126 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-b2f73c29-6a6c-45d7-b5b9-5c6c8539f3f1 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:52.396248 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-b2f73c29-6a6c-45d7-b5b9-5c6c8539f3f1 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.163043 Jul 27 23:27:52.396984 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1602/3388] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:52 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:53.418534 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-45f13dc0-a904-4bf7-98f2-3c599e17f9f5 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:53.419104 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-45f13dc0-a904-4bf7-98f2-3c599e17f9f5 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:53.425683 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45f13dc0-a904-4bf7-98f2-3c599e17f9f5 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:53.426132 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45f13dc0-a904-4bf7-98f2-3c599e17f9f5 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:53.426890 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45f13dc0-a904-4bf7-98f2-3c599e17f9f5 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:53.427328 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-45f13dc0-a904-4bf7-98f2-3c599e17f9f5 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:53.559910 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-45f13dc0-a904-4bf7-98f2-3c599e17f9f5 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:53.567483 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-45f13dc0-a904-4bf7-98f2-3c599e17f9f5 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1510 microversion: 2.1 time: 0.153378 Jul 27 23:27:53.568139 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1787/3389] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:53 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:53.588806 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-36051ea2-6ddf-40bf-b3a5-45f007ca2206 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:27:53.589458 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-36051ea2-6ddf-40bf-b3a5-45f007ca2206 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:53.596059 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36051ea2-6ddf-40bf-b3a5-45f007ca2206 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:53.596497 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36051ea2-6ddf-40bf-b3a5-45f007ca2206 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:53.597283 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36051ea2-6ddf-40bf-b3a5-45f007ca2206 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:53.597707 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-36051ea2-6ddf-40bf-b3a5-45f007ca2206 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:53.642484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-36051ea2-6ddf-40bf-b3a5-45f007ca2206 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129294) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 27 23:27:53.713062 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-36051ea2-6ddf-40bf-b3a5-45f007ca2206 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "POST /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786/action" status: 202 len: 0 microversion: 2.1 time: 0.128271 Jul 27 23:27:53.714011 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1603/3390] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Jul 27 23:27:53 2022] POST /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 23:27:53.721716 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-18127097-f6cf-4b12-b4a2-396eb8699d8b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:53.730287 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-18127097-f6cf-4b12-b4a2-396eb8699d8b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:53.736459 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18127097-f6cf-4b12-b4a2-396eb8699d8b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:53.736957 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18127097-f6cf-4b12-b4a2-396eb8699d8b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:53.737840 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18127097-f6cf-4b12-b4a2-396eb8699d8b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:53.738333 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-18127097-f6cf-4b12-b4a2-396eb8699d8b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:53.874520 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-18127097-f6cf-4b12-b4a2-396eb8699d8b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:53.882224 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-18127097-f6cf-4b12-b4a2-396eb8699d8b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1518 microversion: 2.1 time: 0.164332 Jul 27 23:27:53.882785 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1788/3391] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:53 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:54.903123 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-5a80bfd3-d959-4649-a726-d1eada454fdb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:54.903740 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-5a80bfd3-d959-4649-a726-d1eada454fdb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:54.910538 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a80bfd3-d959-4649-a726-d1eada454fdb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:54.910991 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a80bfd3-d959-4649-a726-d1eada454fdb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:54.911757 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a80bfd3-d959-4649-a726-d1eada454fdb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:54.912195 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-5a80bfd3-d959-4649-a726-d1eada454fdb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:55.048301 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-5a80bfd3-d959-4649-a726-d1eada454fdb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:55.055844 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-5a80bfd3-d959-4649-a726-d1eada454fdb tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1520 microversion: 2.1 time: 0.156622 Jul 27 23:27:55.056407 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1604/3392] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:54 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:55.314979 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-8d57f08b-afa7-4abf-8be8-7357b4fc6d6f req-333f7381-c003-4175-8675-ef01695bd3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9410429-a694-4ac4-88ac-7db8cf2c6786", "name": "network-vif-unplugged", "status": "completed", "tag": "3bb6d854-ec87-49ce-a58f-07a6f86d69d2"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:27:55.324822 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-8d57f08b-afa7-4abf-8be8-7357b4fc6d6f req-333f7381-c003-4175-8675-ef01695bd3d8 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:55.325245 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-8d57f08b-afa7-4abf-8be8-7357b4fc6d6f req-333f7381-c003-4175-8675-ef01695bd3d8 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:55.337241 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-8d57f08b-afa7-4abf-8be8-7357b4fc6d6f req-333f7381-c003-4175-8675-ef01695bd3d8 service nova] Creating event network-vif-unplugged:3bb6d854-ec87-49ce-a58f-07a6f86d69d2 for instance e9410429-a694-4ac4-88ac-7db8cf2c6786 on hv-cinder-85124 Jul 27 23:27:55.342157 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-8d57f08b-afa7-4abf-8be8-7357b4fc6d6f req-333f7381-c003-4175-8675-ef01695bd3d8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030813 Jul 27 23:27:55.342920 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1789/3393] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:27:56.078193 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-04441d6d-a181-4889-b6be-0557fe47176e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:56.078794 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-04441d6d-a181-4889-b6be-0557fe47176e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:56.085297 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04441d6d-a181-4889-b6be-0557fe47176e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:56.085735 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04441d6d-a181-4889-b6be-0557fe47176e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:56.086512 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04441d6d-a181-4889-b6be-0557fe47176e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:56.086940 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-04441d6d-a181-4889-b6be-0557fe47176e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:56.215192 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-04441d6d-a181-4889-b6be-0557fe47176e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:56.222571 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-04441d6d-a181-4889-b6be-0557fe47176e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1576 microversion: 2.1 time: 0.148201 Jul 27 23:27:56.223135 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1605/3394] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:56 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:57.245628 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-1657893e-6a40-4408-8608-6833e859341f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:57.246357 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-1657893e-6a40-4408-8608-6833e859341f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:57.252533 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1657893e-6a40-4408-8608-6833e859341f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:57.253001 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1657893e-6a40-4408-8608-6833e859341f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:57.253749 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1657893e-6a40-4408-8608-6833e859341f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:57.254180 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-1657893e-6a40-4408-8608-6833e859341f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:57.383476 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-1657893e-6a40-4408-8608-6833e859341f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:57.390866 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-1657893e-6a40-4408-8608-6833e859341f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1576 microversion: 2.1 time: 0.150736 Jul 27 23:27:57.391431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1790/3395] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:57 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:58.411568 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-25fb5246-71b8-448d-be0e-a14a9f46a79b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:58.412096 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-25fb5246-71b8-448d-be0e-a14a9f46a79b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:58.419076 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-25fb5246-71b8-448d-be0e-a14a9f46a79b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:58.419520 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-25fb5246-71b8-448d-be0e-a14a9f46a79b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:58.420270 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-25fb5246-71b8-448d-be0e-a14a9f46a79b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:58.420743 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-25fb5246-71b8-448d-be0e-a14a9f46a79b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:58.549098 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-25fb5246-71b8-448d-be0e-a14a9f46a79b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:58.557098 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-25fb5246-71b8-448d-be0e-a14a9f46a79b tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1576 microversion: 2.1 time: 0.149503 Jul 27 23:27:58.557658 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1606/3396] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:58 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:27:59.577974 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-a0b5c2ff-5169-428b-818c-fe7b011ea22e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:27:59.578588 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-a0b5c2ff-5169-428b-818c-fe7b011ea22e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:27:59.585233 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0b5c2ff-5169-428b-818c-fe7b011ea22e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:59.585674 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0b5c2ff-5169-428b-818c-fe7b011ea22e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:59.586434 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0b5c2ff-5169-428b-818c-fe7b011ea22e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:27:59.586861 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-a0b5c2ff-5169-428b-818c-fe7b011ea22e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:27:59.714694 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-a0b5c2ff-5169-428b-818c-fe7b011ea22e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:27:59.722022 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-a0b5c2ff-5169-428b-818c-fe7b011ea22e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1576 microversion: 2.1 time: 0.147888 Jul 27 23:27:59.722649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1791/3397] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:27:59 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:28:00.743386 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-35f342cf-9cb6-4ee9-b02b-50d746ab416a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:28:00.743987 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-35f342cf-9cb6-4ee9-b02b-50d746ab416a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:28:00.750463 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-35f342cf-9cb6-4ee9-b02b-50d746ab416a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:00.750899 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-35f342cf-9cb6-4ee9-b02b-50d746ab416a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:00.751646 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-35f342cf-9cb6-4ee9-b02b-50d746ab416a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:00.752069 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-35f342cf-9cb6-4ee9-b02b-50d746ab416a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:00.882597 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-35f342cf-9cb6-4ee9-b02b-50d746ab416a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:28:00.890650 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-35f342cf-9cb6-4ee9-b02b-50d746ab416a tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1576 microversion: 2.1 time: 0.151358 Jul 27 23:28:00.891215 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1607/3398] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:28:00 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:28:01.911701 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-020ae3c8-4f5e-4d6d-8f1d-6eac28dea52f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:28:01.912309 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-020ae3c8-4f5e-4d6d-8f1d-6eac28dea52f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:28:01.918947 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-020ae3c8-4f5e-4d6d-8f1d-6eac28dea52f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:01.919397 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-020ae3c8-4f5e-4d6d-8f1d-6eac28dea52f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:01.920151 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-020ae3c8-4f5e-4d6d-8f1d-6eac28dea52f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:01.920614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-020ae3c8-4f5e-4d6d-8f1d-6eac28dea52f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:02.061145 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-020ae3c8-4f5e-4d6d-8f1d-6eac28dea52f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:28:02.069056 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-020ae3c8-4f5e-4d6d-8f1d-6eac28dea52f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1576 microversion: 2.1 time: 0.161251 Jul 27 23:28:02.069622 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1792/3399] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:28:01 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:28:03.091107 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-d2c61612-c923-40f0-838b-37c80e0187df tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:28:03.091721 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-d2c61612-c923-40f0-838b-37c80e0187df tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:28:03.098194 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d2c61612-c923-40f0-838b-37c80e0187df tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:03.098639 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d2c61612-c923-40f0-838b-37c80e0187df tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:03.099389 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d2c61612-c923-40f0-838b-37c80e0187df tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:03.099821 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-d2c61612-c923-40f0-838b-37c80e0187df tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:03.232778 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-d2c61612-c923-40f0-838b-37c80e0187df tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:28:03.240185 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-d2c61612-c923-40f0-838b-37c80e0187df tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1576 microversion: 2.1 time: 0.152977 Jul 27 23:28:03.240900 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1608/3400] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:28:03 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:28:04.261426 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-90866c09-b558-4944-bc2d-d10cefafab71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:28:04.262034 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-90866c09-b558-4944-bc2d-d10cefafab71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:28:04.268396 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90866c09-b558-4944-bc2d-d10cefafab71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:04.268869 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90866c09-b558-4944-bc2d-d10cefafab71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:04.269614 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90866c09-b558-4944-bc2d-d10cefafab71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:04.270040 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-90866c09-b558-4944-bc2d-d10cefafab71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:04.399477 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-90866c09-b558-4944-bc2d-d10cefafab71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:28:04.406916 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-90866c09-b558-4944-bc2d-d10cefafab71 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1576 microversion: 2.1 time: 0.149272 Jul 27 23:28:04.407465 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1793/3401] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:28:04 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:28:05.427160 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-c562b5be-5d54-4a2d-839e-adcd39e8114f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:28:05.427768 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-c562b5be-5d54-4a2d-839e-adcd39e8114f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:28:05.435489 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c562b5be-5d54-4a2d-839e-adcd39e8114f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:05.435934 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c562b5be-5d54-4a2d-839e-adcd39e8114f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:05.436512 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [req-bbbc4329-6255-4e2c-b61b-1683c23167bc req-2b08428d-7b76-412e-8fbe-0e0b758e00e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9410429-a694-4ac4-88ac-7db8cf2c6786", "name": "network-vif-plugged", "status": "completed", "tag": "3bb6d854-ec87-49ce-a58f-07a6f86d69d2"}]} {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:28:05.436973 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c562b5be-5d54-4a2d-839e-adcd39e8114f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:05.437151 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-c562b5be-5d54-4a2d-839e-adcd39e8114f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:05.447887 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-bbbc4329-6255-4e2c-b61b-1683c23167bc req-2b08428d-7b76-412e-8fbe-0e0b758e00e2 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:05.448422 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [req-bbbc4329-6255-4e2c-b61b-1683c23167bc req-2b08428d-7b76-412e-8fbe-0e0b758e00e2 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:05.456591 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:28:05.460122 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.compute.server_external_events [req-bbbc4329-6255-4e2c-b61b-1683c23167bc req-2b08428d-7b76-412e-8fbe-0e0b758e00e2 service nova] Creating event network-vif-plugged:3bb6d854-ec87-49ce-a58f-07a6f86d69d2 for instance e9410429-a694-4ac4-88ac-7db8cf2c6786 on hv-cinder-85124 Jul 27 23:28:05.465383 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [req-bbbc4329-6255-4e2c-b61b-1683c23167bc req-2b08428d-7b76-412e-8fbe-0e0b758e00e2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032791 Jul 27 23:28:05.466112 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1794/3402] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 23:28:05.577765 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-c562b5be-5d54-4a2d-839e-adcd39e8114f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:28:05.586642 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-c562b5be-5d54-4a2d-839e-adcd39e8114f tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1576 microversion: 2.1 time: 0.162697 Jul 27 23:28:05.587534 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1609/3403] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:28:05 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:28:06.609682 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-76f472f1-baea-4e89-97ce-85db29339a52 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:28:06.610378 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-76f472f1-baea-4e89-97ce-85db29339a52 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:28:06.617064 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76f472f1-baea-4e89-97ce-85db29339a52 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:06.617766 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76f472f1-baea-4e89-97ce-85db29339a52 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:06.618518 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76f472f1-baea-4e89-97ce-85db29339a52 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:06.618950 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-76f472f1-baea-4e89-97ce-85db29339a52 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:06.751550 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-76f472f1-baea-4e89-97ce-85db29339a52 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:28:06.759502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-76f472f1-baea-4e89-97ce-85db29339a52 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1576 microversion: 2.1 time: 0.154085 Jul 27 23:28:06.760062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1795/3404] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:28:06 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:28:07.780433 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-4310e372-7b13-4217-bd2f-c5b065fe2fde tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:28:07.781083 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-4310e372-7b13-4217-bd2f-c5b065fe2fde tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:28:07.787484 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4310e372-7b13-4217-bd2f-c5b065fe2fde tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:07.787923 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4310e372-7b13-4217-bd2f-c5b065fe2fde tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:07.788695 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4310e372-7b13-4217-bd2f-c5b065fe2fde tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:28:07.789120 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-4310e372-7b13-4217-bd2f-c5b065fe2fde tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:28:07.915816 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-4310e372-7b13-4217-bd2f-c5b065fe2fde tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:28:07.923145 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-4310e372-7b13-4217-bd2f-c5b065fe2fde tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1563 microversion: 2.1 time: 0.146556 Jul 27 23:28:07.923697 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1610/3405] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:28:07 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1563 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:29:22.095086 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:29:22.095830 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG dbcounter [-] [129294] Writing DB stats nova_cell1:SELECT=8 {{(pid=129294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:29:22.097401 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_api:SELECT=30 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:29:22.098580 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG dbcounter [-] [129295] Writing DB stats nova_cell1:SELECT=82 {{(pid=129295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:29:22.105569 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-bf26a59b-028e-41f9-be5c-5cddf15d4962 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:29:22.106063 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bf26a59b-028e-41f9-be5c-5cddf15d4962 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:29:22.117431 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf26a59b-028e-41f9-be5c-5cddf15d4962 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:29:22.117686 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf26a59b-028e-41f9-be5c-5cddf15d4962 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:29:22.119133 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf26a59b-028e-41f9-be5c-5cddf15d4962 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:29:22.119581 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-bf26a59b-028e-41f9-be5c-5cddf15d4962 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:29:22.146980 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-bf26a59b-028e-41f9-be5c-5cddf15d4962 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Going to try to terminate instance {{(pid=129295) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 23:29:22.222218 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-d3236572-3449-4f13-b352-76b817e1db13 req-0f82568b-8bf9-4765-97ba-6fcec1a87887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9410429-a694-4ac4-88ac-7db8cf2c6786", "tag": "3bb6d854-ec87-49ce-a58f-07a6f86d69d2"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:29:22.234999 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-d3236572-3449-4f13-b352-76b817e1db13 req-0f82568b-8bf9-4765-97ba-6fcec1a87887 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:29:22.236313 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-d3236572-3449-4f13-b352-76b817e1db13 req-0f82568b-8bf9-4765-97ba-6fcec1a87887 service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:29:22.240152 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-bf26a59b-028e-41f9-be5c-5cddf15d4962 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 204 len: 0 microversion: 2.1 time: 0.149027 Jul 27 23:29:22.244642 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1796/3406] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Jul 27 23:29:22 2022] DELETE /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 23:29:22.251038 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-d3236572-3449-4f13-b352-76b817e1db13 req-0f82568b-8bf9-4765-97ba-6fcec1a87887 service nova] Creating event network-changed:3bb6d854-ec87-49ce-a58f-07a6f86d69d2 for instance e9410429-a694-4ac4-88ac-7db8cf2c6786 on hv-cinder-85124 Jul 27 23:29:22.252380 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-92298e67-d833-4e2c-82b9-79e66c1b828e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:29:22.253135 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-92298e67-d833-4e2c-82b9-79e66c1b828e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:29:22.257233 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-d3236572-3449-4f13-b352-76b817e1db13 req-0f82568b-8bf9-4765-97ba-6fcec1a87887 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163404 Jul 27 23:29:22.258316 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1611/3407] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 23:29:22.262742 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-92298e67-d833-4e2c-82b9-79e66c1b828e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:29:22.263184 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-92298e67-d833-4e2c-82b9-79e66c1b828e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:29:22.263950 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-92298e67-d833-4e2c-82b9-79e66c1b828e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:29:22.264376 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-92298e67-d833-4e2c-82b9-79e66c1b828e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:29:22.399062 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-92298e67-d833-4e2c-82b9-79e66c1b828e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:29:22.407295 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-92298e67-d833-4e2c-82b9-79e66c1b828e tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.160535 Jul 27 23:29:22.407860 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1797/3408] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:29:22 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 23:29:23.429585 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-81faf7d4-9350-4bad-b75d-717157f7f4f8 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:29:23.430210 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.compute.api [None req-81faf7d4-9350-4bad-b75d-717157f7f4f8 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129294) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:29:23.436437 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-81faf7d4-9350-4bad-b75d-717157f7f4f8 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:29:23.436913 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-81faf7d4-9350-4bad-b75d-717157f7f4f8 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:29:23.437657 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-81faf7d4-9350-4bad-b75d-717157f7f4f8 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:29:23.438089 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [None req-81faf7d4-9350-4bad-b75d-717157f7f4f8 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:29:23.572387 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.policy [None req-81faf7d4-9350-4bad-b75d-717157f7f4f8 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129294) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:29:23.580030 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-81faf7d4-9350-4bad-b75d-717157f7f4f8 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1569 microversion: 2.1 time: 0.155313 Jul 27 23:29:23.580607 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1612/3409] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:29:23 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:29:24.601024 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-899f9ceb-9094-4d50-9f54-4314d93d24fe tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:29:24.601655 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-899f9ceb-9094-4d50-9f54-4314d93d24fe tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:29:24.609827 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-899f9ceb-9094-4d50-9f54-4314d93d24fe tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:29:24.610283 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-899f9ceb-9094-4d50-9f54-4314d93d24fe tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:29:24.611077 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-899f9ceb-9094-4d50-9f54-4314d93d24fe tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:29:24.611558 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-899f9ceb-9094-4d50-9f54-4314d93d24fe tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:29:24.683118 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.policy [None req-899f9ceb-9094-4d50-9f54-4314d93d24fe tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eb6d71e41a4cb4889d956b6a84f975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bdecf8fad2460d969f4dad6ced9d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129295) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 23:29:24.685504 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [req-eec596a8-4f53-43f4-a1a6-3ab7c5b33606 req-c5fa4ab5-d5cb-4e27-b0ec-02ce7897dd4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9410429-a694-4ac4-88ac-7db8cf2c6786", "name": "network-vif-deleted", "tag": "3bb6d854-ec87-49ce-a58f-07a6f86d69d2"}]} {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 23:29:24.692612 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-899f9ceb-9094-4d50-9f54-4314d93d24fe tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 200 len: 1383 microversion: 2.1 time: 0.095392 Jul 27 23:29:24.693649 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1798/3410] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:29:24 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 1383 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 23:29:24.695448 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-eec596a8-4f53-43f4-a1a6-3ab7c5b33606 req-c5fa4ab5-d5cb-4e27-b0ec-02ce7897dd4e service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:29:24.695883 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG oslo_concurrency.lockutils [req-eec596a8-4f53-43f4-a1a6-3ab7c5b33606 req-c5fa4ab5-d5cb-4e27-b0ec-02ce7897dd4e service nova] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:29:24.707080 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.compute.server_external_events [req-eec596a8-4f53-43f4-a1a6-3ab7c5b33606 req-c5fa4ab5-d5cb-4e27-b0ec-02ce7897dd4e service nova] Creating event network-vif-deleted:3bb6d854-ec87-49ce-a58f-07a6f86d69d2 for instance e9410429-a694-4ac4-88ac-7db8cf2c6786 on hv-cinder-85124 Jul 27 23:29:24.711876 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [req-eec596a8-4f53-43f4-a1a6-3ab7c5b33606 req-c5fa4ab5-d5cb-4e27-b0ec-02ce7897dd4e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106559 Jul 27 23:29:24.712501 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1613/3411] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Jul 27 23:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 23:29:25.713897 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-772a5595-e650-4a97-b1c4-2bb510183009 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '>' {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:29:25.714445 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.compute.api [None req-772a5595-e650-4a97-b1c4-2bb510183009 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] [instance: e9410429-a694-4ac4-88ac-7db8cf2c6786] Fetching instance by UUID {{(pid=129295) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 23:29:25.720872 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-772a5595-e650-4a97-b1c4-2bb510183009 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:29:25.721319 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-772a5595-e650-4a97-b1c4-2bb510183009 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:29:25.722068 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-772a5595-e650-4a97-b1c4-2bb510183009 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 23:29:25.722502 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG oslo_concurrency.lockutils [None req-772a5595-e650-4a97-b1c4-2bb510183009 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Lock "fe71611c-dbfe-47bb-b77e-29ffa97fa073" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 23:29:25.737492 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.wsgi [None req-772a5595-e650-4a97-b1c4-2bb510183009 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] HTTP exception thrown: Instance e9410429-a694-4ac4-88ac-7db8cf2c6786 could not be found. Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-772a5595-e650-4a97-b1c4-2bb510183009 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Request method failure captured: Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: request: GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 HTTP/1.1 Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept: application/json Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Accept-Encoding: identity Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Connection: close Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Length: 0 Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Content-Type: application/json Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Host: 10.222.0.47 Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Openstack-System-Scope: None Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: User-Agent: python-urllib3/1.26.10 Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Auth-Token: gAAAAABi4clHt4xEQH11FsDQIPn6axv3iOnnPfvYbUoaJD4_n9rElypBUfIQnQH7Ajv841x-sCWDVBvZAAHwzSyD8KV96s-dTbFYuwbUC1dQ_NCfS0lv6Lgqj1T1FRQQEL91SB_TxIvDzCur7rta_JLJ_zNGjy5p5UUKnnv0ewYVqRF5v7g3RVY Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Id: None Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Domain-Name: None Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Identity-Status: Confirmed Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Is-Admin-Project: True Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Id: default Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Domain-Name: Default Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Id: 80bdecf8fad2460d969f4dad6ced9d9a Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Project-Name: tempest-TestShelveInstance-255437848 Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Role: member,reader Jul 27 23:29:25.739091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Roles: member,reader Jul 27 23:29:25.740464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/80bdecf8fad2460d969f4dad6ced9d9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_80bdecf8fad2460d969f4dad6ced9d9a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/80bdecf8fad2460d969f4dad6ced9d9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/80bdecf8fad2460d969f4dad6ced9d9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}] Jul 27 23:29:25.740464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant: tempest-TestShelveInstance-255437848 Jul 27 23:29:25.740464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Id: 80bdecf8fad2460d969f4dad6ced9d9a Jul 27 23:29:25.740464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-Tenant-Name: tempest-TestShelveInstance-255437848 Jul 27 23:29:25.740464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User: tempest-TestShelveInstance-255437848-project Jul 27 23:29:25.740464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Id: default Jul 27 23:29:25.740464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Domain-Name: Default Jul 27 23:29:25.740464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Id: a4eb6d71e41a4cb4889d956b6a84f975 Jul 27 23:29:25.740464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: X-User-Name: tempest-TestShelveInstance-255437848-project Jul 27 23:29:25.740464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: method: > Jul 27 23:29:25.740464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: exception: Instance e9410429-a694-4ac4-88ac-7db8cf2c6786 could not be found. Jul 27 23:29:25.740464 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: action_args: {'id': 'e9410429-a694-4ac4-88ac-7db8cf2c6786'} Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: {{(pid=129295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9410429-a694-4ac4-88ac-7db8cf2c6786 could not be found. Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 23:29:25.741277 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9410429-a694-4ac4-88ac-7db8cf2c6786 could not be found. Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9410429-a694-4ac4-88ac-7db8cf2c6786 could not be found. Jul 27 23:29:25.742348 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: ERROR nova.api.openstack.wsgi Jul 27 23:29:25.743792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: DEBUG nova.api.openstack.wsgi [None req-772a5595-e650-4a97-b1c4-2bb510183009 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Returning 404 to user: Instance e9410429-a694-4ac4-88ac-7db8cf2c6786 could not be found. {{(pid=129295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 23:29:25.743792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO nova.api.openstack.requestlog [None req-772a5595-e650-4a97-b1c4-2bb510183009 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786" status: 404 len: 111 microversion: 2.1 time: 0.030518 Jul 27 23:29:25.743792 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: [pid: 129295|app: 0|req: 1799/3412] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Jul 27 23:29:25 2022] GET /compute/v2.1/servers/e9410429-a694-4ac4-88ac-7db8cf2c6786 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 23:29:25.897473 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: DEBUG nova.api.openstack.wsgi [None req-16024421-7092-446a-8be7-5f2319792db8 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] Calling method '.version_select at 0x7f696e9469d0>' {{(pid=129294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 23:29:25.919066 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO nova.api.openstack.requestlog [None req-16024421-7092-446a-8be7-5f2319792db8 tempest-TestShelveInstance-255437848 tempest-TestShelveInstance-255437848-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1099128410" status: 202 len: 0 microversion: 2.1 time: 0.026234 Jul 27 23:29:25.919631 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: [pid: 129294|app: 0|req: 1614/3413] 10.222.0.47 () {58 vars in 1254 bytes} [Wed Jul 27 23:29:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1099128410 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 23:31:01.446091 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:31:01.446619 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:31:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:31:01.915275 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:31:01.915804 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:31:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:31:02.193154 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:31:02.193291 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:31:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:31:27.511468 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:31:27.511951 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:31:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:32:38.877486 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:32:38.878036 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:32:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:34:21.454031 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:34:21.454530 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:34:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:34:21.923101 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:34:21.923617 dv-cinder-851249-4-iscsi devstack@n-api.service[129294]: Wed Jul 27 23:34:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 23:34:22.200775 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 23:34:22.200918 dv-cinder-851249-4-iscsi devstack@n-api.service[129295]: Wed Jul 27 23:34:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!